e2e-kops-grid-gce-calico-u2004-k26 #1614932375857270784 Results

Test Failures

Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should be able to deny attaching pod [Conformance] 1m18s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\sshould\sbe\sable\sto\sdeny\sattaching\spod\s\[Conformance\]$'

test/e2e/apimachinery/webhook.go:941
k8s.io/kubernetes/test/e2e/apimachinery.registerWebhookForAttachingPod(0xc000f9ce10, {0xc0048dd2c0, 0xc}, 0xc00477c140, 0x0?)
	test/e2e/apimachinery/webhook.go:941 +0x791
k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.5()
	test/e2e/apimachinery/webhook.go:210 +0x45
				[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/16/23 10:40:26.22�[0m
Jan 16 10:40:26.221: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename webhook �[38;5;243m01/16/23 10:40:26.221�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/16/23 10:40:26.343�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/16/23 10:40:26.409�[0m
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  test/e2e/framework/metrics/init/init.go:31
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  test/e2e/apimachinery/webhook.go:90
�[1mSTEP:�[0m Setting up server cert �[38;5;243m01/16/23 10:40:26.578�[0m
�[1mSTEP:�[0m Create role binding to let webhook read extension-apiserver-authentication �[38;5;243m01/16/23 10:40:27.15�[0m
�[1mSTEP:�[0m Deploying the webhook pod �[38;5;243m01/16/23 10:40:27.197�[0m
�[1mSTEP:�[0m Wait for the deployment to be ready �[38;5;243m01/16/23 10:40:27.281�[0m
Jan 16 10:40:27.410: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 16, 10, 40, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 16, 10, 40, 27, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 16, 10, 40, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 16, 10, 40, 27, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 16 10:40:29.445: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 16, 10, 40, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 16, 10, 40, 27, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 16, 10, 40, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 16, 10, 40, 27, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 16 10:40:31.445: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 16, 10, 40, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 16, 10, 40, 27, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 16, 10, 40, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 16, 10, 40, 27, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
�[1mSTEP:�[0m Deploying the webhook service �[38;5;243m01/16/23 10:40:33.447�[0m
�[1mSTEP:�[0m Verifying the service has paired with the endpoint �[38;5;243m01/16/23 10:40:33.513�[0m
Jan 16 10:40:34.513: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
[It] should be able to deny attaching pod [Conformance]
  test/e2e/apimachinery/webhook.go:209
�[1mSTEP:�[0m Registering the webhook via the AdmissionRegistration API �[38;5;243m01/16/23 10:40:34.567�[0m
Jan 16 10:40:44.779: INFO: Waiting for webhook configuration to be ready...
Jan 16 10:40:54.988: INFO: Waiting for webhook configuration to be ready...
Jan 16 10:41:05.160: INFO: Waiting for webhook configuration to be ready...
Jan 16 10:41:15.279: INFO: Waiting for webhook configuration to be ready...
Jan 16 10:41:25.450: INFO: Waiting for webhook configuration to be ready...
Jan 16 10:41:25.450: INFO: Unexpected error: waiting for webhook configuration to be ready: 
    <*errors.errorString | 0xc00023b9b0>: {
        s: "timed out waiting for the condition",
    }
Jan 16 10:41:25.450: FAIL: waiting for webhook configuration to be ready: timed out waiting for the condition

Full Stack Trace
k8s.io/kubernetes/test/e2e/apimachinery.registerWebhookForAttachingPod(0xc000f9ce10, {0xc0048dd2c0, 0xc}, 0xc00477c140, 0x0?)
	test/e2e/apimachinery/webhook.go:941 +0x791
k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.5()
	test/e2e/apimachinery/webhook.go:210 +0x45
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  test/e2e/framework/node/init/init.go:32
Jan 16 10:41:25.450: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  test/e2e/apimachinery/webhook.go:105
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/16/23 10:41:25.878�[0m
�[1mSTEP:�[0m Collecting events from namespace "webhook-3105". �[38;5;243m01/16/23 10:41:25.878�[0m
�[1mSTEP:�[0m Found 9 events. �[38;5;243m01/16/23 10:41:25.98�[0m
Jan 16 10:41:25.980: INFO: At 2023-01-16 10:40:27 +0000 UTC - event for sample-webhook-deployment: {deployment-controller } ScalingReplicaSet: Scaled up replica set sample-webhook-deployment-865554f4d9 to 1
Jan 16 10:41:25.980: INFO: At 2023-01-16 10:40:27 +0000 UTC - event for sample-webhook-deployment-865554f4d9: {replicaset-controller } SuccessfulCreate: Created pod: sample-webhook-deployment-865554f4d9-c48qw
Jan 16 10:41:25.980: INFO: At 2023-01-16 10:40:27 +0000 UTC - event for sample-webhook-deployment-865554f4d9-c48qw: {default-scheduler } Scheduled: Successfully assigned webhook-3105/sample-webhook-deployment-865554f4d9-c48qw to nodes-us-east1-b-9h4h
Jan 16 10:41:25.980: INFO: At 2023-01-16 10:40:31 +0000 UTC - event for sample-webhook-deployment-865554f4d9-c48qw: {kubelet nodes-us-east1-b-9h4h} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine
Jan 16 10:41:25.980: INFO: At 2023-01-16 10:40:31 +0000 UTC - event for sample-webhook-deployment-865554f4d9-c48qw: {kubelet nodes-us-east1-b-9h4h} Created: Created container sample-webhook
Jan 16 10:41:25.980: INFO: At 2023-01-16 10:40:31 +0000 UTC - event for sample-webhook-deployment-865554f4d9-c48qw: {kubelet nodes-us-east1-b-9h4h} Started: Started container sample-webhook
Jan 16 10:41:25.980: INFO: At 2023-01-16 10:40:31 +0000 UTC - event for sample-webhook-deployment-865554f4d9-c48qw: {kubelet nodes-us-east1-b-9h4h} Unhealthy: Readiness probe failed: Get "https://100.103.14.231:8444/readyz": dial tcp 100.103.14.231:8444: connect: connection refused
Jan 16 10:41:25.980: INFO: At 2023-01-16 10:40:43 +0000 UTC - event for sample-webhook-deployment-865554f4d9-c48qw: {kubelet nodes-us-east1-b-9h4h} Unhealthy: Readiness probe failed: Get "https://100.103.14.231:8444/readyz": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
Jan 16 10:41:25.980: INFO: At 2023-01-16 10:41:25 +0000 UTC - event for sample-webhook-deployment-865554f4d9-c48qw: {kubelet nodes-us-east1-b-9h4h} Killing: Stopping container sample-webhook
Jan 16 10:41:26.056: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Jan 16 10:41:26.056: INFO: 
Jan 16 10:41:26.179: INFO: 
Logging node info for node control-plane-us-east1-b-nc4v
Jan 16 10:41:26.264: INFO: Node Info: &Node{ObjectMeta:{control-plane-us-east1-b-nc4v    3e043433-4a0a-4797-aed2-d532c70362c4 5776 0 2023-01-16 10:33:51 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-standard-2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:control-plane-us-east1-b-nc4v kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node-role.kubernetes.io/node: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:e2-standard-2 topology.gke.io/zone:us-east1-b topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/control-plane-us-east1-b-nc4v"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.4/32 projectcalico.org/IPv4IPIPTunnelAddr:100.126.126.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-16 10:33:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-16 10:34:31 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:34:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {calico-node Update v1 2023-01-16 10:34:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-16 10:34:51 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:34:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:34:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-16 10:40:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/control-plane-us-east1-b-nc4v,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8332767232 0} {<nil>} 8137468Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8227909632 0} {<nil>} 8035068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:34:56 +0000 UTC,LastTransitionTime:2023-01-16 10:34:56 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 10:40:09 +0000 UTC,LastTransitionTime:2023-01-16 10:33:51 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 10:40:09 +0000 UTC,LastTransitionTime:2023-01-16 10:33:51 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 10:40:09 +0000 UTC,LastTransitionTime:2023-01-16 10:33:51 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 10:40:09 +0000 UTC,LastTransitionTime:2023-01-16 10:34:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.4,},NodeAddress{Type:ExternalIP,Address:35.243.145.107,},NodeAddress{Type:Hostname,Address:control-plane-us-east1-b-nc4v,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e5ac4d7bf983c1b4a0fb9c7211b86ad9,SystemUUID:e5ac4d7b-f983-c1b4-a0fb-9c7211b86ad9,BootID:66119c47-44e2-4c4c-ac93-902592bb3d86,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.0],SizeBytes:135162323,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.0],SizeBytes:124991801,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.0],SizeBytes:57657656,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43637878,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42802014,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:2b6acd7f677f76ffe12ecf3ea7df92eb9b1bdb07336d1ac2a54c7631fb753f7e docker.io/calico/kube-controllers:v3.24.5],SizeBytes:31137169,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2 registry.k8s.io/sig-storage/csi-provisioner:v2.1.0],SizeBytes:21205045,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:50c3cfd458fc8e0bf3c8c521eac39172009382fc66dc5044a330d137c6ed0b09 registry.k8s.io/sig-storage/csi-attacher:v3.1.0],SizeBytes:20103959,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a registry.k8s.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:9af9bf28430b00a0cedeb2ec29acadce45e6afcecd8bdf31c793c624cfa75fa7 registry.k8s.io/sig-storage/csi-snapshotter:v3.0.3],SizeBytes:19500777,},ContainerImage{Names:[docker.io/k8scloudprovidergcp/cloud-controller-manager@sha256:881fd1095937638040723973ade90e6700f1c831a78fb585a3227c4d021b0df9 docker.io/k8scloudprovidergcp/cloud-controller-manager:latest],SizeBytes:18702875,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4967322,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 16 10:41:26.265: INFO: 
Logging kubelet events for node control-plane-us-east1-b-nc4v
Jan 16 10:41:26.396: INFO: 
Logging pods the kubelet thinks is on node control-plane-us-east1-b-nc4v
Jan 16 10:41:26.489: INFO: dns-controller-6d5f4bf5d6-kqf4d started at 2023-01-16 10:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:26.489: INFO: 	Container dns-controller ready: true, restart count 0
Jan 16 10:41:26.489: INFO: csi-gce-pd-controller-78fc966fff-m86hh started at 2023-01-16 10:34:31 +0000 UTC (0+5 container statuses recorded)
Jan 16 10:41:26.489: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 16 10:41:26.489: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 16 10:41:26.489: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 16 10:41:26.489: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 16 10:41:26.489: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 10:41:26.489: INFO: kops-controller-smdjr started at 2023-01-16 10:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:26.489: INFO: 	Container kops-controller ready: true, restart count 0
Jan 16 10:41:26.489: INFO: kube-scheduler-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:26.489: INFO: 	Container kube-scheduler ready: true, restart count 0
Jan 16 10:41:26.489: INFO: etcd-manager-events-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:26.489: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 16 10:41:26.489: INFO: etcd-manager-main-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:26.489: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 16 10:41:26.489: INFO: kube-apiserver-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+2 container statuses recorded)
Jan 16 10:41:26.489: INFO: 	Container healthcheck ready: true, restart count 0
Jan 16 10:41:26.489: INFO: 	Container kube-apiserver ready: true, restart count 1
Jan 16 10:41:26.489: INFO: csi-gce-pd-node-kz9xf started at 2023-01-16 10:34:14 +0000 UTC (0+2 container statuses recorded)
Jan 16 10:41:26.489: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 10:41:26.489: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 10:41:26.489: INFO: kube-controller-manager-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:26.489: INFO: 	Container kube-controller-manager ready: true, restart count 2
Jan 16 10:41:26.489: INFO: kube-proxy-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:26.489: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 10:41:26.489: INFO: calico-node-5jgkc started at 2023-01-16 10:34:24 +0000 UTC (3+1 container statuses recorded)
Jan 16 10:41:26.489: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 10:41:26.489: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 10:41:26.489: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 10:41:26.489: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 10:41:26.489: INFO: cloud-controller-manager-b5qds started at 2023-01-16 10:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:26.489: INFO: 	Container cloud-controller-manager ready: true, restart count 0
Jan 16 10:41:26.489: INFO: calico-kube-controllers-55f488656-hcbkw started at 2023-01-16 10:34:50 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:26.489: INFO: 	Container calico-kube-controllers ready: true, restart count 0
Jan 16 10:41:27.067: INFO: 
Latency metrics for node control-plane-us-east1-b-nc4v
Jan 16 10:41:27.067: INFO: 
Logging node info for node nodes-us-east1-b-2xs4
Jan 16 10:41:27.125: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east1-b-2xs4    5523b1af-a125-4437-baf4-a87ff6e2a424 9128 0 2023-01-16 10:35:00 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east1-b-2xs4 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east1-b topology.hostpath.csi/node:nodes-us-east1-b-2xs4 topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-volumelimits-4667":"nodes-us-east1-b-2xs4","csi-mock-csi-mock-volumes-8487":"nodes-us-east1-b-2xs4","pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/nodes-us-east1-b-2xs4"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.6/32 projectcalico.org/IPv4IPIPTunnelAddr:100.123.6.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2023-01-16 10:35:00 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2023-01-16 10:35:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-16 10:35:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {calico-node Update v1 2023-01-16 10:35:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-16 10:41:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/nodes-us-east1-b-2xs4,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:35:32 +0000 UTC,LastTransitionTime:2023-01-16 10:35:32 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 10:41:17 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 10:41:17 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 10:41:17 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 10:41:17 +0000 UTC,LastTransitionTime:2023-01-16 10:35:20 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.6,},NodeAddress{Type:ExternalIP,Address:35.196.42.74,},NodeAddress{Type:Hostname,Address:nodes-us-east1-b-2xs4,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:39f2b9ba1d525f08f837cadb4248f14d,SystemUUID:39f2b9ba-1d52-5f08-f837-cadb4248f14d,BootID:7acec4fd-f02a-4704-a113-25a81be183ce,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 16 10:41:27.126: INFO: 
Logging kubelet events for node nodes-us-east1-b-2xs4
Jan 16 10:41:27.201: INFO: 
Logging pods the kubelet thinks is on node nodes-us-east1-b-2xs4
Jan 16 10:41:27.318: INFO: simpletest.rc-pcrmp started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:27.318: INFO: simpletest.rc-t4z24 started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:27.318: INFO: simpletest.rc-7jbtq started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:27.318: INFO: simpletest.rc-474k9 started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:27.318: INFO: simpletest.rc-xb2p6 started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:27.318: INFO: simpletest.rc-fg5hv started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:27.318: INFO: simpletest.rc-dv6gx started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:27.318: INFO: concurrent-27897761-rmrj7 started at 2023-01-16 10:41:00 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:27.318: INFO: 	Container c ready: true, restart count 0
Jan 16 10:41:27.318: INFO: simpletest.rc-n7fl8 started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:27.318: INFO: simpletest.rc-hjwhh started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:27.318: INFO: simpletest.rc-kv58d started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:27.318: INFO: simpletest.rc-6wgb7 started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:27.318: INFO: csi-mockplugin-attacher-0 started at 2023-01-16 10:41:20 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:27.318: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 16 10:41:27.318: INFO: dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf started at 2023-01-16 10:41:08 +0000 UTC (0+3 container statuses recorded)
Jan 16 10:41:27.318: INFO: 	Container jessie-querier ready: true, restart count 0
Jan 16 10:41:27.318: INFO: 	Container querier ready: true, restart count 0
Jan 16 10:41:27.318: INFO: 	Container webserver ready: true, restart count 0
Jan 16 10:41:27.318: INFO: externalsvc-w4hgw started at 2023-01-16 10:41:12 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:27.318: INFO: 	Container externalsvc ready: true, restart count 0
Jan 16 10:41:27.318: INFO: simpletest.rc-9pjj2 started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:27.318: INFO: pvc-volume-tester-xp7g8 started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:27.318: INFO: simpletest.rc-dxq4h started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:27.318: INFO: kube-proxy-nodes-us-east1-b-2xs4 started at 2023-01-16 10:34:50 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:27.318: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 10:41:27.318: INFO: csi-gce-pd-node-jc8jn started at 2023-01-16 10:35:10 +0000 UTC (0+2 container statuses recorded)
Jan 16 10:41:27.318: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 10:41:27.318: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 10:41:27.318: INFO: netserver-0 started at 2023-01-16 10:40:55 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:27.318: INFO: 	Container webserver ready: true, restart count 0
Jan 16 10:41:27.318: INFO: netserver-0 started at 2023-01-16 10:41:18 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:27.318: INFO: 	Container webserver ready: false, restart count 0
Jan 16 10:41:27.318: INFO: simpletest.rc-kqdb8 started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:27.318: INFO: calico-node-qlnmx started at 2023-01-16 10:35:10 +0000 UTC (3+1 container statuses recorded)
Jan 16 10:41:27.318: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 10:41:27.318: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 10:41:27.318: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 10:41:27.318: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 10:41:27.318: INFO: simpletest.rc-59hsz started at 2023-01-16 10:41:23 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:27.318: INFO: 	Container nginx ready: false, restart count 0
Jan 16 10:41:27.318: INFO: csi-mockplugin-0 started at 2023-01-16 10:40:23 +0000 UTC (0+4 container statuses recorded)
Jan 16 10:41:27.318: INFO: 	Container busybox ready: true, restart count 0
Jan 16 10:41:27.318: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 16 10:41:27.318: INFO: 	Container driver-registrar ready: true, restart count 0
Jan 16 10:41:27.318: INFO: 	Container mock ready: true, restart count 0
Jan 16 10:41:27.318: INFO: httpd started at 2023-01-16 10:41:03 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:27.318: INFO: 	Container httpd ready: false, restart count 0
Jan 16 10:41:27.318: INFO: csi-hostpathplugin-0 started at 2023-01-16 10:41:14 +0000 UTC (0+7 container statuses recorded)
Jan 16 10:41:27.318: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 16 10:41:27.318: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 16 10:41:27.318: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 16 10:41:27.318: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 16 10:41:27.318: INFO: 	Container hostpath ready: true, restart count 0
Jan 16 10:41:27.318: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 16 10:41:27.318: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 16 10:41:27.318: INFO: simpletest.rc-rdkgk started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:27.318: INFO: dns-test-1c7b56de-ab39-4a1c-bceb-06613d2e4d23 started at 2023-01-16 10:39:58 +0000 UTC (0+3 container statuses recorded)
Jan 16 10:41:27.318: INFO: 	Container jessie-querier ready: true, restart count 0
Jan 16 10:41:27.318: INFO: 	Container querier ready: true, restart count 0
Jan 16 10:41:27.318: INFO: 	Container webserver ready: true, restart count 0
Jan 16 10:41:27.318: INFO: simpletest.rc-5nslc started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:27.318: INFO: simpletest.rc-nldkq started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:27.318: INFO: busybox-f889321e-4dfb-4854-9f38-20e0b9d793cb started at 2023-01-16 10:38:44 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:27.318: INFO: 	Container busybox ready: true, restart count 0
Jan 16 10:41:27.318: INFO: simpletest.rc-f9d7l started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:27.318: INFO: simpletest.rc-v7t86 started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:27.318: INFO: simpletest.rc-qs6p4 started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:27.318: INFO: csi-mockplugin-0 started at 2023-01-16 10:41:20 +0000 UTC (0+3 container statuses recorded)
Jan 16 10:41:27.318: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 16 10:41:27.318: INFO: 	Container driver-registrar ready: true, restart count 0
Jan 16 10:41:27.318: INFO: 	Container mock ready: true, restart count 0
Jan 16 10:41:27.318: INFO: simpletest.rc-v4gm2 started at 2023-01-16 10:41:23 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:27.318: INFO: 	Container nginx ready: false, restart count 0
Jan 16 10:41:27.318: INFO: simpletest.rc-pnx76 started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:27.318: INFO: simpletest.rc-9z977 started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:28.051: INFO: 
Latency metrics for node nodes-us-east1-b-2xs4
Jan 16 10:41:28.051: INFO: 
Logging node info for node nodes-us-east1-b-9h4h
Jan 16 10:41:28.100: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east1-b-9h4h    672ac3b7-ea1d-4e3e-bd88-42fa1b6384a8 8690 0 2023-01-16 10:34:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east1-b-9h4h kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east1-b topology.hostpath.csi/node:nodes-us-east1-b-9h4h topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-8272":"nodes-us-east1-b-9h4h","pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/nodes-us-east1-b-9h4h"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.5/32 projectcalico.org/IPv4IPIPTunnelAddr:100.103.14.192 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-16 10:34:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:34:59 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-16 10:34:59 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:35:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {calico-node Update v1 2023-01-16 10:35:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-16 10:41:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/nodes-us-east1-b-9h4h,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:35:24 +0000 UTC,LastTransitionTime:2023-01-16 10:35:24 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 10:41:16 +0000 UTC,LastTransitionTime:2023-01-16 10:34:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 10:41:16 +0000 UTC,LastTransitionTime:2023-01-16 10:34:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 10:41:16 +0000 UTC,LastTransitionTime:2023-01-16 10:34:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 10:41:16 +0000 UTC,LastTransitionTime:2023-01-16 10:35:13 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.5,},NodeAddress{Type:ExternalIP,Address:35.196.180.243,},NodeAddress{Type:Hostname,Address:nodes-us-east1-b-9h4h,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:828dcdb67e74b8a327b01dc0797be5e1,SystemUUID:828dcdb6-7e74-b8a3-27b0-1dc0797be5e1,BootID:dd05deb0-ef00-47e1-83af-c902277fe4b7,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 16 10:41:28.101: INFO: 
Logging kubelet events for node nodes-us-east1-b-9h4h
Jan 16 10:41:28.163: INFO: 
Logging pods the kubelet thinks is on node nodes-us-east1-b-9h4h
Jan 16 10:41:28.218: INFO: kube-proxy-nodes-us-east1-b-9h4h started at 2023-01-16 10:34:55 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:28.218: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 10:41:28.218: INFO: simpletest.rc-hwct5 started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:28.218: INFO: simpletest.rc-ggcnc started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:28.218: INFO: simpletest.rc-bpfht started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:28.218: INFO: hostexec-nodes-us-east1-b-9h4h-j2wcf started at 2023-01-16 10:41:16 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:28.218: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 16 10:41:28.218: INFO: simpletest.rc-cqv84 started at 2023-01-16 10:41:23 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:28.218: INFO: 	Container nginx ready: false, restart count 0
Jan 16 10:41:28.218: INFO: simpletest.rc-xnm8s started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:28.218: INFO: simpletest.rc-hmgxz started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:28.218: INFO: simpletest.rc-78h25 started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:28.218: INFO: simpletest.rc-87wqr started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:28.218: INFO: deployment-shared-map-item-removal-74d7dd69db-492tx started at 2023-01-16 10:40:50 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:28.218: INFO: 	Container nginx ready: false, restart count 0
Jan 16 10:41:28.218: INFO: netserver-1 started at 2023-01-16 10:41:18 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:28.218: INFO: 	Container webserver ready: false, restart count 0
Jan 16 10:41:28.218: INFO: csi-gce-pd-node-ncgj4 started at 2023-01-16 10:35:01 +0000 UTC (0+2 container statuses recorded)
Jan 16 10:41:28.218: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 10:41:28.218: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 10:41:28.218: INFO: calico-node-gmwsc started at 2023-01-16 10:35:01 +0000 UTC (3+1 container statuses recorded)
Jan 16 10:41:28.218: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 10:41:28.218: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 10:41:28.218: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 10:41:28.218: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 10:41:28.218: INFO: coredns-autoscaler-7cb5c5b969-mpv8x started at 2023-01-16 10:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:28.218: INFO: 	Container autoscaler ready: true, restart count 0
Jan 16 10:41:28.218: INFO: pod-ac24315e-10c9-4522-95e7-9fbaeb57edc2 started at 2023-01-16 10:41:21 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:28.218: INFO: 	Container write-pod ready: true, restart count 0
Jan 16 10:41:28.218: INFO: simpletest.rc-7xs9x started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:28.218: INFO: simpletest.rc-hqxmf started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:28.218: INFO: simpletest.rc-kw84c started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:28.218: INFO: coredns-7bc44848df-zs55k started at 2023-01-16 10:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:28.218: INFO: 	Container coredns ready: true, restart count 0
Jan 16 10:41:28.218: INFO: simpletest.rc-mfhg7 started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:28.218: INFO: csi-hostpathplugin-0 started at 2023-01-16 10:40:35 +0000 UTC (0+7 container statuses recorded)
Jan 16 10:41:28.218: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 16 10:41:28.218: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 16 10:41:28.218: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 16 10:41:28.218: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 16 10:41:28.218: INFO: 	Container hostpath ready: true, restart count 0
Jan 16 10:41:28.218: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 16 10:41:28.218: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 16 10:41:28.218: INFO: simpletest.rc-d6bmn started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:28.218: INFO: simpletest.rc-6rc4x started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:28.218: INFO: dns-test-92a596e0-af91-4e72-b7b2-e00f2807047a started at 2023-01-16 10:39:48 +0000 UTC (0+3 container statuses recorded)
Jan 16 10:41:28.218: INFO: 	Container jessie-querier ready: true, restart count 0
Jan 16 10:41:28.218: INFO: 	Container querier ready: true, restart count 0
Jan 16 10:41:28.218: INFO: 	Container webserver ready: true, restart count 0
Jan 16 10:41:28.218: INFO: concurrent-27897760-wsl4w started at 2023-01-16 10:40:00 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:28.218: INFO: 	Container c ready: true, restart count 0
Jan 16 10:41:28.218: INFO: simpletest.rc-6n7l2 started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:28.218: INFO: simpletest.rc-8qlsk started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:28.218: INFO: simpletest.rc-lgcpw started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:28.218: INFO: netserver-1 started at 2023-01-16 10:40:55 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:28.218: INFO: 	Container webserver ready: true, restart count 0
Jan 16 10:41:28.218: INFO: simpletest.rc-5bpnp started at 2023-01-16 10:41:23 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:28.218: INFO: 	Container nginx ready: false, restart count 0
Jan 16 10:41:28.218: INFO: simpletest.rc-ldpc7 started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:28.218: INFO: simpletest.rc-4ln96 started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:28.219: INFO: simpletest.rc-m6wxz started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:28.219: INFO: simpletest.rc-t5tl8 started at 2023-01-16 10:41:23 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:28.219: INFO: 	Container nginx ready: false, restart count 0
Jan 16 10:41:28.219: INFO: simpletest.rc-5fd84 started at 2023-01-16 10:41:23 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:28.219: INFO: 	Container nginx ready: false, restart count 0
Jan 16 10:41:28.219: INFO: simpletest.rc-bqk2l started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:28.219: INFO: simpletest.rc-np2vw started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:32.339: INFO: 
Latency metrics for node nodes-us-east1-b-9h4h
Jan 16 10:41:32.339: INFO: 
Logging node info for node nodes-us-east1-b-rn9p
Jan 16 10:41:32.429: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east1-b-rn9p    59f4f25d-24bf-4d96-a4bf-2cf266b5c083 8792 0 2023-01-16 10:34:59 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east1-b-rn9p kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east1-b topology.hostpath.csi/node:nodes-us-east1-b-rn9p topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-1247":"nodes-us-east1-b-rn9p","pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/nodes-us-east1-b-rn9p"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.3/32 projectcalico.org/IPv4IPIPTunnelAddr:100.98.60.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-16 10:34:59 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:00 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-16 10:35:01 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {calico-node Update v1 2023-01-16 10:35:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-16 10:41:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/nodes-us-east1-b-rn9p,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:35:26 +0000 UTC,LastTransitionTime:2023-01-16 10:35:26 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 10:41:17 +0000 UTC,LastTransitionTime:2023-01-16 10:34:59 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 10:41:17 +0000 UTC,LastTransitionTime:2023-01-16 10:34:59 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 10:41:17 +0000 UTC,LastTransitionTime:2023-01-16 10:34:59 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 10:41:17 +0000 UTC,LastTransitionTime:2023-01-16 10:35:14 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.3,},NodeAddress{Type:ExternalIP,Address:34.75.49.181,},NodeAddress{Type:Hostname,Address:nodes-us-east1-b-rn9p,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:9f39c983773df4ca6a15315227d6fd51,SystemUUID:9f39c983-773d-f4ca-6a15-315227d6fd51,BootID:7e9ad329-1a6b-4405-ba71-ca92e45658b3,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 16 10:41:32.430: INFO: 
Logging kubelet events for node nodes-us-east1-b-rn9p
Jan 16 10:41:32.564: INFO: 
Logging pods the kubelet thinks is on node nodes-us-east1-b-rn9p
Jan 16 10:41:32.724: INFO: pod-771b61fc-2988-47dc-a2a2-35b949003b63 started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:32.725: INFO: pod-977869b4-2dcd-4668-8670-788dc13de569 started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:32.725: INFO: kube-proxy-nodes-us-east1-b-rn9p started at 2023-01-16 10:34:56 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:32.725: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 10:41:32.725: INFO: hostexec-nodes-us-east1-b-rn9p-v7j4j started at 2023-01-16 10:41:11 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:32.725: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 16 10:41:32.725: INFO: test-ss-1 started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:32.725: INFO: simpletest.rc-rjgm9 started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:32.725: INFO: image-pull-test70c4bafe-c453-45d5-b918-e03bafd1687e started at 2023-01-16 10:41:22 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:32.725: INFO: 	Container image-pull-test ready: false, restart count 0
Jan 16 10:41:32.725: INFO: simpletest.rc-n2hr6 started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:32.725: INFO: simpletest.rc-8lbwp started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:32.725: INFO: simpletest.rc-vtllw started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:32.725: INFO: netserver-2 started at 2023-01-16 10:40:55 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:32.725: INFO: 	Container webserver ready: true, restart count 0
Jan 16 10:41:32.725: INFO: simpletest.rc-nmcd6 started at 2023-01-16 10:41:23 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:32.725: INFO: 	Container nginx ready: false, restart count 0
Jan 16 10:41:32.725: INFO: pod-316adfd8-66b9-4d36-b3d3-83c448e8ec80 started at 2023-01-16 10:41:16 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:32.725: INFO: 	Container write-pod ready: true, restart count 0
Jan 16 10:41:32.725: INFO: adopt-release-z6p4s started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:32.725: INFO: simpletest.rc-9lqfd started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:32.725: INFO: simpletest.rc-pg78n started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:32.725: INFO: pod-ephm-test-projected-vfq5 started at 2023-01-16 10:40:22 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:32.725: INFO: 	Container test-container-subpath-projected-vfq5 ready: false, restart count 0
Jan 16 10:41:32.725: INFO: hostexec-nodes-us-east1-b-rn9p-7trpn started at 2023-01-16 10:40:58 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:32.725: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 16 10:41:32.725: INFO: netserver-2 started at 2023-01-16 10:41:18 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:32.725: INFO: 	Container webserver ready: false, restart count 0
Jan 16 10:41:32.725: INFO: calico-node-ntgj5 started at 2023-01-16 10:35:03 +0000 UTC (3+1 container statuses recorded)
Jan 16 10:41:32.725: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 10:41:32.725: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 10:41:32.725: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 10:41:32.725: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 10:41:32.725: INFO: simpletest.rc-nzbdk started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:32.725: INFO: adopt-release-p5zpw started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:32.725: INFO: csi-gce-pd-node-88f4v started at 2023-01-16 10:35:03 +0000 UTC (0+2 container statuses recorded)
Jan 16 10:41:32.725: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 10:41:32.725: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 10:41:32.725: INFO: simpletest.rc-j8ns9 started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:32.725: INFO: csi-mockplugin-0 started at 2023-01-16 10:40:26 +0000 UTC (0+3 container statuses recorded)
Jan 16 10:41:32.725: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 16 10:41:32.725: INFO: 	Container driver-registrar ready: true, restart count 0
Jan 16 10:41:32.725: INFO: 	Container mock ready: true, restart count 0
Jan 16 10:41:32.725: INFO: simpletest.rc-wvtsf started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:32.725: INFO: simpletest.rc-2rzmt started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:35.775: INFO: 
Latency metrics for node nodes-us-east1-b-rn9p
Jan 16 10:41:35.775: INFO: 
Logging node info for node nodes-us-east1-b-wcrf
Jan 16 10:41:35.851: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east1-b-wcrf    509e8852-b60d-4ccc-864a-4efd7f571608 8691 0 2023-01-16 10:35:00 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east1-b-wcrf kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east1-b topology.hostpath.csi/node:nodes-us-east1-b-wcrf topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/nodes-us-east1-b-wcrf"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.2/32 projectcalico.org/IPv4IPIPTunnelAddr:100.110.242.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-16 10:35:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:01 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-16 10:35:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {calico-node Update v1 2023-01-16 10:35:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-16 10:41:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/nodes-us-east1-b-wcrf,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:35:27 +0000 UTC,LastTransitionTime:2023-01-16 10:35:27 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 10:41:08 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 10:41:08 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 10:41:08 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 10:41:08 +0000 UTC,LastTransitionTime:2023-01-16 10:35:15 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.2,},NodeAddress{Type:ExternalIP,Address:35.237.110.203,},NodeAddress{Type:Hostname,Address:nodes-us-east1-b-wcrf,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:90256d4292845f855978b781ab31ded0,SystemUUID:90256d42-9284-5f85-5978-b781ab31ded0,BootID:b6764560-f26d-4d17-83ba-c17bdd70bced,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 16 10:41:35.852: INFO: 
Logging kubelet events for node nodes-us-east1-b-wcrf
Jan 16 10:41:35.923: INFO: 
Logging pods the kubelet thinks is on node nodes-us-east1-b-wcrf
Jan 16 10:41:35.984: INFO: calico-node-tvbl7 started at 2023-01-16 10:35:01 +0000 UTC (3+1 container statuses recorded)
Jan 16 10:41:35.984: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 10:41:35.984: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 10:41:35.984: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 10:41:35.984: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 10:41:35.984: INFO: netserver-3 started at 2023-01-16 10:40:55 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:35.984: INFO: 	Container webserver ready: true, restart count 0
Jan 16 10:41:35.984: INFO: test-ss-0 started at 2023-01-16 10:41:20 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:35.984: INFO: 	Container webserver ready: true, restart count 0
Jan 16 10:41:35.984: INFO: kube-proxy-nodes-us-east1-b-wcrf started at 2023-01-16 10:34:57 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:35.984: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 10:41:35.984: INFO: coredns-7bc44848df-rn2pc started at 2023-01-16 10:35:31 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:35.984: INFO: 	Container coredns ready: true, restart count 0
Jan 16 10:41:35.984: INFO: csi-gce-pd-node-v2gwp started at 2023-01-16 10:35:01 +0000 UTC (0+2 container statuses recorded)
Jan 16 10:41:35.984: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 10:41:35.984: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 10:41:35.984: INFO: execpodk7dvv started at 2023-01-16 10:41:18 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:35.984: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 16 10:41:35.984: INFO: test-container-pod started at 2023-01-16 10:41:19 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:35.984: INFO: 	Container webserver ready: true, restart count 0
Jan 16 10:41:35.984: INFO: netserver-3 started at 2023-01-16 10:41:18 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:35.984: INFO: 	Container webserver ready: false, restart count 0
Jan 16 10:41:35.984: INFO: externalsvc-8qf5c started at 2023-01-16 10:41:11 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:35.984: INFO: 	Container externalsvc ready: true, restart count 0
Jan 16 10:41:35.984: INFO: send-events-9ce98368-c896-44c7-9c20-75ce70f52739 started at 2023-01-16 10:41:14 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:35.984: INFO: 	Container p ready: true, restart count 0
Jan 16 10:41:38.249: INFO: 
Latency metrics for node nodes-us-east1-b-wcrf
�[1mSTEP:�[0m Collecting events from namespace "webhook-3105-markers". �[38;5;243m01/16/23 10:41:38.249�[0m
�[1mSTEP:�[0m Found 0 events. �[38;5;243m01/16/23 10:41:38.299�[0m
Jan 16 10:41:38.338: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Jan 16 10:41:38.338: INFO: 
Jan 16 10:41:38.387: INFO: 
Logging node info for node control-plane-us-east1-b-nc4v
Jan 16 10:41:38.422: INFO: Node Info: &Node{ObjectMeta:{control-plane-us-east1-b-nc4v    3e043433-4a0a-4797-aed2-d532c70362c4 5776 0 2023-01-16 10:33:51 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-standard-2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:control-plane-us-east1-b-nc4v kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node-role.kubernetes.io/node: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:e2-standard-2 topology.gke.io/zone:us-east1-b topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/control-plane-us-east1-b-nc4v"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.4/32 projectcalico.org/IPv4IPIPTunnelAddr:100.126.126.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-16 10:33:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-16 10:34:31 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:34:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {calico-node Update v1 2023-01-16 10:34:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-16 10:34:51 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:34:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:34:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-16 10:40:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/control-plane-us-east1-b-nc4v,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8332767232 0} {<nil>} 8137468Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8227909632 0} {<nil>} 8035068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:34:56 +0000 UTC,LastTransitionTime:2023-01-16 10:34:56 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 10:40:09 +0000 UTC,LastTransitionTime:2023-01-16 10:33:51 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 10:40:09 +0000 UTC,LastTransitionTime:2023-01-16 10:33:51 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 10:40:09 +0000 UTC,LastTransitionTime:2023-01-16 10:33:51 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 10:40:09 +0000 UTC,LastTransitionTime:2023-01-16 10:34:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.4,},NodeAddress{Type:ExternalIP,Address:35.243.145.107,},NodeAddress{Type:Hostname,Address:control-plane-us-east1-b-nc4v,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e5ac4d7bf983c1b4a0fb9c7211b86ad9,SystemUUID:e5ac4d7b-f983-c1b4-a0fb-9c7211b86ad9,BootID:66119c47-44e2-4c4c-ac93-902592bb3d86,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.0],SizeBytes:135162323,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.0],SizeBytes:124991801,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.0],SizeBytes:57657656,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43637878,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42802014,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:2b6acd7f677f76ffe12ecf3ea7df92eb9b1bdb07336d1ac2a54c7631fb753f7e docker.io/calico/kube-controllers:v3.24.5],SizeBytes:31137169,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2 registry.k8s.io/sig-storage/csi-provisioner:v2.1.0],SizeBytes:21205045,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:50c3cfd458fc8e0bf3c8c521eac39172009382fc66dc5044a330d137c6ed0b09 registry.k8s.io/sig-storage/csi-attacher:v3.1.0],SizeBytes:20103959,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a registry.k8s.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:9af9bf28430b00a0cedeb2ec29acadce45e6afcecd8bdf31c793c624cfa75fa7 registry.k8s.io/sig-storage/csi-snapshotter:v3.0.3],SizeBytes:19500777,},ContainerImage{Names:[docker.io/k8scloudprovidergcp/cloud-controller-manager@sha256:881fd1095937638040723973ade90e6700f1c831a78fb585a3227c4d021b0df9 docker.io/k8scloudprovidergcp/cloud-controller-manager:latest],SizeBytes:18702875,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4967322,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 16 10:41:38.422: INFO: 
Logging kubelet events for node control-plane-us-east1-b-nc4v
Jan 16 10:41:38.614: INFO: 
Logging pods the kubelet thinks is on node control-plane-us-east1-b-nc4v
Jan 16 10:41:38.670: INFO: kube-controller-manager-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:38.670: INFO: 	Container kube-controller-manager ready: true, restart count 2
Jan 16 10:41:38.670: INFO: kube-proxy-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:38.670: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 10:41:38.670: INFO: calico-node-5jgkc started at 2023-01-16 10:34:24 +0000 UTC (3+1 container statuses recorded)
Jan 16 10:41:38.670: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 10:41:38.670: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 10:41:38.670: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 10:41:38.670: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 10:41:38.670: INFO: cloud-controller-manager-b5qds started at 2023-01-16 10:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:38.670: INFO: 	Container cloud-controller-manager ready: true, restart count 0
Jan 16 10:41:38.670: INFO: calico-kube-controllers-55f488656-hcbkw started at 2023-01-16 10:34:50 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:38.670: INFO: 	Container calico-kube-controllers ready: true, restart count 0
Jan 16 10:41:38.670: INFO: dns-controller-6d5f4bf5d6-kqf4d started at 2023-01-16 10:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:38.670: INFO: 	Container dns-controller ready: true, restart count 0
Jan 16 10:41:38.670: INFO: csi-gce-pd-controller-78fc966fff-m86hh started at 2023-01-16 10:34:31 +0000 UTC (0+5 container statuses recorded)
Jan 16 10:41:38.670: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 16 10:41:38.670: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 16 10:41:38.670: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 16 10:41:38.670: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 16 10:41:38.670: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 10:41:38.670: INFO: kops-controller-smdjr started at 2023-01-16 10:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:38.670: INFO: 	Container kops-controller ready: true, restart count 0
Jan 16 10:41:38.670: INFO: kube-scheduler-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:38.670: INFO: 	Container kube-scheduler ready: true, restart count 0
Jan 16 10:41:38.670: INFO: etcd-manager-events-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:38.670: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 16 10:41:38.670: INFO: etcd-manager-main-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:38.670: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 16 10:41:38.670: INFO: kube-apiserver-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+2 container statuses recorded)
Jan 16 10:41:38.670: INFO: 	Container healthcheck ready: true, restart count 0
Jan 16 10:41:38.670: INFO: 	Container kube-apiserver ready: true, restart count 1
Jan 16 10:41:38.670: INFO: csi-gce-pd-node-kz9xf started at 2023-01-16 10:34:14 +0000 UTC (0+2 container statuses recorded)
Jan 16 10:41:38.670: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 10:41:38.670: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 10:41:39.048: INFO: 
Latency metrics for node control-plane-us-east1-b-nc4v
Jan 16 10:41:39.048: INFO: 
Logging node info for node nodes-us-east1-b-2xs4
Jan 16 10:41:39.092: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east1-b-2xs4    5523b1af-a125-4437-baf4-a87ff6e2a424 10202 0 2023-01-16 10:35:00 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east1-b-2xs4 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east1-b topology.hostpath.csi/node:nodes-us-east1-b-2xs4 topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-8487":"nodes-us-east1-b-2xs4","pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/nodes-us-east1-b-2xs4"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.6/32 projectcalico.org/IPv4IPIPTunnelAddr:100.123.6.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2023-01-16 10:35:00 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2023-01-16 10:35:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-16 10:35:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {calico-node Update v1 2023-01-16 10:35:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-16 10:41:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/nodes-us-east1-b-2xs4,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:35:32 +0000 UTC,LastTransitionTime:2023-01-16 10:35:32 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 10:41:27 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 10:41:27 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 10:41:27 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 10:41:27 +0000 UTC,LastTransitionTime:2023-01-16 10:35:20 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.6,},NodeAddress{Type:ExternalIP,Address:35.196.42.74,},NodeAddress{Type:Hostname,Address:nodes-us-east1-b-2xs4,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:39f2b9ba1d525f08f837cadb4248f14d,SystemUUID:39f2b9ba-1d52-5f08-f837-cadb4248f14d,BootID:7acec4fd-f02a-4704-a113-25a81be183ce,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 16 10:41:39.093: INFO: 
Logging kubelet events for node nodes-us-east1-b-2xs4
Jan 16 10:41:39.144: INFO: 
Logging pods the kubelet thinks is on node nodes-us-east1-b-2xs4
Jan 16 10:41:39.219: INFO: csi-hostpathplugin-0 started at 2023-01-16 10:41:14 +0000 UTC (0+7 container statuses recorded)
Jan 16 10:41:39.219: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 16 10:41:39.219: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 16 10:41:39.219: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 16 10:41:39.219: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 16 10:41:39.219: INFO: 	Container hostpath ready: true, restart count 0
Jan 16 10:41:39.219: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 16 10:41:39.219: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 16 10:41:39.219: INFO: dns-test-1c7b56de-ab39-4a1c-bceb-06613d2e4d23 started at 2023-01-16 10:39:58 +0000 UTC (0+3 container statuses recorded)
Jan 16 10:41:39.219: INFO: 	Container jessie-querier ready: true, restart count 0
Jan 16 10:41:39.219: INFO: 	Container querier ready: true, restart count 0
Jan 16 10:41:39.219: INFO: 	Container webserver ready: true, restart count 0
Jan 16 10:41:39.219: INFO: busybox-f889321e-4dfb-4854-9f38-20e0b9d793cb started at 2023-01-16 10:38:44 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:39.219: INFO: 	Container busybox ready: true, restart count 0
Jan 16 10:41:39.219: INFO: csi-mockplugin-0 started at 2023-01-16 10:41:20 +0000 UTC (0+3 container statuses recorded)
Jan 16 10:41:39.219: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 16 10:41:39.219: INFO: 	Container driver-registrar ready: true, restart count 0
Jan 16 10:41:39.219: INFO: 	Container mock ready: true, restart count 0
Jan 16 10:41:39.219: INFO: image-pull-test6c43cc73-392d-4649-b014-9a149ac59793 started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:39.219: INFO: concurrent-27897761-rmrj7 started at 2023-01-16 10:41:00 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:39.219: INFO: 	Container c ready: true, restart count 0
Jan 16 10:41:39.219: INFO: csi-mockplugin-attacher-0 started at 2023-01-16 10:41:20 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:39.219: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 16 10:41:39.219: INFO: dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf started at 2023-01-16 10:41:08 +0000 UTC (0+3 container statuses recorded)
Jan 16 10:41:39.219: INFO: 	Container jessie-querier ready: true, restart count 0
Jan 16 10:41:39.219: INFO: 	Container querier ready: true, restart count 0
Jan 16 10:41:39.219: INFO: 	Container webserver ready: true, restart count 0
Jan 16 10:41:39.219: INFO: externalsvc-w4hgw started at 2023-01-16 10:41:12 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:39.219: INFO: 	Container externalsvc ready: true, restart count 0
Jan 16 10:41:39.219: INFO: pvc-volume-tester-xp7g8 started at 2023-01-16 10:41:25 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:39.219: INFO: 	Container volume-tester ready: false, restart count 0
Jan 16 10:41:39.219: INFO: kube-proxy-nodes-us-east1-b-2xs4 started at 2023-01-16 10:34:50 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:39.219: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 10:41:39.219: INFO: csi-gce-pd-node-jc8jn started at 2023-01-16 10:35:10 +0000 UTC (0+2 container statuses recorded)
Jan 16 10:41:39.219: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 10:41:39.219: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 10:41:39.219: INFO: netserver-0 started at 2023-01-16 10:40:55 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:39.219: INFO: 	Container webserver ready: true, restart count 0
Jan 16 10:41:39.219: INFO: netserver-0 started at 2023-01-16 10:41:18 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:39.219: INFO: 	Container webserver ready: false, restart count 0
Jan 16 10:41:39.219: INFO: calico-node-qlnmx started at 2023-01-16 10:35:10 +0000 UTC (3+1 container statuses recorded)
Jan 16 10:41:39.219: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 10:41:39.219: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 10:41:39.219: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 10:41:39.219: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 10:41:39.219: INFO: bin-false19c31689-6d10-4392-b223-75fd280f1870 started at 2023-01-16 10:41:29 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:39.219: INFO: 	Container bin-false19c31689-6d10-4392-b223-75fd280f1870 ready: false, restart count 0
Jan 16 10:41:39.981: INFO: 
Latency metrics for node nodes-us-east1-b-2xs4
Jan 16 10:41:39.981: INFO: 
Logging node info for node nodes-us-east1-b-9h4h
Jan 16 10:41:40.022: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east1-b-9h4h    672ac3b7-ea1d-4e3e-bd88-42fa1b6384a8 9778 0 2023-01-16 10:34:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east1-b-9h4h kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east1-b topology.hostpath.csi/node:nodes-us-east1-b-9h4h topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/nodes-us-east1-b-9h4h"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.5/32 projectcalico.org/IPv4IPIPTunnelAddr:100.103.14.192 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-16 10:34:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:34:59 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-16 10:34:59 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:35:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {calico-node Update v1 2023-01-16 10:35:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-16 10:41:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/nodes-us-east1-b-9h4h,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:35:24 +0000 UTC,LastTransitionTime:2023-01-16 10:35:24 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 10:41:16 +0000 UTC,LastTransitionTime:2023-01-16 10:34:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 10:41:16 +0000 UTC,LastTransitionTime:2023-01-16 10:34:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 10:41:16 +0000 UTC,LastTransitionTime:2023-01-16 10:34:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 10:41:16 +0000 UTC,LastTransitionTime:2023-01-16 10:35:13 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.5,},NodeAddress{Type:ExternalIP,Address:35.196.180.243,},NodeAddress{Type:Hostname,Address:nodes-us-east1-b-9h4h,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:828dcdb67e74b8a327b01dc0797be5e1,SystemUUID:828dcdb6-7e74-b8a3-27b0-1dc0797be5e1,BootID:dd05deb0-ef00-47e1-83af-c902277fe4b7,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 16 10:41:40.022: INFO: 
Logging kubelet events for node nodes-us-east1-b-9h4h
Jan 16 10:41:40.069: INFO: 
Logging pods the kubelet thinks is on node nodes-us-east1-b-9h4h
Jan 16 10:41:40.119: INFO: hostexec-nodes-us-east1-b-9h4h-j2wcf started at 2023-01-16 10:41:16 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:40.119: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 16 10:41:40.119: INFO: deployment-shared-map-item-removal-74d7dd69db-492tx started at 2023-01-16 10:40:50 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:40.119: INFO: 	Container nginx ready: false, restart count 0
Jan 16 10:41:40.119: INFO: netserver-1 started at 2023-01-16 10:41:18 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:40.119: INFO: 	Container webserver ready: false, restart count 0
Jan 16 10:41:40.119: INFO: pod-ac24315e-10c9-4522-95e7-9fbaeb57edc2 started at 2023-01-16 10:41:21 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:40.119: INFO: 	Container write-pod ready: true, restart count 0
Jan 16 10:41:40.119: INFO: deployment-74d7dd69db-mslgt started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:40.119: INFO: pod-6d0950ee-1606-444f-b1aa-4ae12a6b7bf2 started at 2023-01-16 10:41:28 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:40.119: INFO: 	Container write-pod ready: false, restart count 0
Jan 16 10:41:40.119: INFO: csi-gce-pd-node-ncgj4 started at 2023-01-16 10:35:01 +0000 UTC (0+2 container statuses recorded)
Jan 16 10:41:40.119: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 10:41:40.119: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 10:41:40.119: INFO: calico-node-gmwsc started at 2023-01-16 10:35:01 +0000 UTC (3+1 container statuses recorded)
Jan 16 10:41:40.119: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 10:41:40.119: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 10:41:40.119: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 10:41:40.119: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 10:41:40.119: INFO: coredns-autoscaler-7cb5c5b969-mpv8x started at 2023-01-16 10:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:40.119: INFO: 	Container autoscaler ready: true, restart count 0
Jan 16 10:41:40.119: INFO: dns-test-92a596e0-af91-4e72-b7b2-e00f2807047a started at 2023-01-16 10:39:48 +0000 UTC (0+3 container statuses recorded)
Jan 16 10:41:40.119: INFO: 	Container jessie-querier ready: true, restart count 0
Jan 16 10:41:40.119: INFO: 	Container querier ready: true, restart count 0
Jan 16 10:41:40.119: INFO: 	Container webserver ready: true, restart count 0
Jan 16 10:41:40.119: INFO: coredns-7bc44848df-zs55k started at 2023-01-16 10:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:40.119: INFO: 	Container coredns ready: true, restart count 0
Jan 16 10:41:40.119: INFO: concurrent-27897760-wsl4w started at 2023-01-16 10:40:00 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:40.119: INFO: 	Container c ready: true, restart count 0
Jan 16 10:41:40.119: INFO: netserver-1 started at 2023-01-16 10:40:55 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:40.119: INFO: 	Container webserver ready: true, restart count 0
Jan 16 10:41:40.119: INFO: kube-proxy-nodes-us-east1-b-9h4h started at 2023-01-16 10:34:55 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:40.119: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 10:41:40.887: INFO: 
Latency metrics for node nodes-us-east1-b-9h4h
Jan 16 10:41:40.887: INFO: 
Logging node info for node nodes-us-east1-b-rn9p
Jan 16 10:41:40.922: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east1-b-rn9p    59f4f25d-24bf-4d96-a4bf-2cf266b5c083 10212 0 2023-01-16 10:34:59 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east1-b-rn9p kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east1-b topology.hostpath.csi/node:nodes-us-east1-b-rn9p topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/nodes-us-east1-b-rn9p"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.3/32 projectcalico.org/IPv4IPIPTunnelAddr:100.98.60.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-16 10:34:59 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:00 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-16 10:35:01 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {calico-node Update v1 2023-01-16 10:35:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-16 10:41:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/nodes-us-east1-b-rn9p,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:35:26 +0000 UTC,LastTransitionTime:2023-01-16 10:35:26 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 10:41:17 +0000 UTC,LastTransitionTime:2023-01-16 10:34:59 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 10:41:17 +0000 UTC,LastTransitionTime:2023-01-16 10:34:59 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 10:41:17 +0000 UTC,LastTransitionTime:2023-01-16 10:34:59 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 10:41:17 +0000 UTC,LastTransitionTime:2023-01-16 10:35:14 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.3,},NodeAddress{Type:ExternalIP,Address:34.75.49.181,},NodeAddress{Type:Hostname,Address:nodes-us-east1-b-rn9p,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:9f39c983773df4ca6a15315227d6fd51,SystemUUID:9f39c983-773d-f4ca-6a15-315227d6fd51,BootID:7e9ad329-1a6b-4405-ba71-ca92e45658b3,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 16 10:41:40.922: INFO: 
Logging kubelet events for node nodes-us-east1-b-rn9p
Jan 16 10:41:40.963: INFO: 
Logging pods the kubelet thinks is on node nodes-us-east1-b-rn9p
Jan 16 10:41:41.029: INFO: adopt-release-z6p4s started at 2023-01-16 10:41:26 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:41.029: INFO: 	Container c ready: false, restart count 0
Jan 16 10:41:41.029: INFO: pod-ephm-test-projected-vfq5 started at 2023-01-16 10:40:22 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:41.029: INFO: 	Container test-container-subpath-projected-vfq5 ready: false, restart count 0
Jan 16 10:41:41.029: INFO: hostexec-nodes-us-east1-b-rn9p-7trpn started at 2023-01-16 10:40:58 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:41.029: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 16 10:41:41.029: INFO: netserver-2 started at 2023-01-16 10:41:18 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:41.029: INFO: 	Container webserver ready: false, restart count 0
Jan 16 10:41:41.029: INFO: calico-node-ntgj5 started at 2023-01-16 10:35:03 +0000 UTC (3+1 container statuses recorded)
Jan 16 10:41:41.029: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 10:41:41.029: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 10:41:41.029: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 10:41:41.029: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 10:41:41.029: INFO: adopt-release-p5zpw started at 2023-01-16 10:41:26 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:41.029: INFO: 	Container c ready: false, restart count 0
Jan 16 10:41:41.029: INFO: csi-gce-pd-node-88f4v started at 2023-01-16 10:35:03 +0000 UTC (0+2 container statuses recorded)
Jan 16 10:41:41.029: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 10:41:41.029: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 10:41:41.029: INFO: csi-mockplugin-0 started at 2023-01-16 10:40:26 +0000 UTC (0+3 container statuses recorded)
Jan 16 10:41:41.029: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 16 10:41:41.029: INFO: 	Container driver-registrar ready: true, restart count 0
Jan 16 10:41:41.029: INFO: 	Container mock ready: true, restart count 0
Jan 16 10:41:41.029: INFO: pod-771b61fc-2988-47dc-a2a2-35b949003b63 started at 2023-01-16 10:41:30 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:41.029: INFO: 	Container write-pod ready: false, restart count 0
Jan 16 10:41:41.029: INFO: pod-977869b4-2dcd-4668-8670-788dc13de569 started at 2023-01-16 10:41:29 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:41.029: INFO: 	Container test-container ready: false, restart count 0
Jan 16 10:41:41.029: INFO: kube-proxy-nodes-us-east1-b-rn9p started at 2023-01-16 10:34:56 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:41.029: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 10:41:41.029: INFO: hostexec-nodes-us-east1-b-rn9p-v7j4j started at 2023-01-16 10:41:11 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:41.029: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 16 10:41:41.029: INFO: test-ss-1 started at 2023-01-16 10:41:31 +0000 UTC (0+2 container statuses recorded)
Jan 16 10:41:41.029: INFO: 	Container test-ss ready: false, restart count 0
Jan 16 10:41:41.029: INFO: 	Container webserver ready: false, restart count 0
Jan 16 10:41:41.029: INFO: image-pull-test70c4bafe-c453-45d5-b918-e03bafd1687e started at 2023-01-16 10:41:22 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:41.029: INFO: 	Container image-pull-test ready: false, restart count 0
Jan 16 10:41:41.029: INFO: deployment-74d7dd69db-hc264 started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:41.029: INFO: netserver-2 started at 2023-01-16 10:40:55 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:41.029: INFO: 	Container webserver ready: true, restart count 0
Jan 16 10:41:42.788: INFO: 
Latency metrics for node nodes-us-east1-b-rn9p
Jan 16 10:41:42.788: INFO: 
Logging node info for node nodes-us-east1-b-wcrf
Jan 16 10:41:42.824: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east1-b-wcrf    509e8852-b60d-4ccc-864a-4efd7f571608 8691 0 2023-01-16 10:35:00 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east1-b-wcrf kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east1-b topology.hostpath.csi/node:nodes-us-east1-b-wcrf topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/nodes-us-east1-b-wcrf"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.2/32 projectcalico.org/IPv4IPIPTunnelAddr:100.110.242.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-16 10:35:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:01 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-16 10:35:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {calico-node Update v1 2023-01-16 10:35:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-16 10:41:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/nodes-us-east1-b-wcrf,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:35:27 +0000 UTC,LastTransitionTime:2023-01-16 10:35:27 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 10:41:08 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 10:41:08 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 10:41:08 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 10:41:08 +0000 UTC,LastTransitionTime:2023-01-16 10:35:15 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.2,},NodeAddress{Type:ExternalIP,Address:35.237.110.203,},NodeAddress{Type:Hostname,Address:nodes-us-east1-b-wcrf,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:90256d4292845f855978b781ab31ded0,SystemUUID:90256d42-9284-5f85-5978-b781ab31ded0,BootID:b6764560-f26d-4d17-83ba-c17bdd70bced,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 16 10:41:42.824: INFO: 
Logging kubelet events for node nodes-us-east1-b-wcrf
Jan 16 10:41:42.921: INFO: 
Logging pods the kubelet thinks is on node nodes-us-east1-b-wcrf
Jan 16 10:41:42.972: INFO: externalsvc-8qf5c started at 2023-01-16 10:41:11 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:42.972: INFO: 	Container externalsvc ready: true, restart count 0
Jan 16 10:41:42.972: INFO: send-events-9ce98368-c896-44c7-9c20-75ce70f52739 started at 2023-01-16 10:41:14 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:42.972: INFO: 	Container p ready: true, restart count 0
Jan 16 10:41:42.972: INFO: deployment-74d7dd69db-4gjkl started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:42.972: INFO: deployment-74d7dd69db-p5rnj started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:42.972: INFO: calico-node-tvbl7 started at 2023-01-16 10:35:01 +0000 UTC (3+1 container statuses recorded)
Jan 16 10:41:42.972: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 10:41:42.972: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 10:41:42.972: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 10:41:42.972: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 10:41:42.972: INFO: netserver-3 started at 2023-01-16 10:40:55 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:42.972: INFO: 	Container webserver ready: true, restart count 0
Jan 16 10:41:42.972: INFO: test-ss-0 started at 2023-01-16 10:41:20 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:42.972: INFO: 	Container webserver ready: true, restart count 0
Jan 16 10:41:42.972: INFO: kube-proxy-nodes-us-east1-b-wcrf started at 2023-01-16 10:34:57 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:42.972: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 10:41:42.972: INFO: ss-0 started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:42.972: INFO: coredns-7bc44848df-rn2pc started at 2023-01-16 10:35:31 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:42.972: INFO: 	Container coredns ready: true, restart count 0
Jan 16 10:41:42.972: INFO: hostexec-nodes-us-east1-b-wcrf-cffcd started at <nil> (0+0 container statuses recorded)
Jan 16 10:41:42.972: INFO: csi-gce-pd-node-v2gwp started at 2023-01-16 10:35:01 +0000 UTC (0+2 container statuses recorded)
Jan 16 10:41:42.972: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 10:41:42.972: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 10:41:42.972: INFO: execpodk7dvv started at 2023-01-16 10:41:18 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:42.972: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 16 10:41:42.972: INFO: test-container-pod started at 2023-01-16 10:41:19 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:42.972: INFO: 	Container webserver ready: true, restart count 0
Jan 16 10:41:42.972: INFO: hostexec-nodes-us-east1-b-wcrf-qsr6z started at 2023-01-16 10:41:39 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:42.972: INFO: 	Container agnhost-container ready: false, restart count 0
Jan 16 10:41:42.972: INFO: netserver-3 started at 2023-01-16 10:41:18 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:41:42.972: INFO: 	Container webserver ready: true, restart count 0
Jan 16 10:41:44.447: INFO: 
Latency metrics for node nodes-us-east1-b-wcrf
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "webhook-3105" for this suite. �[38;5;243m01/16/23 10:41:44.447�[0m
�[1mSTEP:�[0m Destroying namespace "webhook-3105-markers" for this suite. �[38;5;243m01/16/23 10:41:44.49�[0m

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should unconditionally reject operations on fail closed webhook [Conformance] 1m7s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\sshould\sunconditionally\sreject\soperations\son\sfail\sclosed\swebhook\s\[Conformance\]$'

test/e2e/apimachinery/webhook.go:1257
k8s.io/kubernetes/test/e2e/apimachinery.registerFailClosedWebhook(0xc000bbeff0, {0xc00306c370, 0xc}, 0x0?, 0x0?)
	test/e2e/apimachinery/webhook.go:1257 +0x591
k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.7()
	test/e2e/apimachinery/webhook.go:240 +0x45
				[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/16/23 10:58:40.279�[0m
Jan 16 10:58:40.280: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename webhook �[38;5;243m01/16/23 10:58:40.28�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/16/23 10:58:40.424�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/16/23 10:58:40.512�[0m
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  test/e2e/framework/metrics/init/init.go:31
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  test/e2e/apimachinery/webhook.go:90
�[1mSTEP:�[0m Setting up server cert �[38;5;243m01/16/23 10:58:40.669�[0m
�[1mSTEP:�[0m Create role binding to let webhook read extension-apiserver-authentication �[38;5;243m01/16/23 10:58:41.586�[0m
�[1mSTEP:�[0m Deploying the webhook pod �[38;5;243m01/16/23 10:58:41.625�[0m
�[1mSTEP:�[0m Wait for the deployment to be ready �[38;5;243m01/16/23 10:58:41.706�[0m
Jan 16 10:58:41.820: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 16, 10, 58, 41, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 16, 10, 58, 41, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 16, 10, 58, 41, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 16, 10, 58, 41, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 16 10:58:43.858: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 16, 10, 58, 41, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 16, 10, 58, 41, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 16, 10, 58, 41, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 16, 10, 58, 41, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
�[1mSTEP:�[0m Deploying the webhook service �[38;5;243m01/16/23 10:58:45.856�[0m
�[1mSTEP:�[0m Verifying the service has paired with the endpoint �[38;5;243m01/16/23 10:58:45.905�[0m
Jan 16 10:58:46.905: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
[It] should unconditionally reject operations on fail closed webhook [Conformance]
  test/e2e/apimachinery/webhook.go:239
�[1mSTEP:�[0m Registering a webhook that server cannot talk to, with fail closed policy, via the AdmissionRegistration API �[38;5;243m01/16/23 10:58:46.955�[0m
Jan 16 10:58:57.069: INFO: Waiting for webhook configuration to be ready...
Jan 16 10:59:07.242: INFO: Waiting for webhook configuration to be ready...
Jan 16 10:59:17.348: INFO: Waiting for webhook configuration to be ready...
Jan 16 10:59:27.444: INFO: Waiting for webhook configuration to be ready...
Jan 16 10:59:37.519: INFO: Waiting for webhook configuration to be ready...
Jan 16 10:59:37.519: INFO: Unexpected error: waiting for webhook configuration to be ready: 
    <*errors.errorString | 0xc0001f1970>: {
        s: "timed out waiting for the condition",
    }
Jan 16 10:59:37.519: FAIL: waiting for webhook configuration to be ready: timed out waiting for the condition

Full Stack Trace
k8s.io/kubernetes/test/e2e/apimachinery.registerFailClosedWebhook(0xc000bbeff0, {0xc00306c370, 0xc}, 0x0?, 0x0?)
	test/e2e/apimachinery/webhook.go:1257 +0x591
k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.7()
	test/e2e/apimachinery/webhook.go:240 +0x45
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  test/e2e/framework/node/init/init.go:32
Jan 16 10:59:37.520: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  test/e2e/apimachinery/webhook.go:105
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/16/23 10:59:37.752�[0m
�[1mSTEP:�[0m Collecting events from namespace "webhook-8944". �[38;5;243m01/16/23 10:59:37.752�[0m
�[1mSTEP:�[0m Found 7 events. �[38;5;243m01/16/23 10:59:37.787�[0m
Jan 16 10:59:37.788: INFO: At 2023-01-16 10:58:41 +0000 UTC - event for sample-webhook-deployment: {deployment-controller } ScalingReplicaSet: Scaled up replica set sample-webhook-deployment-865554f4d9 to 1
Jan 16 10:59:37.788: INFO: At 2023-01-16 10:58:41 +0000 UTC - event for sample-webhook-deployment-865554f4d9: {replicaset-controller } SuccessfulCreate: Created pod: sample-webhook-deployment-865554f4d9-xwtcf
Jan 16 10:59:37.788: INFO: At 2023-01-16 10:58:41 +0000 UTC - event for sample-webhook-deployment-865554f4d9-xwtcf: {default-scheduler } Scheduled: Successfully assigned webhook-8944/sample-webhook-deployment-865554f4d9-xwtcf to nodes-us-east1-b-2xs4
Jan 16 10:59:37.788: INFO: At 2023-01-16 10:58:43 +0000 UTC - event for sample-webhook-deployment-865554f4d9-xwtcf: {kubelet nodes-us-east1-b-2xs4} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine
Jan 16 10:59:37.788: INFO: At 2023-01-16 10:58:43 +0000 UTC - event for sample-webhook-deployment-865554f4d9-xwtcf: {kubelet nodes-us-east1-b-2xs4} Created: Created container sample-webhook
Jan 16 10:59:37.788: INFO: At 2023-01-16 10:58:43 +0000 UTC - event for sample-webhook-deployment-865554f4d9-xwtcf: {kubelet nodes-us-east1-b-2xs4} Started: Started container sample-webhook
Jan 16 10:59:37.788: INFO: At 2023-01-16 10:59:37 +0000 UTC - event for sample-webhook-deployment-865554f4d9-xwtcf: {kubelet nodes-us-east1-b-2xs4} Killing: Stopping container sample-webhook
Jan 16 10:59:37.821: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Jan 16 10:59:37.821: INFO: 
Jan 16 10:59:37.862: INFO: 
Logging node info for node control-plane-us-east1-b-nc4v
Jan 16 10:59:37.899: INFO: Node Info: &Node{ObjectMeta:{control-plane-us-east1-b-nc4v    3e043433-4a0a-4797-aed2-d532c70362c4 44644 0 2023-01-16 10:33:51 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-standard-2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:control-plane-us-east1-b-nc4v kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node-role.kubernetes.io/node: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:e2-standard-2 topology.gke.io/zone:us-east1-b topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/control-plane-us-east1-b-nc4v"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.4/32 projectcalico.org/IPv4IPIPTunnelAddr:100.126.126.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-16 10:33:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-16 10:34:31 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:34:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {calico-node Update v1 2023-01-16 10:34:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-16 10:34:51 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:34:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:34:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-16 10:55:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/control-plane-us-east1-b-nc4v,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8332767232 0} {<nil>} 8137468Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8227909632 0} {<nil>} 8035068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:34:56 +0000 UTC,LastTransitionTime:2023-01-16 10:34:56 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 10:55:28 +0000 UTC,LastTransitionTime:2023-01-16 10:33:51 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 10:55:28 +0000 UTC,LastTransitionTime:2023-01-16 10:33:51 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 10:55:28 +0000 UTC,LastTransitionTime:2023-01-16 10:33:51 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 10:55:28 +0000 UTC,LastTransitionTime:2023-01-16 10:34:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.4,},NodeAddress{Type:ExternalIP,Address:35.243.145.107,},NodeAddress{Type:Hostname,Address:control-plane-us-east1-b-nc4v,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e5ac4d7bf983c1b4a0fb9c7211b86ad9,SystemUUID:e5ac4d7b-f983-c1b4-a0fb-9c7211b86ad9,BootID:66119c47-44e2-4c4c-ac93-902592bb3d86,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.0],SizeBytes:135162323,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.0],SizeBytes:124991801,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.0],SizeBytes:57657656,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43637878,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42802014,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:2b6acd7f677f76ffe12ecf3ea7df92eb9b1bdb07336d1ac2a54c7631fb753f7e docker.io/calico/kube-controllers:v3.24.5],SizeBytes:31137169,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2 registry.k8s.io/sig-storage/csi-provisioner:v2.1.0],SizeBytes:21205045,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:50c3cfd458fc8e0bf3c8c521eac39172009382fc66dc5044a330d137c6ed0b09 registry.k8s.io/sig-storage/csi-attacher:v3.1.0],SizeBytes:20103959,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a registry.k8s.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:9af9bf28430b00a0cedeb2ec29acadce45e6afcecd8bdf31c793c624cfa75fa7 registry.k8s.io/sig-storage/csi-snapshotter:v3.0.3],SizeBytes:19500777,},ContainerImage{Names:[docker.io/k8scloudprovidergcp/cloud-controller-manager@sha256:881fd1095937638040723973ade90e6700f1c831a78fb585a3227c4d021b0df9 docker.io/k8scloudprovidergcp/cloud-controller-manager:latest],SizeBytes:18702875,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4967322,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 16 10:59:37.899: INFO: 
Logging kubelet events for node control-plane-us-east1-b-nc4v
Jan 16 10:59:37.947: INFO: 
Logging pods the kubelet thinks is on node control-plane-us-east1-b-nc4v
Jan 16 10:59:37.995: INFO: csi-gce-pd-node-kz9xf started at 2023-01-16 10:34:14 +0000 UTC (0+2 container statuses recorded)
Jan 16 10:59:37.995: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 10:59:37.995: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 10:59:37.995: INFO: csi-gce-pd-controller-78fc966fff-m86hh started at 2023-01-16 10:34:31 +0000 UTC (0+5 container statuses recorded)
Jan 16 10:59:37.995: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 16 10:59:37.995: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 16 10:59:37.995: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 16 10:59:37.995: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 16 10:59:37.995: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 10:59:37.995: INFO: kops-controller-smdjr started at 2023-01-16 10:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:37.995: INFO: 	Container kops-controller ready: true, restart count 0
Jan 16 10:59:37.995: INFO: etcd-manager-events-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:37.995: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 16 10:59:37.995: INFO: etcd-manager-main-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:37.995: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 16 10:59:37.995: INFO: calico-node-5jgkc started at 2023-01-16 10:34:24 +0000 UTC (3+1 container statuses recorded)
Jan 16 10:59:37.995: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 10:59:37.995: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 10:59:37.995: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 10:59:37.995: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 10:59:37.995: INFO: cloud-controller-manager-b5qds started at 2023-01-16 10:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:37.995: INFO: 	Container cloud-controller-manager ready: true, restart count 0
Jan 16 10:59:37.995: INFO: kube-controller-manager-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:37.995: INFO: 	Container kube-controller-manager ready: true, restart count 2
Jan 16 10:59:37.995: INFO: kube-proxy-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:37.995: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 10:59:37.995: INFO: dns-controller-6d5f4bf5d6-kqf4d started at 2023-01-16 10:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:37.995: INFO: 	Container dns-controller ready: true, restart count 0
Jan 16 10:59:37.995: INFO: kube-scheduler-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:37.995: INFO: 	Container kube-scheduler ready: true, restart count 0
Jan 16 10:59:37.995: INFO: kube-apiserver-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+2 container statuses recorded)
Jan 16 10:59:37.995: INFO: 	Container healthcheck ready: true, restart count 0
Jan 16 10:59:37.995: INFO: 	Container kube-apiserver ready: true, restart count 1
Jan 16 10:59:37.995: INFO: calico-kube-controllers-55f488656-hcbkw started at 2023-01-16 10:34:50 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:37.995: INFO: 	Container calico-kube-controllers ready: true, restart count 0
Jan 16 10:59:38.269: INFO: 
Latency metrics for node control-plane-us-east1-b-nc4v
Jan 16 10:59:38.269: INFO: 
Logging node info for node nodes-us-east1-b-2xs4
Jan 16 10:59:38.303: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east1-b-2xs4    5523b1af-a125-4437-baf4-a87ff6e2a424 45893 0 2023-01-16 10:35:00 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east1-b-2xs4 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east1-b topology.hostpath.csi/node:nodes-us-east1-b-2xs4 topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/nodes-us-east1-b-2xs4"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.6/32 projectcalico.org/IPv4IPIPTunnelAddr:100.123.6.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2023-01-16 10:35:00 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2023-01-16 10:35:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-16 10:35:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {calico-node Update v1 2023-01-16 10:35:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-16 10:55:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/nodes-us-east1-b-2xs4,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:35:32 +0000 UTC,LastTransitionTime:2023-01-16 10:35:32 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 10:55:58 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 10:55:58 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 10:55:58 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 10:55:58 +0000 UTC,LastTransitionTime:2023-01-16 10:35:20 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.6,},NodeAddress{Type:ExternalIP,Address:35.196.42.74,},NodeAddress{Type:Hostname,Address:nodes-us-east1-b-2xs4,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:39f2b9ba1d525f08f837cadb4248f14d,SystemUUID:39f2b9ba-1d52-5f08-f837-cadb4248f14d,BootID:7acec4fd-f02a-4704-a113-25a81be183ce,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 16 10:59:38.303: INFO: 
Logging kubelet events for node nodes-us-east1-b-2xs4
Jan 16 10:59:38.345: INFO: 
Logging pods the kubelet thinks is on node nodes-us-east1-b-2xs4
Jan 16 10:59:38.395: INFO: dns-test-9ac02aeb-ccb8-4dbf-a031-3f8abf3c41bb started at 2023-01-16 10:56:17 +0000 UTC (0+3 container statuses recorded)
Jan 16 10:59:38.395: INFO: 	Container jessie-querier ready: true, restart count 0
Jan 16 10:59:38.395: INFO: 	Container querier ready: true, restart count 0
Jan 16 10:59:38.395: INFO: 	Container webserver ready: true, restart count 0
Jan 16 10:59:38.395: INFO: agnhost started at 2023-01-16 10:46:16 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:38.395: INFO: 	Container agnhost ready: true, restart count 0
Jan 16 10:59:38.395: INFO: deployment-shared-unset-7cf876c5d4-rrwf6 started at 2023-01-16 10:58:05 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:38.395: INFO: 	Container nginx ready: false, restart count 0
Jan 16 10:59:38.395: INFO: proxy-service-cgkvp-fj8m5 started at 2023-01-16 10:54:34 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:38.395: INFO: 	Container proxy-service-cgkvp ready: true, restart count 0
Jan 16 10:59:38.395: INFO: test-rolling-update-with-lb-7bc4f96468-mnmfn started at 2023-01-16 10:59:21 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:38.395: INFO: 	Container agnhost ready: true, restart count 0
Jan 16 10:59:38.395: INFO: kube-proxy-nodes-us-east1-b-2xs4 started at 2023-01-16 10:34:50 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:38.395: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 10:59:38.395: INFO: csi-gce-pd-node-jc8jn started at 2023-01-16 10:35:10 +0000 UTC (0+2 container statuses recorded)
Jan 16 10:59:38.395: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 10:59:38.395: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 10:59:38.395: INFO: test-pod started at 2023-01-16 10:58:02 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:38.395: INFO: 	Container test-container ready: false, restart count 0
Jan 16 10:59:38.395: INFO: calico-node-qlnmx started at 2023-01-16 10:35:10 +0000 UTC (3+1 container statuses recorded)
Jan 16 10:59:38.395: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 10:59:38.395: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 10:59:38.395: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 10:59:38.395: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 10:59:38.395: INFO: dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1 started at 2023-01-16 10:43:45 +0000 UTC (0+3 container statuses recorded)
Jan 16 10:59:38.395: INFO: 	Container jessie-querier ready: true, restart count 1
Jan 16 10:59:38.395: INFO: 	Container querier ready: true, restart count 1
Jan 16 10:59:38.395: INFO: 	Container webserver ready: true, restart count 0
Jan 16 10:59:38.631: INFO: 
Latency metrics for node nodes-us-east1-b-2xs4
Jan 16 10:59:38.631: INFO: 
Logging node info for node nodes-us-east1-b-9h4h
Jan 16 10:59:38.666: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east1-b-9h4h    672ac3b7-ea1d-4e3e-bd88-42fa1b6384a8 54576 0 2023-01-16 10:34:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east1-b-9h4h kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east1-b topology.hostpath.csi/node:nodes-us-east1-b-9h4h topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/nodes-us-east1-b-9h4h"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.5/32 projectcalico.org/IPv4IPIPTunnelAddr:100.103.14.192 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-16 10:34:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:34:59 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-16 10:34:59 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:35:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {calico-node Update v1 2023-01-16 10:35:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-16 10:59:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/nodes-us-east1-b-9h4h,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:35:24 +0000 UTC,LastTransitionTime:2023-01-16 10:35:24 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 10:59:30 +0000 UTC,LastTransitionTime:2023-01-16 10:34:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 10:59:30 +0000 UTC,LastTransitionTime:2023-01-16 10:34:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 10:59:30 +0000 UTC,LastTransitionTime:2023-01-16 10:34:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 10:59:30 +0000 UTC,LastTransitionTime:2023-01-16 10:35:13 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.5,},NodeAddress{Type:ExternalIP,Address:35.196.180.243,},NodeAddress{Type:Hostname,Address:nodes-us-east1-b-9h4h,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:828dcdb67e74b8a327b01dc0797be5e1,SystemUUID:828dcdb6-7e74-b8a3-27b0-1dc0797be5e1,BootID:dd05deb0-ef00-47e1-83af-c902277fe4b7,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 16 10:59:38.667: INFO: 
Logging kubelet events for node nodes-us-east1-b-9h4h
Jan 16 10:59:38.707: INFO: 
Logging pods the kubelet thinks is on node nodes-us-east1-b-9h4h
Jan 16 10:59:38.762: INFO: csi-gce-pd-node-ncgj4 started at 2023-01-16 10:35:01 +0000 UTC (0+2 container statuses recorded)
Jan 16 10:59:38.762: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 10:59:38.762: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 10:59:38.762: INFO: calico-node-gmwsc started at 2023-01-16 10:35:01 +0000 UTC (3+1 container statuses recorded)
Jan 16 10:59:38.762: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 10:59:38.762: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 10:59:38.762: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 10:59:38.762: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 10:59:38.762: INFO: coredns-autoscaler-7cb5c5b969-mpv8x started at 2023-01-16 10:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:38.762: INFO: 	Container autoscaler ready: true, restart count 0
Jan 16 10:59:38.762: INFO: coredns-7bc44848df-zs55k started at 2023-01-16 10:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:38.762: INFO: 	Container coredns ready: true, restart count 0
Jan 16 10:59:38.762: INFO: dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94 started at 2023-01-16 10:49:18 +0000 UTC (0+3 container statuses recorded)
Jan 16 10:59:38.762: INFO: 	Container jessie-querier ready: true, restart count 0
Jan 16 10:59:38.762: INFO: 	Container querier ready: true, restart count 0
Jan 16 10:59:38.762: INFO: 	Container webserver ready: true, restart count 0
Jan 16 10:59:38.762: INFO: rs-6gpcp started at 2023-01-16 10:58:42 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:38.762: INFO: 	Container donothing ready: false, restart count 0
Jan 16 10:59:38.762: INFO: kube-proxy-nodes-us-east1-b-9h4h started at 2023-01-16 10:34:55 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:38.762: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 10:59:38.762: INFO: dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74 started at 2023-01-16 10:49:57 +0000 UTC (0+3 container statuses recorded)
Jan 16 10:59:38.762: INFO: 	Container jessie-querier ready: false, restart count 6
Jan 16 10:59:38.762: INFO: 	Container querier ready: false, restart count 6
Jan 16 10:59:38.762: INFO: 	Container webserver ready: true, restart count 0
Jan 16 10:59:38.998: INFO: 
Latency metrics for node nodes-us-east1-b-9h4h
Jan 16 10:59:38.998: INFO: 
Logging node info for node nodes-us-east1-b-rn9p
Jan 16 10:59:39.033: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east1-b-rn9p    59f4f25d-24bf-4d96-a4bf-2cf266b5c083 54781 0 2023-01-16 10:34:59 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east1-b-rn9p kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east1-b topology.hostpath.csi/node:nodes-us-east1-b-rn9p topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-volumemode-2930":"nodes-us-east1-b-rn9p","csi-mock-csi-mock-volumes-2985":"nodes-us-east1-b-rn9p","csi-mock-csi-mock-volumes-4891":"nodes-us-east1-b-rn9p","csi-mock-csi-mock-volumes-5606":"nodes-us-east1-b-rn9p","pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/nodes-us-east1-b-rn9p"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.3/32 projectcalico.org/IPv4IPIPTunnelAddr:100.98.60.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-16 10:34:59 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:00 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-16 10:35:01 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {calico-node Update v1 2023-01-16 10:35:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:59:23 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-16 10:59:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/nodes-us-east1-b-rn9p,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:35:26 +0000 UTC,LastTransitionTime:2023-01-16 10:35:26 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 10:59:27 +0000 UTC,LastTransitionTime:2023-01-16 10:34:59 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 10:59:27 +0000 UTC,LastTransitionTime:2023-01-16 10:34:59 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 10:59:27 +0000 UTC,LastTransitionTime:2023-01-16 10:34:59 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 10:59:27 +0000 UTC,LastTransitionTime:2023-01-16 10:35:14 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.3,},NodeAddress{Type:ExternalIP,Address:34.75.49.181,},NodeAddress{Type:Hostname,Address:nodes-us-east1-b-rn9p,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:9f39c983773df4ca6a15315227d6fd51,SystemUUID:9f39c983-773d-f4ca-6a15-315227d6fd51,BootID:7e9ad329-1a6b-4405-ba71-ca92e45658b3,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:c0ddb4794bc8a3631e3373015f913c00b230ee54f87bde9ade195b3a3415c60f registry.k8s.io/build-image/distroless-iptables:v0.1.2],SizeBytes:7685585,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-2985^d1ab04ac-958c-11ed-8da4-0a67cce18e32],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-2985^d1ab04ac-958c-11ed-8da4-0a67cce18e32,DevicePath:,},},Config:nil,},}
Jan 16 10:59:39.034: INFO: 
Logging kubelet events for node nodes-us-east1-b-rn9p
Jan 16 10:59:39.073: INFO: 
Logging pods the kubelet thinks is on node nodes-us-east1-b-rn9p
Jan 16 10:59:39.160: INFO: pod-8168e957-d5d1-44a8-9fcc-6e1b4b1a85b6 started at 2023-01-16 10:59:10 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:39.160: INFO: 	Container write-pod ready: true, restart count 0
Jan 16 10:59:39.160: INFO: calico-node-ntgj5 started at 2023-01-16 10:35:03 +0000 UTC (3+1 container statuses recorded)
Jan 16 10:59:39.160: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 10:59:39.160: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 10:59:39.160: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 10:59:39.160: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 10:59:39.161: INFO: pod-9b3bfee8-e726-4c67-b789-067a1dd7be1b started at 2023-01-16 10:58:39 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:39.161: INFO: 	Container write-pod ready: true, restart count 0
Jan 16 10:59:39.161: INFO: csi-mockplugin-0 started at 2023-01-16 10:59:09 +0000 UTC (0+3 container statuses recorded)
Jan 16 10:59:39.161: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 16 10:59:39.161: INFO: 	Container driver-registrar ready: true, restart count 0
Jan 16 10:59:39.161: INFO: 	Container mock ready: true, restart count 0
Jan 16 10:59:39.161: INFO: pod-071e9a1a-22f7-4e1b-8395-28554f3a77b2 started at 2023-01-16 10:58:41 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:39.161: INFO: 	Container write-pod ready: true, restart count 0
Jan 16 10:59:39.161: INFO: csi-mockplugin-attacher-0 started at 2023-01-16 10:59:09 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:39.161: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 16 10:59:39.161: INFO: csi-gce-pd-node-88f4v started at 2023-01-16 10:35:03 +0000 UTC (0+2 container statuses recorded)
Jan 16 10:59:39.161: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 10:59:39.161: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 10:59:39.161: INFO: csi-mockplugin-0 started at 2023-01-16 10:56:24 +0000 UTC (0+3 container statuses recorded)
Jan 16 10:59:39.161: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 16 10:59:39.161: INFO: 	Container driver-registrar ready: true, restart count 0
Jan 16 10:59:39.161: INFO: 	Container mock ready: true, restart count 0
Jan 16 10:59:39.161: INFO: test-rolling-update-with-lb-7bc4f96468-d2q2p started at 2023-01-16 10:59:25 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:39.161: INFO: 	Container agnhost ready: false, restart count 0
Jan 16 10:59:39.161: INFO: csi-mockplugin-attacher-0 started at 2023-01-16 10:57:44 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:39.161: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 16 10:59:39.161: INFO: csi-mockplugin-attacher-0 started at 2023-01-16 10:56:24 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:39.161: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 16 10:59:39.161: INFO: hostexec-nodes-us-east1-b-rn9p-89lvp started at 2023-01-16 10:57:18 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:39.161: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 16 10:59:39.161: INFO: csi-mockplugin-0 started at 2023-01-16 10:58:49 +0000 UTC (0+3 container statuses recorded)
Jan 16 10:59:39.161: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 16 10:59:39.161: INFO: 	Container driver-registrar ready: true, restart count 0
Jan 16 10:59:39.161: INFO: 	Container mock ready: true, restart count 0
Jan 16 10:59:39.161: INFO: kube-proxy-nodes-us-east1-b-rn9p started at 2023-01-16 10:34:56 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:39.161: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 10:59:39.161: INFO: pvc-volume-tester-9g725 started at <nil> (0+0 container statuses recorded)
Jan 16 10:59:39.161: INFO: csi-mockplugin-0 started at 2023-01-16 10:58:16 +0000 UTC (0+3 container statuses recorded)
Jan 16 10:59:39.161: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 16 10:59:39.161: INFO: 	Container driver-registrar ready: true, restart count 0
Jan 16 10:59:39.161: INFO: 	Container mock ready: true, restart count 0
Jan 16 10:59:39.161: INFO: hostexec-nodes-us-east1-b-rn9p-5285c started at 2023-01-16 10:58:41 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:39.161: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 16 10:59:39.161: INFO: startup-331b250a-8083-4bb9-a9ac-125215967415 started at 2023-01-16 10:58:39 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:39.161: INFO: 	Container busybox ready: false, restart count 0
Jan 16 10:59:39.161: INFO: csi-mockplugin-attacher-0 started at 2023-01-16 10:58:49 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:39.161: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 16 10:59:39.161: INFO: test-rolling-update-with-lb-85b8b59c8c-r4w2q started at 2023-01-16 10:59:01 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:39.161: INFO: 	Container agnhost ready: true, restart count 0
Jan 16 10:59:39.161: INFO: hostexec-nodes-us-east1-b-rn9p-qzbv7 started at 2023-01-16 10:58:26 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:39.161: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 16 10:59:39.161: INFO: csi-mockplugin-0 started at 2023-01-16 10:57:44 +0000 UTC (0+3 container statuses recorded)
Jan 16 10:59:39.161: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 16 10:59:39.161: INFO: 	Container driver-registrar ready: true, restart count 0
Jan 16 10:59:39.161: INFO: 	Container mock ready: true, restart count 0
Jan 16 10:59:39.161: INFO: hostexec-nodes-us-east1-b-rn9p-ddmfz started at 2023-01-16 10:58:20 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:39.161: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 16 10:59:39.161: INFO: pvc-volume-tester-c8xrn started at 2023-01-16 10:59:18 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:39.161: INFO: 	Container volume-tester ready: false, restart count 0
Jan 16 10:59:39.161: INFO: hostexec-nodes-us-east1-b-rn9p-58vv9 started at 2023-01-16 10:58:50 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:39.161: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 16 10:59:39.161: INFO: pod-subpath-test-preprovisionedpv-h97n started at 2023-01-16 10:59:15 +0000 UTC (2+1 container statuses recorded)
Jan 16 10:59:39.161: INFO: 	Init container init-volume-preprovisionedpv-h97n ready: true, restart count 0
Jan 16 10:59:39.161: INFO: 	Init container test-init-volume-preprovisionedpv-h97n ready: false, restart count 0
Jan 16 10:59:39.161: INFO: 	Container test-container-subpath-preprovisionedpv-h97n ready: false, restart count 0
Jan 16 10:59:39.161: INFO: pod-9d6228eb-ad40-45f1-a37b-3a5328bdf040 started at 2023-01-16 10:59:24 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:39.161: INFO: 	Container write-pod ready: false, restart count 0
Jan 16 10:59:39.161: INFO: csi-hostpathplugin-0 started at 2023-01-16 10:57:44 +0000 UTC (0+7 container statuses recorded)
Jan 16 10:59:39.161: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 16 10:59:39.161: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 16 10:59:39.161: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 16 10:59:39.161: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 16 10:59:39.161: INFO: 	Container hostpath ready: true, restart count 0
Jan 16 10:59:39.161: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 16 10:59:39.161: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 16 10:59:39.161: INFO: webserver-pod started at 2023-01-16 10:55:08 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:39.161: INFO: 	Container agnhost ready: false, restart count 0
Jan 16 10:59:41.684: INFO: 
Latency metrics for node nodes-us-east1-b-rn9p
Jan 16 10:59:41.684: INFO: 
Logging node info for node nodes-us-east1-b-wcrf
Jan 16 10:59:41.720: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east1-b-wcrf    509e8852-b60d-4ccc-864a-4efd7f571608 54067 0 2023-01-16 10:35:00 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east1-b-wcrf kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east1-b topology.hostpath.csi/node:nodes-us-east1-b-wcrf topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-5412":"nodes-us-east1-b-wcrf","pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/nodes-us-east1-b-wcrf"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.2/32 projectcalico.org/IPv4IPIPTunnelAddr:100.110.242.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-16 10:35:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:01 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-16 10:35:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {calico-node Update v1 2023-01-16 10:35:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:59:00 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-16 10:59:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/nodes-us-east1-b-wcrf,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:35:27 +0000 UTC,LastTransitionTime:2023-01-16 10:35:27 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 10:59:03 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 10:59:03 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 10:59:03 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 10:59:03 +0000 UTC,LastTransitionTime:2023-01-16 10:35:15 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.2,},NodeAddress{Type:ExternalIP,Address:35.237.110.203,},NodeAddress{Type:Hostname,Address:nodes-us-east1-b-wcrf,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:90256d4292845f855978b781ab31ded0,SystemUUID:90256d42-9284-5f85-5978-b781ab31ded0,BootID:b6764560-f26d-4d17-83ba-c17bdd70bced,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-5412^bfa9e03e-958c-11ed-a5c7-ca0810b1c8a4 kubernetes.io/csi/csi-hostpath-ephemeral-5412^c6895f5e-958c-11ed-a5c7-ca0810b1c8a4],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-5412^bfa9e03e-958c-11ed-a5c7-ca0810b1c8a4,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-5412^c6895f5e-958c-11ed-a5c7-ca0810b1c8a4,DevicePath:,},},Config:nil,},}
Jan 16 10:59:41.720: INFO: 
Logging kubelet events for node nodes-us-east1-b-wcrf
Jan 16 10:59:41.758: INFO: 
Logging pods the kubelet thinks is on node nodes-us-east1-b-wcrf
Jan 16 10:59:41.800: INFO: csi-gce-pd-node-v2gwp started at 2023-01-16 10:35:01 +0000 UTC (0+2 container statuses recorded)
Jan 16 10:59:41.800: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 10:59:41.800: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 10:59:41.800: INFO: deployment-6c94ddcb9f-wbrch started at 2023-01-16 10:58:40 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:41.800: INFO: 	Container nginx ready: false, restart count 0
Jan 16 10:59:41.800: INFO: inline-volume-tester-8jtck started at 2023-01-16 10:58:47 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:41.800: INFO: 	Container csi-volume-tester ready: true, restart count 0
Jan 16 10:59:41.800: INFO: test-rolling-update-with-lb-7bc4f96468-fc4m8 started at 2023-01-16 10:59:23 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:41.800: INFO: 	Container agnhost ready: true, restart count 0
Jan 16 10:59:41.800: INFO: calico-node-tvbl7 started at 2023-01-16 10:35:01 +0000 UTC (3+1 container statuses recorded)
Jan 16 10:59:41.800: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 10:59:41.800: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 10:59:41.800: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 10:59:41.800: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 10:59:41.800: INFO: csi-hostpathplugin-0 started at 2023-01-16 10:58:39 +0000 UTC (0+7 container statuses recorded)
Jan 16 10:59:41.800: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 16 10:59:41.800: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 16 10:59:41.800: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 16 10:59:41.800: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 16 10:59:41.800: INFO: 	Container hostpath ready: true, restart count 0
Jan 16 10:59:41.800: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 16 10:59:41.800: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 16 10:59:41.800: INFO: kube-proxy-nodes-us-east1-b-wcrf started at 2023-01-16 10:34:57 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:41.800: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 10:59:41.800: INFO: coredns-7bc44848df-rn2pc started at 2023-01-16 10:35:31 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:41.800: INFO: 	Container coredns ready: true, restart count 0
Jan 16 10:59:41.800: INFO: deployment-shared-unset-7cf876c5d4-g79dm started at 2023-01-16 10:58:05 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:41.800: INFO: 	Container nginx ready: false, restart count 0
Jan 16 10:59:42.056: INFO: 
Latency metrics for node nodes-us-east1-b-wcrf
�[1mSTEP:�[0m Collecting events from namespace "webhook-8944-markers". �[38;5;243m01/16/23 10:59:42.056�[0m
�[1mSTEP:�[0m Found 0 events. �[38;5;243m01/16/23 10:59:42.09�[0m
Jan 16 10:59:42.124: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Jan 16 10:59:42.124: INFO: 
Jan 16 10:59:42.161: INFO: 
Logging node info for node control-plane-us-east1-b-nc4v
Jan 16 10:59:42.198: INFO: Node Info: &Node{ObjectMeta:{control-plane-us-east1-b-nc4v    3e043433-4a0a-4797-aed2-d532c70362c4 44644 0 2023-01-16 10:33:51 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-standard-2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:control-plane-us-east1-b-nc4v kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node-role.kubernetes.io/node: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:e2-standard-2 topology.gke.io/zone:us-east1-b topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/control-plane-us-east1-b-nc4v"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.4/32 projectcalico.org/IPv4IPIPTunnelAddr:100.126.126.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-16 10:33:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-16 10:34:31 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:34:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {calico-node Update v1 2023-01-16 10:34:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-16 10:34:51 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:34:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:34:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-16 10:55:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/control-plane-us-east1-b-nc4v,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8332767232 0} {<nil>} 8137468Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8227909632 0} {<nil>} 8035068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:34:56 +0000 UTC,LastTransitionTime:2023-01-16 10:34:56 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 10:55:28 +0000 UTC,LastTransitionTime:2023-01-16 10:33:51 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 10:55:28 +0000 UTC,LastTransitionTime:2023-01-16 10:33:51 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 10:55:28 +0000 UTC,LastTransitionTime:2023-01-16 10:33:51 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 10:55:28 +0000 UTC,LastTransitionTime:2023-01-16 10:34:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.4,},NodeAddress{Type:ExternalIP,Address:35.243.145.107,},NodeAddress{Type:Hostname,Address:control-plane-us-east1-b-nc4v,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e5ac4d7bf983c1b4a0fb9c7211b86ad9,SystemUUID:e5ac4d7b-f983-c1b4-a0fb-9c7211b86ad9,BootID:66119c47-44e2-4c4c-ac93-902592bb3d86,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.0],SizeBytes:135162323,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.0],SizeBytes:124991801,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.0],SizeBytes:57657656,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43637878,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42802014,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:2b6acd7f677f76ffe12ecf3ea7df92eb9b1bdb07336d1ac2a54c7631fb753f7e docker.io/calico/kube-controllers:v3.24.5],SizeBytes:31137169,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2 registry.k8s.io/sig-storage/csi-provisioner:v2.1.0],SizeBytes:21205045,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:50c3cfd458fc8e0bf3c8c521eac39172009382fc66dc5044a330d137c6ed0b09 registry.k8s.io/sig-storage/csi-attacher:v3.1.0],SizeBytes:20103959,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a registry.k8s.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:9af9bf28430b00a0cedeb2ec29acadce45e6afcecd8bdf31c793c624cfa75fa7 registry.k8s.io/sig-storage/csi-snapshotter:v3.0.3],SizeBytes:19500777,},ContainerImage{Names:[docker.io/k8scloudprovidergcp/cloud-controller-manager@sha256:881fd1095937638040723973ade90e6700f1c831a78fb585a3227c4d021b0df9 docker.io/k8scloudprovidergcp/cloud-controller-manager:latest],SizeBytes:18702875,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4967322,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 16 10:59:42.198: INFO: 
Logging kubelet events for node control-plane-us-east1-b-nc4v
Jan 16 10:59:42.239: INFO: 
Logging pods the kubelet thinks is on node control-plane-us-east1-b-nc4v
Jan 16 10:59:42.282: INFO: calico-kube-controllers-55f488656-hcbkw started at 2023-01-16 10:34:50 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:42.282: INFO: 	Container calico-kube-controllers ready: true, restart count 0
Jan 16 10:59:42.282: INFO: csi-gce-pd-node-kz9xf started at 2023-01-16 10:34:14 +0000 UTC (0+2 container statuses recorded)
Jan 16 10:59:42.282: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 10:59:42.282: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 10:59:42.282: INFO: csi-gce-pd-controller-78fc966fff-m86hh started at 2023-01-16 10:34:31 +0000 UTC (0+5 container statuses recorded)
Jan 16 10:59:42.282: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 16 10:59:42.282: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 16 10:59:42.282: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 16 10:59:42.282: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 16 10:59:42.282: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 10:59:42.282: INFO: kops-controller-smdjr started at 2023-01-16 10:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:42.282: INFO: 	Container kops-controller ready: true, restart count 0
Jan 16 10:59:42.282: INFO: etcd-manager-events-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:42.282: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 16 10:59:42.282: INFO: etcd-manager-main-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:42.282: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 16 10:59:42.282: INFO: calico-node-5jgkc started at 2023-01-16 10:34:24 +0000 UTC (3+1 container statuses recorded)
Jan 16 10:59:42.282: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 10:59:42.282: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 10:59:42.282: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 10:59:42.282: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 10:59:42.282: INFO: cloud-controller-manager-b5qds started at 2023-01-16 10:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:42.282: INFO: 	Container cloud-controller-manager ready: true, restart count 0
Jan 16 10:59:42.282: INFO: kube-controller-manager-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:42.282: INFO: 	Container kube-controller-manager ready: true, restart count 2
Jan 16 10:59:42.282: INFO: kube-proxy-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:42.282: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 10:59:42.282: INFO: dns-controller-6d5f4bf5d6-kqf4d started at 2023-01-16 10:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:42.282: INFO: 	Container dns-controller ready: true, restart count 0
Jan 16 10:59:42.282: INFO: kube-scheduler-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:42.282: INFO: 	Container kube-scheduler ready: true, restart count 0
Jan 16 10:59:42.282: INFO: kube-apiserver-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+2 container statuses recorded)
Jan 16 10:59:42.282: INFO: 	Container healthcheck ready: true, restart count 0
Jan 16 10:59:42.282: INFO: 	Container kube-apiserver ready: true, restart count 1
Jan 16 10:59:42.544: INFO: 
Latency metrics for node control-plane-us-east1-b-nc4v
Jan 16 10:59:42.544: INFO: 
Logging node info for node nodes-us-east1-b-2xs4
Jan 16 10:59:42.580: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east1-b-2xs4    5523b1af-a125-4437-baf4-a87ff6e2a424 45893 0 2023-01-16 10:35:00 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east1-b-2xs4 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east1-b topology.hostpath.csi/node:nodes-us-east1-b-2xs4 topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/nodes-us-east1-b-2xs4"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.6/32 projectcalico.org/IPv4IPIPTunnelAddr:100.123.6.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2023-01-16 10:35:00 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2023-01-16 10:35:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-16 10:35:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {calico-node Update v1 2023-01-16 10:35:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-16 10:55:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/nodes-us-east1-b-2xs4,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:35:32 +0000 UTC,LastTransitionTime:2023-01-16 10:35:32 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 10:55:58 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 10:55:58 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 10:55:58 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 10:55:58 +0000 UTC,LastTransitionTime:2023-01-16 10:35:20 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.6,},NodeAddress{Type:ExternalIP,Address:35.196.42.74,},NodeAddress{Type:Hostname,Address:nodes-us-east1-b-2xs4,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:39f2b9ba1d525f08f837cadb4248f14d,SystemUUID:39f2b9ba-1d52-5f08-f837-cadb4248f14d,BootID:7acec4fd-f02a-4704-a113-25a81be183ce,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 16 10:59:42.580: INFO: 
Logging kubelet events for node nodes-us-east1-b-2xs4
Jan 16 10:59:42.619: INFO: 
Logging pods the kubelet thinks is on node nodes-us-east1-b-2xs4
Jan 16 10:59:42.660: INFO: csi-gce-pd-node-jc8jn started at 2023-01-16 10:35:10 +0000 UTC (0+2 container statuses recorded)
Jan 16 10:59:42.660: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 10:59:42.660: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 10:59:42.660: INFO: test-pod started at 2023-01-16 10:58:02 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:42.660: INFO: 	Container test-container ready: false, restart count 0
Jan 16 10:59:42.660: INFO: kube-proxy-nodes-us-east1-b-2xs4 started at 2023-01-16 10:34:50 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:42.660: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 10:59:42.660: INFO: dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1 started at 2023-01-16 10:43:45 +0000 UTC (0+3 container statuses recorded)
Jan 16 10:59:42.660: INFO: 	Container jessie-querier ready: true, restart count 1
Jan 16 10:59:42.660: INFO: 	Container querier ready: true, restart count 1
Jan 16 10:59:42.660: INFO: 	Container webserver ready: true, restart count 0
Jan 16 10:59:42.660: INFO: calico-node-qlnmx started at 2023-01-16 10:35:10 +0000 UTC (3+1 container statuses recorded)
Jan 16 10:59:42.660: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 10:59:42.660: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 10:59:42.660: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 10:59:42.660: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 10:59:42.660: INFO: dns-test-9ac02aeb-ccb8-4dbf-a031-3f8abf3c41bb started at 2023-01-16 10:56:17 +0000 UTC (0+3 container statuses recorded)
Jan 16 10:59:42.660: INFO: 	Container jessie-querier ready: true, restart count 0
Jan 16 10:59:42.660: INFO: 	Container querier ready: true, restart count 0
Jan 16 10:59:42.660: INFO: 	Container webserver ready: true, restart count 0
Jan 16 10:59:42.660: INFO: deployment-shared-unset-7cf876c5d4-rrwf6 started at 2023-01-16 10:58:05 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:42.660: INFO: 	Container nginx ready: false, restart count 0
Jan 16 10:59:42.660: INFO: proxy-service-cgkvp-fj8m5 started at 2023-01-16 10:54:34 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:42.660: INFO: 	Container proxy-service-cgkvp ready: true, restart count 0
Jan 16 10:59:42.660: INFO: agnhost started at 2023-01-16 10:46:16 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:42.660: INFO: 	Container agnhost ready: true, restart count 0
Jan 16 10:59:42.660: INFO: test-rolling-update-with-lb-7bc4f96468-mnmfn started at 2023-01-16 10:59:21 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:42.660: INFO: 	Container agnhost ready: true, restart count 0
Jan 16 10:59:42.910: INFO: 
Latency metrics for node nodes-us-east1-b-2xs4
Jan 16 10:59:42.910: INFO: 
Logging node info for node nodes-us-east1-b-9h4h
Jan 16 10:59:42.950: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east1-b-9h4h    672ac3b7-ea1d-4e3e-bd88-42fa1b6384a8 54576 0 2023-01-16 10:34:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east1-b-9h4h kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east1-b topology.hostpath.csi/node:nodes-us-east1-b-9h4h topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/nodes-us-east1-b-9h4h"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.5/32 projectcalico.org/IPv4IPIPTunnelAddr:100.103.14.192 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-16 10:34:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:34:59 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-16 10:34:59 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:35:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {calico-node Update v1 2023-01-16 10:35:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-16 10:59:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/nodes-us-east1-b-9h4h,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:35:24 +0000 UTC,LastTransitionTime:2023-01-16 10:35:24 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 10:59:30 +0000 UTC,LastTransitionTime:2023-01-16 10:34:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 10:59:30 +0000 UTC,LastTransitionTime:2023-01-16 10:34:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 10:59:30 +0000 UTC,LastTransitionTime:2023-01-16 10:34:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 10:59:30 +0000 UTC,LastTransitionTime:2023-01-16 10:35:13 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.5,},NodeAddress{Type:ExternalIP,Address:35.196.180.243,},NodeAddress{Type:Hostname,Address:nodes-us-east1-b-9h4h,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:828dcdb67e74b8a327b01dc0797be5e1,SystemUUID:828dcdb6-7e74-b8a3-27b0-1dc0797be5e1,BootID:dd05deb0-ef00-47e1-83af-c902277fe4b7,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 16 10:59:42.951: INFO: 
Logging kubelet events for node nodes-us-east1-b-9h4h
Jan 16 10:59:43.013: INFO: 
Logging pods the kubelet thinks is on node nodes-us-east1-b-9h4h
Jan 16 10:59:43.056: INFO: dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94 started at 2023-01-16 10:49:18 +0000 UTC (0+3 container statuses recorded)
Jan 16 10:59:43.056: INFO: 	Container jessie-querier ready: true, restart count 0
Jan 16 10:59:43.056: INFO: 	Container querier ready: true, restart count 0
Jan 16 10:59:43.056: INFO: 	Container webserver ready: true, restart count 0
Jan 16 10:59:43.056: INFO: rs-6gpcp started at 2023-01-16 10:58:42 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:43.056: INFO: 	Container donothing ready: false, restart count 0
Jan 16 10:59:43.056: INFO: kube-proxy-nodes-us-east1-b-9h4h started at 2023-01-16 10:34:55 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:43.056: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 10:59:43.056: INFO: dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74 started at 2023-01-16 10:49:57 +0000 UTC (0+3 container statuses recorded)
Jan 16 10:59:43.056: INFO: 	Container jessie-querier ready: false, restart count 6
Jan 16 10:59:43.056: INFO: 	Container querier ready: false, restart count 6
Jan 16 10:59:43.056: INFO: 	Container webserver ready: true, restart count 0
Jan 16 10:59:43.056: INFO: csi-gce-pd-node-ncgj4 started at 2023-01-16 10:35:01 +0000 UTC (0+2 container statuses recorded)
Jan 16 10:59:43.056: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 10:59:43.056: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 10:59:43.056: INFO: calico-node-gmwsc started at 2023-01-16 10:35:01 +0000 UTC (3+1 container statuses recorded)
Jan 16 10:59:43.056: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 10:59:43.056: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 10:59:43.056: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 10:59:43.056: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 10:59:43.056: INFO: coredns-autoscaler-7cb5c5b969-mpv8x started at 2023-01-16 10:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:43.056: INFO: 	Container autoscaler ready: true, restart count 0
Jan 16 10:59:43.056: INFO: coredns-7bc44848df-zs55k started at 2023-01-16 10:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:43.056: INFO: 	Container coredns ready: true, restart count 0
Jan 16 10:59:43.262: INFO: 
Latency metrics for node nodes-us-east1-b-9h4h
Jan 16 10:59:43.262: INFO: 
Logging node info for node nodes-us-east1-b-rn9p
Jan 16 10:59:43.298: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east1-b-rn9p    59f4f25d-24bf-4d96-a4bf-2cf266b5c083 54839 0 2023-01-16 10:34:59 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east1-b-rn9p kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east1-b topology.hostpath.csi/node:nodes-us-east1-b-rn9p topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-2985":"nodes-us-east1-b-rn9p","csi-mock-csi-mock-volumes-4891":"nodes-us-east1-b-rn9p","csi-mock-csi-mock-volumes-5606":"nodes-us-east1-b-rn9p","pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/nodes-us-east1-b-rn9p"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.3/32 projectcalico.org/IPv4IPIPTunnelAddr:100.98.60.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-16 10:34:59 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:00 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-16 10:35:01 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {calico-node Update v1 2023-01-16 10:35:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:59:39 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-16 10:59:40 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/nodes-us-east1-b-rn9p,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:35:26 +0000 UTC,LastTransitionTime:2023-01-16 10:35:26 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 10:59:27 +0000 UTC,LastTransitionTime:2023-01-16 10:34:59 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 10:59:27 +0000 UTC,LastTransitionTime:2023-01-16 10:34:59 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 10:59:27 +0000 UTC,LastTransitionTime:2023-01-16 10:34:59 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 10:59:27 +0000 UTC,LastTransitionTime:2023-01-16 10:35:14 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.3,},NodeAddress{Type:ExternalIP,Address:34.75.49.181,},NodeAddress{Type:Hostname,Address:nodes-us-east1-b-rn9p,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:9f39c983773df4ca6a15315227d6fd51,SystemUUID:9f39c983-773d-f4ca-6a15-315227d6fd51,BootID:7e9ad329-1a6b-4405-ba71-ca92e45658b3,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:c0ddb4794bc8a3631e3373015f913c00b230ee54f87bde9ade195b3a3415c60f registry.k8s.io/build-image/distroless-iptables:v0.1.2],SizeBytes:7685585,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-2985^d1ab04ac-958c-11ed-8da4-0a67cce18e32],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-4891^ddb99650-958c-11ed-8a08-5af639de4d2e,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-2985^d1ab04ac-958c-11ed-8da4-0a67cce18e32,DevicePath:,},},Config:nil,},}
Jan 16 10:59:43.299: INFO: 
Logging kubelet events for node nodes-us-east1-b-rn9p
Jan 16 10:59:43.342: INFO: 
Logging pods the kubelet thinks is on node nodes-us-east1-b-rn9p
Jan 16 10:59:43.465: INFO: csi-mockplugin-0 started at 2023-01-16 10:58:49 +0000 UTC (0+3 container statuses recorded)
Jan 16 10:59:43.465: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 16 10:59:43.465: INFO: 	Container driver-registrar ready: true, restart count 0
Jan 16 10:59:43.465: INFO: 	Container mock ready: true, restart count 0
Jan 16 10:59:43.465: INFO: kube-proxy-nodes-us-east1-b-rn9p started at 2023-01-16 10:34:56 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:43.465: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 10:59:43.465: INFO: pvc-volume-tester-9g725 started at <nil> (0+0 container statuses recorded)
Jan 16 10:59:43.465: INFO: csi-mockplugin-0 started at 2023-01-16 10:58:16 +0000 UTC (0+3 container statuses recorded)
Jan 16 10:59:43.465: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 16 10:59:43.465: INFO: 	Container driver-registrar ready: true, restart count 0
Jan 16 10:59:43.465: INFO: 	Container mock ready: true, restart count 0
Jan 16 10:59:43.465: INFO: hostexec-nodes-us-east1-b-rn9p-5285c started at 2023-01-16 10:58:41 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:43.465: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 16 10:59:43.465: INFO: startup-331b250a-8083-4bb9-a9ac-125215967415 started at 2023-01-16 10:58:39 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:43.465: INFO: 	Container busybox ready: false, restart count 0
Jan 16 10:59:43.465: INFO: csi-mockplugin-attacher-0 started at 2023-01-16 10:58:49 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:43.465: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 16 10:59:43.465: INFO: hostexec-nodes-us-east1-b-rn9p-qzbv7 started at 2023-01-16 10:58:26 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:43.465: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 16 10:59:43.465: INFO: csi-mockplugin-0 started at 2023-01-16 10:57:44 +0000 UTC (0+3 container statuses recorded)
Jan 16 10:59:43.465: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 16 10:59:43.465: INFO: 	Container driver-registrar ready: true, restart count 0
Jan 16 10:59:43.465: INFO: 	Container mock ready: true, restart count 0
Jan 16 10:59:43.465: INFO: hostexec-nodes-us-east1-b-rn9p-ddmfz started at 2023-01-16 10:58:20 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:43.465: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 16 10:59:43.465: INFO: pvc-volume-tester-c8xrn started at 2023-01-16 10:59:18 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:43.465: INFO: 	Container volume-tester ready: false, restart count 0
Jan 16 10:59:43.465: INFO: pod-subpath-test-preprovisionedpv-h97n started at 2023-01-16 10:59:15 +0000 UTC (2+1 container statuses recorded)
Jan 16 10:59:43.465: INFO: 	Init container init-volume-preprovisionedpv-h97n ready: true, restart count 0
Jan 16 10:59:43.465: INFO: 	Init container test-init-volume-preprovisionedpv-h97n ready: false, restart count 0
Jan 16 10:59:43.465: INFO: 	Container test-container-subpath-preprovisionedpv-h97n ready: false, restart count 0
Jan 16 10:59:43.465: INFO: pod-9d6228eb-ad40-45f1-a37b-3a5328bdf040 started at 2023-01-16 10:59:24 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:43.465: INFO: 	Container write-pod ready: false, restart count 0
Jan 16 10:59:43.465: INFO: csi-hostpathplugin-0 started at 2023-01-16 10:57:44 +0000 UTC (0+7 container statuses recorded)
Jan 16 10:59:43.465: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 16 10:59:43.465: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 16 10:59:43.465: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 16 10:59:43.465: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 16 10:59:43.465: INFO: 	Container hostpath ready: true, restart count 0
Jan 16 10:59:43.465: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 16 10:59:43.465: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 16 10:59:43.465: INFO: webserver-pod started at 2023-01-16 10:55:08 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:43.465: INFO: 	Container agnhost ready: false, restart count 0
Jan 16 10:59:43.465: INFO: csi-mockplugin-attacher-0 started at 2023-01-16 10:59:09 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:43.465: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 16 10:59:43.465: INFO: pod-8168e957-d5d1-44a8-9fcc-6e1b4b1a85b6 started at 2023-01-16 10:59:10 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:43.465: INFO: 	Container write-pod ready: true, restart count 0
Jan 16 10:59:43.465: INFO: calico-node-ntgj5 started at 2023-01-16 10:35:03 +0000 UTC (3+1 container statuses recorded)
Jan 16 10:59:43.465: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 10:59:43.465: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 10:59:43.465: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 10:59:43.465: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 10:59:43.465: INFO: csi-mockplugin-0 started at 2023-01-16 10:59:09 +0000 UTC (0+3 container statuses recorded)
Jan 16 10:59:43.465: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 16 10:59:43.465: INFO: 	Container driver-registrar ready: true, restart count 0
Jan 16 10:59:43.465: INFO: 	Container mock ready: true, restart count 0
Jan 16 10:59:43.465: INFO: pod-071e9a1a-22f7-4e1b-8395-28554f3a77b2 started at 2023-01-16 10:58:41 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:43.465: INFO: 	Container write-pod ready: true, restart count 0
Jan 16 10:59:43.465: INFO: csi-mockplugin-attacher-0 started at 2023-01-16 10:57:44 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:43.465: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 16 10:59:43.465: INFO: csi-gce-pd-node-88f4v started at 2023-01-16 10:35:03 +0000 UTC (0+2 container statuses recorded)
Jan 16 10:59:43.465: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 10:59:43.465: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 10:59:43.465: INFO: csi-mockplugin-0 started at 2023-01-16 10:56:24 +0000 UTC (0+3 container statuses recorded)
Jan 16 10:59:43.465: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 16 10:59:43.465: INFO: 	Container driver-registrar ready: true, restart count 0
Jan 16 10:59:43.465: INFO: 	Container mock ready: true, restart count 0
Jan 16 10:59:43.465: INFO: test-rolling-update-with-lb-7bc4f96468-d2q2p started at 2023-01-16 10:59:25 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:43.465: INFO: 	Container agnhost ready: true, restart count 0
Jan 16 10:59:43.465: INFO: csi-mockplugin-attacher-0 started at 2023-01-16 10:56:24 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:43.465: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 16 10:59:47.787: INFO: 
Latency metrics for node nodes-us-east1-b-rn9p
Jan 16 10:59:47.787: INFO: 
Logging node info for node nodes-us-east1-b-wcrf
Jan 16 10:59:47.822: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east1-b-wcrf    509e8852-b60d-4ccc-864a-4efd7f571608 54945 0 2023-01-16 10:35:00 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east1-b-wcrf kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east1-b topology.hostpath.csi/node:nodes-us-east1-b-wcrf topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-5412":"nodes-us-east1-b-wcrf","pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/nodes-us-east1-b-wcrf"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.2/32 projectcalico.org/IPv4IPIPTunnelAddr:100.110.242.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-16 10:35:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:01 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-16 10:35:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {calico-node Update v1 2023-01-16 10:35:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:59:44 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-16 10:59:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/nodes-us-east1-b-wcrf,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:35:27 +0000 UTC,LastTransitionTime:2023-01-16 10:35:27 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 10:59:44 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 10:59:44 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 10:59:44 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 10:59:44 +0000 UTC,LastTransitionTime:2023-01-16 10:35:15 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.2,},NodeAddress{Type:ExternalIP,Address:35.237.110.203,},NodeAddress{Type:Hostname,Address:nodes-us-east1-b-wcrf,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:90256d4292845f855978b781ab31ded0,SystemUUID:90256d42-9284-5f85-5978-b781ab31ded0,BootID:b6764560-f26d-4d17-83ba-c17bdd70bced,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-5412^bfa9e03e-958c-11ed-a5c7-ca0810b1c8a4],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-5412^bfa9e03e-958c-11ed-a5c7-ca0810b1c8a4,DevicePath:,},},Config:nil,},}
Jan 16 10:59:47.823: INFO: 
Logging kubelet events for node nodes-us-east1-b-wcrf
Jan 16 10:59:47.861: INFO: 
Logging pods the kubelet thinks is on node nodes-us-east1-b-wcrf
Jan 16 10:59:47.904: INFO: csi-gce-pd-node-v2gwp started at 2023-01-16 10:35:01 +0000 UTC (0+2 container statuses recorded)
Jan 16 10:59:47.904: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 10:59:47.904: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 10:59:47.904: INFO: deployment-6c94ddcb9f-wbrch started at 2023-01-16 10:58:40 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:47.904: INFO: 	Container nginx ready: false, restart count 0
Jan 16 10:59:47.904: INFO: inline-volume-tester-8jtck started at 2023-01-16 10:58:47 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:47.904: INFO: 	Container csi-volume-tester ready: true, restart count 0
Jan 16 10:59:47.904: INFO: calico-node-tvbl7 started at 2023-01-16 10:35:01 +0000 UTC (3+1 container statuses recorded)
Jan 16 10:59:47.904: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 10:59:47.904: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 10:59:47.904: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 10:59:47.904: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 10:59:47.904: INFO: test-rolling-update-with-lb-5f94bf68d9-r2kx4 started at 2023-01-16 10:59:45 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:47.904: INFO: 	Container agnhost ready: true, restart count 0
Jan 16 10:59:47.904: INFO: csi-hostpathplugin-0 started at 2023-01-16 10:58:39 +0000 UTC (0+7 container statuses recorded)
Jan 16 10:59:47.904: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 16 10:59:47.904: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 16 10:59:47.904: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 16 10:59:47.904: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 16 10:59:47.904: INFO: 	Container hostpath ready: true, restart count 0
Jan 16 10:59:47.904: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 16 10:59:47.904: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 16 10:59:47.904: INFO: kube-proxy-nodes-us-east1-b-wcrf started at 2023-01-16 10:34:57 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:47.904: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 10:59:47.904: INFO: coredns-7bc44848df-rn2pc started at 2023-01-16 10:35:31 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:47.904: INFO: 	Container coredns ready: true, restart count 0
Jan 16 10:59:47.904: INFO: deployment-shared-unset-7cf876c5d4-g79dm started at 2023-01-16 10:58:05 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:59:47.904: INFO: 	Container nginx ready: false, restart count 0
Jan 16 10:59:48.164: INFO: 
Latency metrics for node nodes-us-east1-b-wcrf
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "webhook-8944" for this suite. �[38;5;243m01/16/23 10:59:48.164�[0m
�[1mSTEP:�[0m Destroying namespace "webhook-8944-markers" for this suite. �[38;5;243m01/16/23 10:59:48.202�[0m

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin] should be able to convert from CR v1 to CR v2 [Conformance] 1m46s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sCustomResourceConversionWebhook\s\[Privileged\:ClusterAdmin\]\sshould\sbe\sable\sto\sconvert\sfrom\sCR\sv1\sto\sCR\sv2\s\[Conformance\]$'

test/e2e/apimachinery/crd_conversion_webhook.go:478
k8s.io/kubernetes/test/e2e/apimachinery.waitWebhookConversionReady(0xc0002bdc20?, 0xc000c58c80?, 0xc003690630?, {0x75b565e?, 0x2?})
	test/e2e/apimachinery/crd_conversion_webhook.go:478 +0xf3
k8s.io/kubernetes/test/e2e/apimachinery.glob..func5.3()
	test/e2e/apimachinery/crd_conversion_webhook.go:173 +0x113
				[BeforeEach] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin]
  set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/16/23 10:49:43.521�[0m
Jan 16 10:49:43.521: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename crd-webhook �[38;5;243m01/16/23 10:49:43.522�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/16/23 10:49:43.635�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/16/23 10:49:43.701�[0m
[BeforeEach] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin]
  test/e2e/framework/metrics/init/init.go:31
[BeforeEach] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin]
  test/e2e/apimachinery/crd_conversion_webhook.go:128
�[1mSTEP:�[0m Setting up server cert �[38;5;243m01/16/23 10:49:43.767�[0m
�[1mSTEP:�[0m Create role binding to let cr conversion webhook read extension-apiserver-authentication �[38;5;243m01/16/23 10:49:44.162�[0m
�[1mSTEP:�[0m Deploying the custom resource conversion webhook pod �[38;5;243m01/16/23 10:49:44.198�[0m
�[1mSTEP:�[0m Wait for the deployment to be ready �[38;5;243m01/16/23 10:49:44.284�[0m
Jan 16 10:49:44.413: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 16, 10, 49, 44, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 16, 10, 49, 44, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 16, 10, 49, 44, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 16, 10, 49, 44, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 16 10:49:46.449: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 16, 10, 49, 44, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 16, 10, 49, 44, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 16, 10, 49, 44, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 16, 10, 49, 44, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 16 10:49:48.451: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 16, 10, 49, 44, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 16, 10, 49, 44, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 16, 10, 49, 44, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 16, 10, 49, 44, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
�[1mSTEP:�[0m Deploying the webhook service �[38;5;243m01/16/23 10:49:50.455�[0m
�[1mSTEP:�[0m Verifying the service has paired with the endpoint �[38;5;243m01/16/23 10:49:50.511�[0m
Jan 16 10:49:51.512: INFO: Waiting for amount of service:e2e-test-crd-conversion-webhook endpoints to be 1
[It] should be able to convert from CR v1 to CR v2 [Conformance]
  test/e2e/apimachinery/crd_conversion_webhook.go:149
Jan 16 10:49:51.551: INFO: >>> kubeConfig: /root/.kube/config
Jan 16 10:50:23.803: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-6151-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-2054.svc:9443/crdconvert?timeout=30s": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
Jan 16 10:50:54.072: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-6151-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-2054.svc:9443/crdconvert?timeout=30s": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
Jan 16 10:51:24.463: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-6151-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-2054.svc:9443/crdconvert?timeout=30s": dial tcp 100.69.215.14:9443: i/o timeout
Jan 16 10:51:24.463: INFO: Unexpected error: 
    <*errors.errorString | 0xc0001c39f0>: {
        s: "timed out waiting for the condition",
    }
Jan 16 10:51:24.463: FAIL: timed out waiting for the condition

Full Stack Trace
k8s.io/kubernetes/test/e2e/apimachinery.waitWebhookConversionReady(0xc0002bdc20?, 0xc000c58c80?, 0xc003690630?, {0x75b565e?, 0x2?})
	test/e2e/apimachinery/crd_conversion_webhook.go:478 +0xf3
k8s.io/kubernetes/test/e2e/apimachinery.glob..func5.3()
	test/e2e/apimachinery/crd_conversion_webhook.go:173 +0x113
[AfterEach] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin]
  test/e2e/framework/node/init/init.go:32
Jan 16 10:51:25.129: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[AfterEach] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin]
  test/e2e/apimachinery/crd_conversion_webhook.go:139
[DeferCleanup (Each)] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin]
  test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin]
  dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/16/23 10:51:25.564�[0m
�[1mSTEP:�[0m Collecting events from namespace "crd-webhook-2054". �[38;5;243m01/16/23 10:51:25.565�[0m
�[1mSTEP:�[0m Found 7 events. �[38;5;243m01/16/23 10:51:25.605�[0m
Jan 16 10:51:25.606: INFO: At 2023-01-16 10:49:44 +0000 UTC - event for sample-crd-conversion-webhook-deployment: {deployment-controller } ScalingReplicaSet: Scaled up replica set sample-crd-conversion-webhook-deployment-74ff66dd47 to 1
Jan 16 10:51:25.606: INFO: At 2023-01-16 10:49:44 +0000 UTC - event for sample-crd-conversion-webhook-deployment-74ff66dd47: {replicaset-controller } SuccessfulCreate: Created pod: sample-crd-conversion-webhook-deployment-74ff66dd47-rn7tn
Jan 16 10:51:25.606: INFO: At 2023-01-16 10:49:44 +0000 UTC - event for sample-crd-conversion-webhook-deployment-74ff66dd47-rn7tn: {default-scheduler } Scheduled: Successfully assigned crd-webhook-2054/sample-crd-conversion-webhook-deployment-74ff66dd47-rn7tn to nodes-us-east1-b-2xs4
Jan 16 10:51:25.606: INFO: At 2023-01-16 10:49:47 +0000 UTC - event for sample-crd-conversion-webhook-deployment-74ff66dd47-rn7tn: {kubelet nodes-us-east1-b-2xs4} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine
Jan 16 10:51:25.606: INFO: At 2023-01-16 10:49:47 +0000 UTC - event for sample-crd-conversion-webhook-deployment-74ff66dd47-rn7tn: {kubelet nodes-us-east1-b-2xs4} Created: Created container sample-crd-conversion-webhook
Jan 16 10:51:25.606: INFO: At 2023-01-16 10:49:47 +0000 UTC - event for sample-crd-conversion-webhook-deployment-74ff66dd47-rn7tn: {kubelet nodes-us-east1-b-2xs4} Started: Started container sample-crd-conversion-webhook
Jan 16 10:51:25.606: INFO: At 2023-01-16 10:51:25 +0000 UTC - event for sample-crd-conversion-webhook-deployment-74ff66dd47-rn7tn: {kubelet nodes-us-east1-b-2xs4} Killing: Stopping container sample-crd-conversion-webhook
Jan 16 10:51:25.643: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Jan 16 10:51:25.643: INFO: 
Jan 16 10:51:25.686: INFO: 
Logging node info for node control-plane-us-east1-b-nc4v
Jan 16 10:51:25.723: INFO: Node Info: &Node{ObjectMeta:{control-plane-us-east1-b-nc4v    3e043433-4a0a-4797-aed2-d532c70362c4 31161 0 2023-01-16 10:33:51 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-standard-2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:control-plane-us-east1-b-nc4v kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node-role.kubernetes.io/node: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:e2-standard-2 topology.gke.io/zone:us-east1-b topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/control-plane-us-east1-b-nc4v"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.4/32 projectcalico.org/IPv4IPIPTunnelAddr:100.126.126.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-16 10:33:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-16 10:34:31 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:34:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {calico-node Update v1 2023-01-16 10:34:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-16 10:34:51 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:34:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:34:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-16 10:50:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/control-plane-us-east1-b-nc4v,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8332767232 0} {<nil>} 8137468Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8227909632 0} {<nil>} 8035068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:34:56 +0000 UTC,LastTransitionTime:2023-01-16 10:34:56 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 10:50:22 +0000 UTC,LastTransitionTime:2023-01-16 10:33:51 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 10:50:22 +0000 UTC,LastTransitionTime:2023-01-16 10:33:51 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 10:50:22 +0000 UTC,LastTransitionTime:2023-01-16 10:33:51 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 10:50:22 +0000 UTC,LastTransitionTime:2023-01-16 10:34:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.4,},NodeAddress{Type:ExternalIP,Address:35.243.145.107,},NodeAddress{Type:Hostname,Address:control-plane-us-east1-b-nc4v,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e5ac4d7bf983c1b4a0fb9c7211b86ad9,SystemUUID:e5ac4d7b-f983-c1b4-a0fb-9c7211b86ad9,BootID:66119c47-44e2-4c4c-ac93-902592bb3d86,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.0],SizeBytes:135162323,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.0],SizeBytes:124991801,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.0],SizeBytes:57657656,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43637878,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42802014,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:2b6acd7f677f76ffe12ecf3ea7df92eb9b1bdb07336d1ac2a54c7631fb753f7e docker.io/calico/kube-controllers:v3.24.5],SizeBytes:31137169,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2 registry.k8s.io/sig-storage/csi-provisioner:v2.1.0],SizeBytes:21205045,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:50c3cfd458fc8e0bf3c8c521eac39172009382fc66dc5044a330d137c6ed0b09 registry.k8s.io/sig-storage/csi-attacher:v3.1.0],SizeBytes:20103959,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a registry.k8s.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:9af9bf28430b00a0cedeb2ec29acadce45e6afcecd8bdf31c793c624cfa75fa7 registry.k8s.io/sig-storage/csi-snapshotter:v3.0.3],SizeBytes:19500777,},ContainerImage{Names:[docker.io/k8scloudprovidergcp/cloud-controller-manager@sha256:881fd1095937638040723973ade90e6700f1c831a78fb585a3227c4d021b0df9 docker.io/k8scloudprovidergcp/cloud-controller-manager:latest],SizeBytes:18702875,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4967322,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 16 10:51:25.723: INFO: 
Logging kubelet events for node control-plane-us-east1-b-nc4v
Jan 16 10:51:25.770: INFO: 
Logging pods the kubelet thinks is on node control-plane-us-east1-b-nc4v
Jan 16 10:51:25.818: INFO: cloud-controller-manager-b5qds started at 2023-01-16 10:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:25.818: INFO: 	Container cloud-controller-manager ready: true, restart count 0
Jan 16 10:51:25.818: INFO: calico-kube-controllers-55f488656-hcbkw started at 2023-01-16 10:34:50 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:25.818: INFO: 	Container calico-kube-controllers ready: true, restart count 0
Jan 16 10:51:25.818: INFO: kube-controller-manager-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:25.818: INFO: 	Container kube-controller-manager ready: true, restart count 2
Jan 16 10:51:25.818: INFO: kube-proxy-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:25.818: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 10:51:25.818: INFO: calico-node-5jgkc started at 2023-01-16 10:34:24 +0000 UTC (3+1 container statuses recorded)
Jan 16 10:51:25.818: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 10:51:25.818: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 10:51:25.818: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 10:51:25.818: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 10:51:25.818: INFO: kube-apiserver-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+2 container statuses recorded)
Jan 16 10:51:25.818: INFO: 	Container healthcheck ready: true, restart count 0
Jan 16 10:51:25.818: INFO: 	Container kube-apiserver ready: true, restart count 1
Jan 16 10:51:25.818: INFO: csi-gce-pd-node-kz9xf started at 2023-01-16 10:34:14 +0000 UTC (0+2 container statuses recorded)
Jan 16 10:51:25.818: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 10:51:25.818: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 10:51:25.818: INFO: dns-controller-6d5f4bf5d6-kqf4d started at 2023-01-16 10:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:25.818: INFO: 	Container dns-controller ready: true, restart count 0
Jan 16 10:51:25.818: INFO: csi-gce-pd-controller-78fc966fff-m86hh started at 2023-01-16 10:34:31 +0000 UTC (0+5 container statuses recorded)
Jan 16 10:51:25.818: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 16 10:51:25.818: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 16 10:51:25.818: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 16 10:51:25.818: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 16 10:51:25.818: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 10:51:25.818: INFO: kops-controller-smdjr started at 2023-01-16 10:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:25.818: INFO: 	Container kops-controller ready: true, restart count 0
Jan 16 10:51:25.818: INFO: kube-scheduler-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:25.818: INFO: 	Container kube-scheduler ready: true, restart count 0
Jan 16 10:51:25.818: INFO: etcd-manager-events-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:25.818: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 16 10:51:25.818: INFO: etcd-manager-main-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:25.818: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 16 10:51:26.137: INFO: 
Latency metrics for node control-plane-us-east1-b-nc4v
Jan 16 10:51:26.137: INFO: 
Logging node info for node nodes-us-east1-b-2xs4
Jan 16 10:51:26.173: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east1-b-2xs4    5523b1af-a125-4437-baf4-a87ff6e2a424 25128 0 2023-01-16 10:35:00 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east1-b-2xs4 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east1-b topology.hostpath.csi/node:nodes-us-east1-b-2xs4 topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/nodes-us-east1-b-2xs4"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.6/32 projectcalico.org/IPv4IPIPTunnelAddr:100.123.6.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2023-01-16 10:35:00 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2023-01-16 10:35:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-16 10:35:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {calico-node Update v1 2023-01-16 10:35:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-16 10:47:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/nodes-us-east1-b-2xs4,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:35:32 +0000 UTC,LastTransitionTime:2023-01-16 10:35:32 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 10:47:26 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 10:47:26 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 10:47:26 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 10:47:26 +0000 UTC,LastTransitionTime:2023-01-16 10:35:20 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.6,},NodeAddress{Type:ExternalIP,Address:35.196.42.74,},NodeAddress{Type:Hostname,Address:nodes-us-east1-b-2xs4,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:39f2b9ba1d525f08f837cadb4248f14d,SystemUUID:39f2b9ba-1d52-5f08-f837-cadb4248f14d,BootID:7acec4fd-f02a-4704-a113-25a81be183ce,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 16 10:51:26.174: INFO: 
Logging kubelet events for node nodes-us-east1-b-2xs4
Jan 16 10:51:26.213: INFO: 
Logging pods the kubelet thinks is on node nodes-us-east1-b-2xs4
Jan 16 10:51:26.262: INFO: calico-node-qlnmx started at 2023-01-16 10:35:10 +0000 UTC (3+1 container statuses recorded)
Jan 16 10:51:26.262: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 10:51:26.262: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 10:51:26.262: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 10:51:26.262: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 10:51:26.262: INFO: dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1 started at 2023-01-16 10:43:45 +0000 UTC (0+3 container statuses recorded)
Jan 16 10:51:26.262: INFO: 	Container jessie-querier ready: true, restart count 0
Jan 16 10:51:26.262: INFO: 	Container querier ready: true, restart count 0
Jan 16 10:51:26.262: INFO: 	Container webserver ready: true, restart count 0
Jan 16 10:51:26.262: INFO: webserver-7f5969cbc7-zlnz9 started at 2023-01-16 10:50:30 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:26.262: INFO: 	Container httpd ready: true, restart count 0
Jan 16 10:51:26.262: INFO: update-demo-nautilus-br277 started at 2023-01-16 10:51:10 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:26.262: INFO: 	Container update-demo ready: true, restart count 0
Jan 16 10:51:26.262: INFO: indexed-job-0-xpr2c started at 2023-01-16 10:51:19 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:26.262: INFO: 	Container c ready: false, restart count 0
Jan 16 10:51:26.262: INFO: webserver-7f5969cbc7-2tpt4 started at 2023-01-16 10:51:22 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:26.262: INFO: 	Container httpd ready: true, restart count 0
Jan 16 10:51:26.262: INFO: agnhost started at 2023-01-16 10:46:16 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:26.262: INFO: 	Container agnhost ready: true, restart count 0
Jan 16 10:51:26.262: INFO: liveness-29020903-3c58-4a32-91fa-c5fe091750aa started at 2023-01-16 10:50:10 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:26.262: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 16 10:51:26.262: INFO: pod-eaa16e67-b99e-4234-8bca-285894fa2178 started at 2023-01-16 10:51:16 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:26.262: INFO: 	Container write-pod ready: true, restart count 0
Jan 16 10:51:26.262: INFO: ss2-1 started at 2023-01-16 10:50:57 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:26.262: INFO: 	Container webserver ready: true, restart count 0
Jan 16 10:51:26.262: INFO: indexed-job-1-mnsdq started at 2023-01-16 10:51:19 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:26.262: INFO: 	Container c ready: false, restart count 0
Jan 16 10:51:26.262: INFO: hostexec-nodes-us-east1-b-2xs4-dqcxn started at 2023-01-16 10:51:20 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:26.262: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 16 10:51:26.262: INFO: dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf started at 2023-01-16 10:41:08 +0000 UTC (0+3 container statuses recorded)
Jan 16 10:51:26.262: INFO: 	Container jessie-querier ready: true, restart count 0
Jan 16 10:51:26.262: INFO: 	Container querier ready: true, restart count 0
Jan 16 10:51:26.262: INFO: 	Container webserver ready: true, restart count 0
Jan 16 10:51:26.262: INFO: kube-proxy-nodes-us-east1-b-2xs4 started at 2023-01-16 10:34:50 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:26.262: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 10:51:26.262: INFO: csi-gce-pd-node-jc8jn started at 2023-01-16 10:35:10 +0000 UTC (0+2 container statuses recorded)
Jan 16 10:51:26.262: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 10:51:26.262: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 10:51:26.262: INFO: hostexec-nodes-us-east1-b-2xs4-7dgtr started at 2023-01-16 10:51:01 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:26.262: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 16 10:51:26.262: INFO: pod-server-1 started at 2023-01-16 10:51:14 +0000 UTC (1+1 container statuses recorded)
Jan 16 10:51:26.262: INFO: 	Init container init ready: false, restart count 0
Jan 16 10:51:26.262: INFO: 	Container agnhost-container ready: false, restart count 0
Jan 16 10:51:26.613: INFO: 
Latency metrics for node nodes-us-east1-b-2xs4
Jan 16 10:51:26.614: INFO: 
Logging node info for node nodes-us-east1-b-9h4h
Jan 16 10:51:26.650: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east1-b-9h4h    672ac3b7-ea1d-4e3e-bd88-42fa1b6384a8 32249 0 2023-01-16 10:34:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east1-b-9h4h kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east1-b topology.hostpath.csi/node:nodes-us-east1-b-9h4h topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-6300":"nodes-us-east1-b-9h4h","pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/nodes-us-east1-b-9h4h"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.5/32 projectcalico.org/IPv4IPIPTunnelAddr:100.103.14.192 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-16 10:34:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:34:59 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-16 10:34:59 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:35:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {calico-node Update v1 2023-01-16 10:35:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-16 10:50:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/nodes-us-east1-b-9h4h,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:35:24 +0000 UTC,LastTransitionTime:2023-01-16 10:35:24 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 10:48:04 +0000 UTC,LastTransitionTime:2023-01-16 10:34:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 10:48:04 +0000 UTC,LastTransitionTime:2023-01-16 10:34:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 10:48:04 +0000 UTC,LastTransitionTime:2023-01-16 10:34:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 10:48:04 +0000 UTC,LastTransitionTime:2023-01-16 10:35:13 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.5,},NodeAddress{Type:ExternalIP,Address:35.196.180.243,},NodeAddress{Type:Hostname,Address:nodes-us-east1-b-9h4h,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:828dcdb67e74b8a327b01dc0797be5e1,SystemUUID:828dcdb6-7e74-b8a3-27b0-1dc0797be5e1,BootID:dd05deb0-ef00-47e1-83af-c902277fe4b7,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 16 10:51:26.650: INFO: 
Logging kubelet events for node nodes-us-east1-b-9h4h
Jan 16 10:51:26.690: INFO: 
Logging pods the kubelet thinks is on node nodes-us-east1-b-9h4h
Jan 16 10:51:26.737: INFO: csi-gce-pd-node-ncgj4 started at 2023-01-16 10:35:01 +0000 UTC (0+2 container statuses recorded)
Jan 16 10:51:26.737: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 10:51:26.737: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 10:51:26.737: INFO: calico-node-gmwsc started at 2023-01-16 10:35:01 +0000 UTC (3+1 container statuses recorded)
Jan 16 10:51:26.737: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 10:51:26.737: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 10:51:26.737: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 10:51:26.737: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 10:51:26.737: INFO: coredns-autoscaler-7cb5c5b969-mpv8x started at 2023-01-16 10:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:26.737: INFO: 	Container autoscaler ready: true, restart count 0
Jan 16 10:51:26.737: INFO: csi-hostpathplugin-0 started at 2023-01-16 10:50:40 +0000 UTC (0+7 container statuses recorded)
Jan 16 10:51:26.737: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 16 10:51:26.737: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 16 10:51:26.737: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 16 10:51:26.737: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 16 10:51:26.737: INFO: 	Container hostpath ready: true, restart count 0
Jan 16 10:51:26.737: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 16 10:51:26.737: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 16 10:51:26.737: INFO: coredns-7bc44848df-zs55k started at 2023-01-16 10:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:26.737: INFO: 	Container coredns ready: true, restart count 0
Jan 16 10:51:26.737: INFO: dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94 started at 2023-01-16 10:49:18 +0000 UTC (0+3 container statuses recorded)
Jan 16 10:51:26.737: INFO: 	Container jessie-querier ready: true, restart count 0
Jan 16 10:51:26.737: INFO: 	Container querier ready: true, restart count 0
Jan 16 10:51:26.737: INFO: 	Container webserver ready: true, restart count 0
Jan 16 10:51:26.737: INFO: webserver-7f5969cbc7-c4pjg started at 2023-01-16 10:51:15 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:26.737: INFO: 	Container httpd ready: true, restart count 0
Jan 16 10:51:26.737: INFO: ss2-0 started at 2023-01-16 10:50:42 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:26.737: INFO: 	Container webserver ready: false, restart count 0
Jan 16 10:51:26.737: INFO: csi-mockplugin-attacher-0 started at 2023-01-16 10:51:25 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:26.737: INFO: 	Container csi-attacher ready: false, restart count 0
Jan 16 10:51:26.737: INFO: inline-volume-tester-4xdb4 started at 2023-01-16 10:50:40 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:26.737: INFO: 	Container csi-volume-tester ready: true, restart count 0
Jan 16 10:51:26.737: INFO: kube-proxy-nodes-us-east1-b-9h4h started at 2023-01-16 10:34:55 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:26.737: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 10:51:26.737: INFO: pod-client started at 2023-01-16 10:51:03 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:26.737: INFO: 	Container pod-client ready: true, restart count 0
Jan 16 10:51:26.737: INFO: dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74 started at 2023-01-16 10:49:57 +0000 UTC (0+3 container statuses recorded)
Jan 16 10:51:26.737: INFO: 	Container jessie-querier ready: false, restart count 1
Jan 16 10:51:26.737: INFO: 	Container querier ready: false, restart count 1
Jan 16 10:51:26.737: INFO: 	Container webserver ready: true, restart count 0
Jan 16 10:51:26.737: INFO: webserver-7f5969cbc7-n5mwj started at 2023-01-16 10:51:11 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:26.737: INFO: 	Container httpd ready: true, restart count 0
Jan 16 10:51:26.737: INFO: ss2-0 started at 2023-01-16 10:51:10 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:26.737: INFO: 	Container webserver ready: true, restart count 0
Jan 16 10:51:26.737: INFO: csi-mockplugin-0 started at 2023-01-16 10:51:25 +0000 UTC (0+3 container statuses recorded)
Jan 16 10:51:26.737: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan 16 10:51:26.737: INFO: 	Container driver-registrar ready: false, restart count 0
Jan 16 10:51:26.737: INFO: 	Container mock ready: false, restart count 0
Jan 16 10:51:28.098: INFO: 
Latency metrics for node nodes-us-east1-b-9h4h
Jan 16 10:51:28.098: INFO: 
Logging node info for node nodes-us-east1-b-rn9p
Jan 16 10:51:28.155: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east1-b-rn9p    59f4f25d-24bf-4d96-a4bf-2cf266b5c083 33834 0 2023-01-16 10:34:59 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east1-b-rn9p kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east1-b topology.hostpath.csi/node:nodes-us-east1-b-rn9p topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-7973":"nodes-us-east1-b-rn9p","pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/nodes-us-east1-b-rn9p"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.3/32 projectcalico.org/IPv4IPIPTunnelAddr:100.98.60.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-16 10:34:59 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:00 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-16 10:35:01 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {calico-node Update v1 2023-01-16 10:35:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-16 10:51:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/nodes-us-east1-b-rn9p,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:35:26 +0000 UTC,LastTransitionTime:2023-01-16 10:35:26 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 10:48:25 +0000 UTC,LastTransitionTime:2023-01-16 10:34:59 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 10:48:25 +0000 UTC,LastTransitionTime:2023-01-16 10:34:59 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 10:48:25 +0000 UTC,LastTransitionTime:2023-01-16 10:34:59 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 10:48:25 +0000 UTC,LastTransitionTime:2023-01-16 10:35:14 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.3,},NodeAddress{Type:ExternalIP,Address:34.75.49.181,},NodeAddress{Type:Hostname,Address:nodes-us-east1-b-rn9p,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:9f39c983773df4ca6a15315227d6fd51,SystemUUID:9f39c983-773d-f4ca-6a15-315227d6fd51,BootID:7e9ad329-1a6b-4405-ba71-ca92e45658b3,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:c0ddb4794bc8a3631e3373015f913c00b230ee54f87bde9ade195b3a3415c60f registry.k8s.io/build-image/distroless-iptables:v0.1.2],SizeBytes:7685585,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 16 10:51:28.155: INFO: 
Logging kubelet events for node nodes-us-east1-b-rn9p
Jan 16 10:51:28.197: INFO: 
Logging pods the kubelet thinks is on node nodes-us-east1-b-rn9p
Jan 16 10:51:28.347: INFO: calico-node-ntgj5 started at 2023-01-16 10:35:03 +0000 UTC (3+1 container statuses recorded)
Jan 16 10:51:28.347: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 10:51:28.347: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 10:51:28.347: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 10:51:28.347: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 10:51:28.347: INFO: csi-gce-pd-node-88f4v started at 2023-01-16 10:35:03 +0000 UTC (0+2 container statuses recorded)
Jan 16 10:51:28.347: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 10:51:28.347: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 10:51:28.347: INFO: labelsupdatede477abb-3aac-431e-85d4-3b0bd9f76752 started at 2023-01-16 10:51:06 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:28.347: INFO: 	Container client-container ready: true, restart count 0
Jan 16 10:51:28.347: INFO: ss2-2 started at 2023-01-16 10:50:44 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:28.347: INFO: 	Container webserver ready: false, restart count 0
Jan 16 10:51:28.347: INFO: kube-proxy-nodes-us-east1-b-rn9p started at 2023-01-16 10:34:56 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:28.347: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 10:51:28.347: INFO: privileged-pod started at 2023-01-16 10:50:49 +0000 UTC (0+2 container statuses recorded)
Jan 16 10:51:28.347: INFO: 	Container not-privileged-container ready: true, restart count 0
Jan 16 10:51:28.347: INFO: 	Container privileged-container ready: true, restart count 0
Jan 16 10:51:28.347: INFO: hostexec-nodes-us-east1-b-rn9p-6g4xd started at 2023-01-16 10:51:13 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:28.347: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 16 10:51:28.347: INFO: csi-hostpathplugin-0 started at 2023-01-16 10:51:17 +0000 UTC (0+7 container statuses recorded)
Jan 16 10:51:28.347: INFO: 	Container csi-attacher ready: false, restart count 0
Jan 16 10:51:28.347: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan 16 10:51:28.347: INFO: 	Container csi-resizer ready: false, restart count 0
Jan 16 10:51:28.347: INFO: 	Container csi-snapshotter ready: false, restart count 0
Jan 16 10:51:28.347: INFO: 	Container hostpath ready: false, restart count 0
Jan 16 10:51:28.347: INFO: 	Container liveness-probe ready: false, restart count 0
Jan 16 10:51:28.347: INFO: 	Container node-driver-registrar ready: false, restart count 0
Jan 16 10:51:28.347: INFO: webserver-7f5969cbc7-nc2x2 started at 2023-01-16 10:51:22 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:28.347: INFO: 	Container httpd ready: false, restart count 0
Jan 16 10:51:28.347: INFO: busybox-privileged-true-6fe89232-1ebc-4926-822b-4be92af9a78d started at 2023-01-16 10:51:08 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:28.347: INFO: 	Container busybox-privileged-true-6fe89232-1ebc-4926-822b-4be92af9a78d ready: false, restart count 0
Jan 16 10:51:28.347: INFO: webserver-7f5969cbc7-ddc4d started at 2023-01-16 10:51:22 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:28.347: INFO: 	Container httpd ready: false, restart count 0
Jan 16 10:51:29.723: INFO: 
Latency metrics for node nodes-us-east1-b-rn9p
Jan 16 10:51:29.723: INFO: 
Logging node info for node nodes-us-east1-b-wcrf
Jan 16 10:51:29.760: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east1-b-wcrf    509e8852-b60d-4ccc-864a-4efd7f571608 33082 0 2023-01-16 10:35:00 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east1-b-wcrf kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east1-b topology.hostpath.csi/node:nodes-us-east1-b-wcrf topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-volume-expand-6126":"nodes-us-east1-b-wcrf","pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/nodes-us-east1-b-wcrf"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.2/32 projectcalico.org/IPv4IPIPTunnelAddr:100.110.242.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-16 10:35:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:01 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-16 10:35:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {calico-node Update v1 2023-01-16 10:35:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:51:06 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-16 10:51:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/nodes-us-east1-b-wcrf,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:35:27 +0000 UTC,LastTransitionTime:2023-01-16 10:35:27 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 10:51:12 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 10:51:12 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 10:51:12 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 10:51:12 +0000 UTC,LastTransitionTime:2023-01-16 10:35:15 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.2,},NodeAddress{Type:ExternalIP,Address:35.237.110.203,},NodeAddress{Type:Hostname,Address:nodes-us-east1-b-wcrf,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:90256d4292845f855978b781ab31ded0,SystemUUID:90256d42-9284-5f85-5978-b781ab31ded0,BootID:b6764560-f26d-4d17-83ba-c17bdd70bced,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-volume-expand-6126^acf06ee7-958b-11ed-8f85-aa136efeb01c],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-volume-expand-6126^acf06ee7-958b-11ed-8f85-aa136efeb01c,DevicePath:,},},Config:nil,},}
Jan 16 10:51:29.760: INFO: 
Logging kubelet events for node nodes-us-east1-b-wcrf
Jan 16 10:51:29.798: INFO: 
Logging pods the kubelet thinks is on node nodes-us-east1-b-wcrf
Jan 16 10:51:29.845: INFO: coredns-7bc44848df-rn2pc started at 2023-01-16 10:35:31 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:29.845: INFO: 	Container coredns ready: true, restart count 0
Jan 16 10:51:29.845: INFO: update-demo-nautilus-bv2lc started at 2023-01-16 10:51:10 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:29.845: INFO: 	Container update-demo ready: true, restart count 0
Jan 16 10:51:29.845: INFO: pod-ephm-test-configmap-qpm4 started at 2023-01-16 10:49:49 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:29.845: INFO: 	Container test-container-subpath-configmap-qpm4 ready: false, restart count 0
Jan 16 10:51:29.845: INFO: csi-gce-pd-node-v2gwp started at 2023-01-16 10:35:01 +0000 UTC (0+2 container statuses recorded)
Jan 16 10:51:29.845: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 10:51:29.845: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 10:51:29.845: INFO: hostexec-nodes-us-east1-b-wcrf-f7qh2 started at 2023-01-16 10:51:19 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:29.845: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 16 10:51:29.845: INFO: hostexec-nodes-us-east1-b-wcrf-rkqdl started at 2023-01-16 10:51:23 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:29.845: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 16 10:51:29.845: INFO: csi-hostpathplugin-0 started at 2023-01-16 10:51:01 +0000 UTC (0+7 container statuses recorded)
Jan 16 10:51:29.845: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 16 10:51:29.845: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 16 10:51:29.845: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 16 10:51:29.845: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 16 10:51:29.845: INFO: 	Container hostpath ready: true, restart count 0
Jan 16 10:51:29.845: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 16 10:51:29.845: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 16 10:51:29.845: INFO: webserver-7f5969cbc7-xmmbz started at 2023-01-16 10:51:15 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:29.845: INFO: 	Container httpd ready: true, restart count 0
Jan 16 10:51:29.845: INFO: calico-node-tvbl7 started at 2023-01-16 10:35:01 +0000 UTC (3+1 container statuses recorded)
Jan 16 10:51:29.845: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 10:51:29.845: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 10:51:29.845: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 10:51:29.845: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 10:51:29.845: INFO: webserver-pod started at 2023-01-16 10:51:27 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:29.845: INFO: 	Container agnhost ready: true, restart count 0
Jan 16 10:51:29.845: INFO: pod-subpath-test-configmap-9kzs started at 2023-01-16 10:49:56 +0000 UTC (1+2 container statuses recorded)
Jan 16 10:51:29.845: INFO: 	Init container init-volume-configmap-9kzs ready: true, restart count 0
Jan 16 10:51:29.845: INFO: 	Container test-container-subpath-configmap-9kzs ready: true, restart count 3
Jan 16 10:51:29.845: INFO: 	Container test-container-volume-configmap-9kzs ready: true, restart count 0
Jan 16 10:51:29.845: INFO: kube-proxy-nodes-us-east1-b-wcrf started at 2023-01-16 10:34:57 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:29.845: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 10:51:29.845: INFO: webserver-7f5969cbc7-mj9mq started at 2023-01-16 10:51:15 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:29.845: INFO: 	Container httpd ready: true, restart count 0
Jan 16 10:51:30.137: INFO: 
Latency metrics for node nodes-us-east1-b-wcrf
[DeferCleanup (Each)] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin]
  tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "crd-webhook-2054" for this suite. �[38;5;243m01/16/23 10:51:30.137�[0m

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-cli] Kubectl client Update Demo should create and stop a replication controller [Conformance] 5m9s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-cli\]\sKubectl\sclient\sUpdate\sDemo\sshould\screate\sand\sstop\sa\sreplication\scontroller\s\s\[Conformance\]$'

test/e2e/kubectl/kubectl.go:2431
k8s.io/kubernetes/test/e2e/kubectl.validateController({0x801e128, 0xc003910680}, {0xc0006c7110?, 0xc000cd67d8?}, 0x2, {0x75cf5a1, 0xb}, {0x75e78bb, 0x10}, 0xc001efbcb0, ...)
	test/e2e/kubectl/kubectl.go:2431 +0x49d
k8s.io/kubernetes/test/e2e/kubectl.glob..func1.6.2()
	test/e2e/kubectl/kubectl.go:344 +0x1ec
				[BeforeEach] [sig-cli] Kubectl client
  set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/16/23 10:51:08.031�[0m
Jan 16 10:51:08.032: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename kubectl �[38;5;243m01/16/23 10:51:08.033�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/16/23 10:51:08.138�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/16/23 10:51:08.212�[0m
[BeforeEach] [sig-cli] Kubectl client
  test/e2e/framework/metrics/init/init.go:31
[BeforeEach] [sig-cli] Kubectl client
  test/e2e/kubectl/kubectl.go:274
[BeforeEach] Update Demo
  test/e2e/kubectl/kubectl.go:326
[It] should create and stop a replication controller  [Conformance]
  test/e2e/kubectl/kubectl.go:339
�[1mSTEP:�[0m creating a replication controller �[38;5;243m01/16/23 10:51:08.312�[0m
Jan 16 10:51:08.312: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4365 create -f -'
Jan 16 10:51:10.253: INFO: stderr: ""
Jan 16 10:51:10.253: INFO: stdout: "replicationcontroller/update-demo-nautilus created\n"
�[1mSTEP:�[0m waiting for all containers in name=update-demo pods to come up. �[38;5;243m01/16/23 10:51:10.253�[0m
Jan 16 10:51:10.253: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4365 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo'
Jan 16 10:51:10.468: INFO: stderr: ""
Jan 16 10:51:10.468: INFO: stdout: "update-demo-nautilus-br277 update-demo-nautilus-bv2lc "
Jan 16 10:51:10.468: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4365 get pods update-demo-nautilus-br277 -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}'
Jan 16 10:51:10.660: INFO: stderr: ""
Jan 16 10:51:10.660: INFO: stdout: ""
Jan 16 10:51:10.660: INFO: update-demo-nautilus-br277 is created but not running
Jan 16 10:51:15.660: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4365 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo'
Jan 16 10:51:15.874: INFO: stderr: ""
Jan 16 10:51:15.874: INFO: stdout: "update-demo-nautilus-br277 update-demo-nautilus-bv2lc "
Jan 16 10:51:15.874: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4365 get pods update-demo-nautilus-br277 -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}'
Jan 16 10:51:16.055: INFO: stderr: ""
Jan 16 10:51:16.055: INFO: stdout: ""
Jan 16 10:51:16.055: INFO: update-demo-nautilus-br277 is created but not running
Jan 16 10:51:21.056: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4365 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo'
Jan 16 10:51:21.270: INFO: stderr: ""
Jan 16 10:51:21.270: INFO: stdout: "update-demo-nautilus-br277 update-demo-nautilus-bv2lc "
Jan 16 10:51:21.270: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4365 get pods update-demo-nautilus-br277 -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}'
Jan 16 10:51:21.453: INFO: stderr: ""
Jan 16 10:51:21.453: INFO: stdout: ""
Jan 16 10:51:21.453: INFO: update-demo-nautilus-br277 is created but not running
Jan 16 10:51:26.453: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4365 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo'
Jan 16 10:51:26.667: INFO: stderr: ""
Jan 16 10:51:26.667: INFO: stdout: "update-demo-nautilus-br277 update-demo-nautilus-bv2lc "
Jan 16 10:51:26.667: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4365 get pods update-demo-nautilus-br277 -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}'
Jan 16 10:51:26.857: INFO: stderr: ""
Jan 16 10:51:26.857: INFO: stdout: "true"
Jan 16 10:51:26.857: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4365 get pods update-demo-nautilus-br277 -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}'
Jan 16 10:51:27.052: INFO: stderr: ""
Jan 16 10:51:27.052: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.7"
Jan 16 10:51:27.052: INFO: validating pod update-demo-nautilus-br277
Jan 16 10:51:57.096: INFO: update-demo-nautilus-br277 is running right image but validator function failed: the server is currently unable to handle the request (get pods update-demo-nautilus-br277)
Jan 16 10:52:02.096: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4365 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo'
Jan 16 10:52:02.308: INFO: stderr: ""
Jan 16 10:52:02.308: INFO: stdout: "update-demo-nautilus-br277 update-demo-nautilus-bv2lc "
Jan 16 10:52:02.308: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4365 get pods update-demo-nautilus-br277 -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}'
Jan 16 10:52:02.492: INFO: stderr: ""
Jan 16 10:52:02.493: INFO: stdout: "true"
Jan 16 10:52:02.493: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4365 get pods update-demo-nautilus-br277 -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}'
Jan 16 10:52:02.684: INFO: stderr: ""
Jan 16 10:52:02.684: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.7"
Jan 16 10:52:02.684: INFO: validating pod update-demo-nautilus-br277
Jan 16 10:52:32.719: INFO: update-demo-nautilus-br277 is running right image but validator function failed: the server is currently unable to handle the request (get pods update-demo-nautilus-br277)
Jan 16 10:52:37.720: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4365 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo'
Jan 16 10:52:37.995: INFO: stderr: ""
Jan 16 10:52:37.995: INFO: stdout: "update-demo-nautilus-br277 update-demo-nautilus-bv2lc "
Jan 16 10:52:37.995: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4365 get pods update-demo-nautilus-br277 -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}'
Jan 16 10:52:38.199: INFO: stderr: ""
Jan 16 10:52:38.199: INFO: stdout: "true"
Jan 16 10:52:38.199: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4365 get pods update-demo-nautilus-br277 -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}'
Jan 16 10:52:38.398: INFO: stderr: ""
Jan 16 10:52:38.398: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.7"
Jan 16 10:52:38.398: INFO: validating pod update-demo-nautilus-br277
Jan 16 10:53:08.461: INFO: update-demo-nautilus-br277 is running right image but validator function failed: the server is currently unable to handle the request (get pods update-demo-nautilus-br277)
Jan 16 10:53:13.462: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4365 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo'
Jan 16 10:53:13.682: INFO: stderr: ""
Jan 16 10:53:13.682: INFO: stdout: "update-demo-nautilus-br277 update-demo-nautilus-bv2lc "
Jan 16 10:53:13.682: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4365 get pods update-demo-nautilus-br277 -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}'
Jan 16 10:53:13.880: INFO: stderr: ""
Jan 16 10:53:13.880: INFO: stdout: "true"
Jan 16 10:53:13.880: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4365 get pods update-demo-nautilus-br277 -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}'
Jan 16 10:53:14.083: INFO: stderr: ""
Jan 16 10:53:14.083: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.7"
Jan 16 10:53:14.083: INFO: validating pod update-demo-nautilus-br277
Jan 16 10:53:44.138: INFO: update-demo-nautilus-br277 is running right image but validator function failed: the server is currently unable to handle the request (get pods update-demo-nautilus-br277)
Jan 16 10:53:49.138: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4365 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo'
Jan 16 10:53:49.410: INFO: stderr: ""
Jan 16 10:53:49.410: INFO: stdout: "update-demo-nautilus-br277 update-demo-nautilus-bv2lc "
Jan 16 10:53:49.410: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4365 get pods update-demo-nautilus-br277 -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}'
Jan 16 10:53:49.635: INFO: stderr: ""
Jan 16 10:53:49.635: INFO: stdout: "true"
Jan 16 10:53:49.635: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4365 get pods update-demo-nautilus-br277 -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}'
Jan 16 10:53:49.975: INFO: stderr: ""
Jan 16 10:53:49.975: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.7"
Jan 16 10:53:49.975: INFO: validating pod update-demo-nautilus-br277
Jan 16 10:54:20.016: INFO: update-demo-nautilus-br277 is running right image but validator function failed: the server is currently unable to handle the request (get pods update-demo-nautilus-br277)
Jan 16 10:54:25.017: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4365 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo'
Jan 16 10:54:25.246: INFO: stderr: ""
Jan 16 10:54:25.246: INFO: stdout: "update-demo-nautilus-br277 update-demo-nautilus-bv2lc "
Jan 16 10:54:25.246: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4365 get pods update-demo-nautilus-br277 -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}'
Jan 16 10:54:25.430: INFO: stderr: ""
Jan 16 10:54:25.430: INFO: stdout: "true"
Jan 16 10:54:25.430: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4365 get pods update-demo-nautilus-br277 -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}'
Jan 16 10:54:25.612: INFO: stderr: ""
Jan 16 10:54:25.612: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.7"
Jan 16 10:54:25.612: INFO: validating pod update-demo-nautilus-br277
Jan 16 10:54:55.650: INFO: update-demo-nautilus-br277 is running right image but validator function failed: the server is currently unable to handle the request (get pods update-demo-nautilus-br277)
Jan 16 10:55:00.650: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4365 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo'
Jan 16 10:55:00.860: INFO: stderr: ""
Jan 16 10:55:00.860: INFO: stdout: "update-demo-nautilus-br277 update-demo-nautilus-bv2lc "
Jan 16 10:55:00.860: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4365 get pods update-demo-nautilus-br277 -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}'
Jan 16 10:55:01.041: INFO: stderr: ""
Jan 16 10:55:01.041: INFO: stdout: "true"
Jan 16 10:55:01.041: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4365 get pods update-demo-nautilus-br277 -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}'
Jan 16 10:55:01.227: INFO: stderr: ""
Jan 16 10:55:01.227: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.7"
Jan 16 10:55:01.227: INFO: validating pod update-demo-nautilus-br277
Jan 16 10:55:31.262: INFO: update-demo-nautilus-br277 is running right image but validator function failed: the server is currently unable to handle the request (get pods update-demo-nautilus-br277)
Jan 16 10:55:36.262: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4365 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo'
Jan 16 10:55:36.479: INFO: stderr: ""
Jan 16 10:55:36.479: INFO: stdout: "update-demo-nautilus-br277 update-demo-nautilus-bv2lc "
Jan 16 10:55:36.479: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4365 get pods update-demo-nautilus-br277 -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}'
Jan 16 10:55:36.660: INFO: stderr: ""
Jan 16 10:55:36.660: INFO: stdout: "true"
Jan 16 10:55:36.660: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4365 get pods update-demo-nautilus-br277 -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}'
Jan 16 10:55:36.864: INFO: stderr: ""
Jan 16 10:55:36.864: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.7"
Jan 16 10:55:36.864: INFO: validating pod update-demo-nautilus-br277
Jan 16 10:56:06.916: INFO: update-demo-nautilus-br277 is running right image but validator function failed: the server is currently unable to handle the request (get pods update-demo-nautilus-br277)
Jan 16 10:56:11.917: FAIL: Timed out after 300 seconds waiting for name=update-demo pods to reach valid state

Full Stack Trace
k8s.io/kubernetes/test/e2e/kubectl.validateController({0x801e128, 0xc003910680}, {0xc0006c7110?, 0xc000cd67d8?}, 0x2, {0x75cf5a1, 0xb}, {0x75e78bb, 0x10}, 0xc001efbcb0, ...)
	test/e2e/kubectl/kubectl.go:2431 +0x49d
k8s.io/kubernetes/test/e2e/kubectl.glob..func1.6.2()
	test/e2e/kubectl/kubectl.go:344 +0x1ec
�[1mSTEP:�[0m using delete to clean up resources �[38;5;243m01/16/23 10:56:11.917�[0m
Jan 16 10:56:11.917: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4365 delete --grace-period=0 --force -f -'
Jan 16 10:56:12.161: INFO: stderr: "Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely.\n"
Jan 16 10:56:12.161: INFO: stdout: "replicationcontroller \"update-demo-nautilus\" force deleted\n"
Jan 16 10:56:12.161: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4365 get rc,svc -l name=update-demo --no-headers'
Jan 16 10:56:12.427: INFO: stderr: "No resources found in kubectl-4365 namespace.\n"
Jan 16 10:56:12.427: INFO: stdout: ""
Jan 16 10:56:12.427: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4365 get pods -l name=update-demo -o go-template={{ range .items }}{{ if not .metadata.deletionTimestamp }}{{ .metadata.name }}{{ "\n" }}{{ end }}{{ end }}'
Jan 16 10:56:12.669: INFO: stderr: ""
Jan 16 10:56:12.669: INFO: stdout: ""
[AfterEach] [sig-cli] Kubectl client
  test/e2e/framework/node/init/init.go:32
Jan 16 10:56:12.669: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-cli] Kubectl client
  test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-cli] Kubectl client
  dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/16/23 10:56:12.707�[0m
�[1mSTEP:�[0m Collecting events from namespace "kubectl-4365". �[38;5;243m01/16/23 10:56:12.707�[0m
�[1mSTEP:�[0m Found 13 events. �[38;5;243m01/16/23 10:56:12.743�[0m
Jan 16 10:56:12.743: INFO: At 2023-01-16 10:51:10 +0000 UTC - event for update-demo-nautilus: {replication-controller } SuccessfulCreate: Created pod: update-demo-nautilus-bv2lc
Jan 16 10:56:12.743: INFO: At 2023-01-16 10:51:10 +0000 UTC - event for update-demo-nautilus: {replication-controller } SuccessfulCreate: Created pod: update-demo-nautilus-br277
Jan 16 10:56:12.743: INFO: At 2023-01-16 10:51:10 +0000 UTC - event for update-demo-nautilus-br277: {default-scheduler } Scheduled: Successfully assigned kubectl-4365/update-demo-nautilus-br277 to nodes-us-east1-b-2xs4
Jan 16 10:56:12.743: INFO: At 2023-01-16 10:51:10 +0000 UTC - event for update-demo-nautilus-bv2lc: {default-scheduler } Scheduled: Successfully assigned kubectl-4365/update-demo-nautilus-bv2lc to nodes-us-east1-b-wcrf
Jan 16 10:56:12.743: INFO: At 2023-01-16 10:51:11 +0000 UTC - event for update-demo-nautilus-bv2lc: {kubelet nodes-us-east1-b-wcrf} Started: Started container update-demo
Jan 16 10:56:12.743: INFO: At 2023-01-16 10:51:11 +0000 UTC - event for update-demo-nautilus-bv2lc: {kubelet nodes-us-east1-b-wcrf} Pulled: Container image "registry.k8s.io/e2e-test-images/nautilus:1.7" already present on machine
Jan 16 10:56:12.743: INFO: At 2023-01-16 10:51:11 +0000 UTC - event for update-demo-nautilus-bv2lc: {kubelet nodes-us-east1-b-wcrf} Created: Created container update-demo
Jan 16 10:56:12.743: INFO: At 2023-01-16 10:51:12 +0000 UTC - event for update-demo-nautilus-br277: {kubelet nodes-us-east1-b-2xs4} Pulling: Pulling image "registry.k8s.io/e2e-test-images/nautilus:1.7"
Jan 16 10:56:12.743: INFO: At 2023-01-16 10:51:20 +0000 UTC - event for update-demo-nautilus-br277: {kubelet nodes-us-east1-b-2xs4} Created: Created container update-demo
Jan 16 10:56:12.743: INFO: At 2023-01-16 10:51:20 +0000 UTC - event for update-demo-nautilus-br277: {kubelet nodes-us-east1-b-2xs4} Pulled: Successfully pulled image "registry.k8s.io/e2e-test-images/nautilus:1.7" in 8.460063381s (8.460078679s including waiting)
Jan 16 10:56:12.743: INFO: At 2023-01-16 10:51:21 +0000 UTC - event for update-demo-nautilus-br277: {kubelet nodes-us-east1-b-2xs4} Started: Started container update-demo
Jan 16 10:56:12.743: INFO: At 2023-01-16 10:56:12 +0000 UTC - event for update-demo-nautilus-br277: {kubelet nodes-us-east1-b-2xs4} Killing: Stopping container update-demo
Jan 16 10:56:12.743: INFO: At 2023-01-16 10:56:12 +0000 UTC - event for update-demo-nautilus-bv2lc: {kubelet nodes-us-east1-b-wcrf} Killing: Stopping container update-demo
Jan 16 10:56:12.785: INFO: POD                         NODE                   PHASE    GRACE  CONDITIONS
Jan 16 10:56:12.785: INFO: update-demo-nautilus-br277  nodes-us-east1-b-2xs4  Running  30s    [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-16 10:51:10 +0000 UTC  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-01-16 10:51:21 +0000 UTC  } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-01-16 10:51:21 +0000 UTC  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-16 10:51:10 +0000 UTC  }]
Jan 16 10:56:12.785: INFO: update-demo-nautilus-bv2lc  nodes-us-east1-b-wcrf  Running  30s    [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-16 10:51:10 +0000 UTC  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-01-16 10:51:12 +0000 UTC  } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-01-16 10:51:12 +0000 UTC  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-16 10:51:10 +0000 UTC  }]
Jan 16 10:56:12.785: INFO: 
Jan 16 10:56:12.931: INFO: 
Logging node info for node control-plane-us-east1-b-nc4v
Jan 16 10:56:12.971: INFO: Node Info: &Node{ObjectMeta:{control-plane-us-east1-b-nc4v    3e043433-4a0a-4797-aed2-d532c70362c4 44644 0 2023-01-16 10:33:51 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-standard-2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:control-plane-us-east1-b-nc4v kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node-role.kubernetes.io/node: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:e2-standard-2 topology.gke.io/zone:us-east1-b topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/control-plane-us-east1-b-nc4v"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.4/32 projectcalico.org/IPv4IPIPTunnelAddr:100.126.126.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-16 10:33:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-16 10:34:31 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:34:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {calico-node Update v1 2023-01-16 10:34:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-16 10:34:51 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:34:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:34:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-16 10:55:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/control-plane-us-east1-b-nc4v,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8332767232 0} {<nil>} 8137468Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8227909632 0} {<nil>} 8035068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:34:56 +0000 UTC,LastTransitionTime:2023-01-16 10:34:56 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 10:55:28 +0000 UTC,LastTransitionTime:2023-01-16 10:33:51 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 10:55:28 +0000 UTC,LastTransitionTime:2023-01-16 10:33:51 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 10:55:28 +0000 UTC,LastTransitionTime:2023-01-16 10:33:51 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 10:55:28 +0000 UTC,LastTransitionTime:2023-01-16 10:34:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.4,},NodeAddress{Type:ExternalIP,Address:35.243.145.107,},NodeAddress{Type:Hostname,Address:control-plane-us-east1-b-nc4v,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e5ac4d7bf983c1b4a0fb9c7211b86ad9,SystemUUID:e5ac4d7b-f983-c1b4-a0fb-9c7211b86ad9,BootID:66119c47-44e2-4c4c-ac93-902592bb3d86,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.0],SizeBytes:135162323,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.0],SizeBytes:124991801,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.0],SizeBytes:57657656,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43637878,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42802014,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:2b6acd7f677f76ffe12ecf3ea7df92eb9b1bdb07336d1ac2a54c7631fb753f7e docker.io/calico/kube-controllers:v3.24.5],SizeBytes:31137169,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2 registry.k8s.io/sig-storage/csi-provisioner:v2.1.0],SizeBytes:21205045,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:50c3cfd458fc8e0bf3c8c521eac39172009382fc66dc5044a330d137c6ed0b09 registry.k8s.io/sig-storage/csi-attacher:v3.1.0],SizeBytes:20103959,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a registry.k8s.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:9af9bf28430b00a0cedeb2ec29acadce45e6afcecd8bdf31c793c624cfa75fa7 registry.k8s.io/sig-storage/csi-snapshotter:v3.0.3],SizeBytes:19500777,},ContainerImage{Names:[docker.io/k8scloudprovidergcp/cloud-controller-manager@sha256:881fd1095937638040723973ade90e6700f1c831a78fb585a3227c4d021b0df9 docker.io/k8scloudprovidergcp/cloud-controller-manager:latest],SizeBytes:18702875,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4967322,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 16 10:56:12.972: INFO: 
Logging kubelet events for node control-plane-us-east1-b-nc4v
Jan 16 10:56:13.011: INFO: 
Logging pods the kubelet thinks is on node control-plane-us-east1-b-nc4v
Jan 16 10:56:13.064: INFO: etcd-manager-events-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:56:13.064: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 16 10:56:13.064: INFO: etcd-manager-main-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:56:13.064: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 16 10:56:13.064: INFO: kube-apiserver-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+2 container statuses recorded)
Jan 16 10:56:13.064: INFO: 	Container healthcheck ready: true, restart count 0
Jan 16 10:56:13.064: INFO: 	Container kube-apiserver ready: true, restart count 1
Jan 16 10:56:13.064: INFO: csi-gce-pd-node-kz9xf started at 2023-01-16 10:34:14 +0000 UTC (0+2 container statuses recorded)
Jan 16 10:56:13.064: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 10:56:13.064: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 10:56:13.064: INFO: dns-controller-6d5f4bf5d6-kqf4d started at 2023-01-16 10:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:56:13.064: INFO: 	Container dns-controller ready: true, restart count 0
Jan 16 10:56:13.064: INFO: csi-gce-pd-controller-78fc966fff-m86hh started at 2023-01-16 10:34:31 +0000 UTC (0+5 container statuses recorded)
Jan 16 10:56:13.064: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 16 10:56:13.064: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 16 10:56:13.064: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 16 10:56:13.064: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 16 10:56:13.064: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 10:56:13.064: INFO: kops-controller-smdjr started at 2023-01-16 10:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:56:13.064: INFO: 	Container kops-controller ready: true, restart count 0
Jan 16 10:56:13.064: INFO: kube-scheduler-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:56:13.064: INFO: 	Container kube-scheduler ready: true, restart count 0
Jan 16 10:56:13.064: INFO: kube-proxy-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:56:13.064: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 10:56:13.064: INFO: calico-node-5jgkc started at 2023-01-16 10:34:24 +0000 UTC (3+1 container statuses recorded)
Jan 16 10:56:13.064: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 10:56:13.064: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 10:56:13.064: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 10:56:13.064: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 10:56:13.064: INFO: cloud-controller-manager-b5qds started at 2023-01-16 10:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:56:13.064: INFO: 	Container cloud-controller-manager ready: true, restart count 0
Jan 16 10:56:13.064: INFO: calico-kube-controllers-55f488656-hcbkw started at 2023-01-16 10:34:50 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:56:13.064: INFO: 	Container calico-kube-controllers ready: true, restart count 0
Jan 16 10:56:13.064: INFO: kube-controller-manager-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:56:13.064: INFO: 	Container kube-controller-manager ready: true, restart count 2
Jan 16 10:56:13.420: INFO: 
Latency metrics for node control-plane-us-east1-b-nc4v
Jan 16 10:56:13.420: INFO: 
Logging node info for node nodes-us-east1-b-2xs4
Jan 16 10:56:13.455: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east1-b-2xs4    5523b1af-a125-4437-baf4-a87ff6e2a424 45893 0 2023-01-16 10:35:00 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east1-b-2xs4 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east1-b topology.hostpath.csi/node:nodes-us-east1-b-2xs4 topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/nodes-us-east1-b-2xs4"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.6/32 projectcalico.org/IPv4IPIPTunnelAddr:100.123.6.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2023-01-16 10:35:00 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2023-01-16 10:35:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-16 10:35:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {calico-node Update v1 2023-01-16 10:35:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-16 10:55:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/nodes-us-east1-b-2xs4,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:35:32 +0000 UTC,LastTransitionTime:2023-01-16 10:35:32 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 10:55:58 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 10:55:58 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 10:55:58 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 10:55:58 +0000 UTC,LastTransitionTime:2023-01-16 10:35:20 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.6,},NodeAddress{Type:ExternalIP,Address:35.196.42.74,},NodeAddress{Type:Hostname,Address:nodes-us-east1-b-2xs4,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:39f2b9ba1d525f08f837cadb4248f14d,SystemUUID:39f2b9ba-1d52-5f08-f837-cadb4248f14d,BootID:7acec4fd-f02a-4704-a113-25a81be183ce,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 16 10:56:13.455: INFO: 
Logging kubelet events for node nodes-us-east1-b-2xs4
Jan 16 10:56:13.501: INFO: 
Logging pods the kubelet thinks is on node nodes-us-east1-b-2xs4
Jan 16 10:56:13.584: INFO: default started at 2023-01-16 10:55:02 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:56:13.584: INFO: 	Container cntr ready: true, restart count 0
Jan 16 10:56:13.584: INFO: netserver-0 started at 2023-01-16 10:55:37 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:56:13.584: INFO: 	Container webserver ready: true, restart count 0
Jan 16 10:56:13.584: INFO: update-demo-nautilus-br277 started at 2023-01-16 10:51:10 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:56:13.584: INFO: 	Container update-demo ready: true, restart count 0
Jan 16 10:56:13.584: INFO: master started at 2023-01-16 10:54:32 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:56:13.584: INFO: 	Container cntr ready: true, restart count 0
Jan 16 10:56:13.584: INFO: agnhost started at 2023-01-16 10:46:16 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:56:13.584: INFO: 	Container agnhost ready: true, restart count 0
Jan 16 10:56:13.584: INFO: pod-subpath-test-preprovisionedpv-55bn started at 2023-01-16 10:56:00 +0000 UTC (1+1 container statuses recorded)
Jan 16 10:56:13.584: INFO: 	Init container init-volume-preprovisionedpv-55bn ready: true, restart count 0
Jan 16 10:56:13.584: INFO: 	Container test-container-subpath-preprovisionedpv-55bn ready: false, restart count 0
Jan 16 10:56:13.584: INFO: hostexec-nodes-us-east1-b-2xs4-gxvc9 started at 2023-01-16 10:55:51 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:56:13.584: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 16 10:56:13.584: INFO: proxy-service-cgkvp-fj8m5 started at 2023-01-16 10:54:34 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:56:13.584: INFO: 	Container proxy-service-cgkvp ready: true, restart count 0
Jan 16 10:56:13.584: INFO: pod-failure-ignore-rnw4n started at 2023-01-16 10:55:54 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:56:13.584: INFO: 	Container c ready: false, restart count 0
Jan 16 10:56:13.584: INFO: pod-terminate-status-0-14 started at 2023-01-16 10:55:59 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:56:13.584: INFO: 	Container fail ready: true, restart count 0
Jan 16 10:56:13.584: INFO: pod-configmaps-b505898f-bc84-4424-8765-ae56f7ecdeb5 started at 2023-01-16 10:56:00 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:56:13.584: INFO: 	Container agnhost-container ready: false, restart count 0
Jan 16 10:56:13.584: INFO: pod-configmaps-6a33a767-d8a1-415e-b464-de60ce7130cc started at 2023-01-16 10:56:05 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:56:13.584: INFO: 	Container configmap-volume-test ready: false, restart count 0
Jan 16 10:56:13.584: INFO: pod-failure-ignore-ttf5m started at 2023-01-16 10:55:54 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:56:13.584: INFO: 	Container c ready: false, restart count 0
Jan 16 10:56:13.584: INFO: slave started at 2023-01-16 10:54:40 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:56:13.584: INFO: 	Container cntr ready: true, restart count 0
Jan 16 10:56:13.584: INFO: private started at 2023-01-16 10:54:50 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:56:13.584: INFO: 	Container cntr ready: true, restart count 0
Jan 16 10:56:13.584: INFO: kube-proxy-nodes-us-east1-b-2xs4 started at 2023-01-16 10:34:50 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:56:13.584: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 10:56:13.584: INFO: csi-gce-pd-node-jc8jn started at 2023-01-16 10:35:10 +0000 UTC (0+2 container statuses recorded)
Jan 16 10:56:13.584: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 10:56:13.584: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 10:56:13.584: INFO: pod-failure-ignore-6sbgg started at 2023-01-16 10:56:08 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:56:13.584: INFO: 	Container c ready: false, restart count 0
Jan 16 10:56:13.584: INFO: calico-node-qlnmx started at 2023-01-16 10:35:10 +0000 UTC (3+1 container statuses recorded)
Jan 16 10:56:13.584: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 10:56:13.584: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 10:56:13.584: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 10:56:13.584: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 10:56:13.584: INFO: dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1 started at 2023-01-16 10:43:45 +0000 UTC (0+3 container statuses recorded)
Jan 16 10:56:13.584: INFO: 	Container jessie-querier ready: true, restart count 0
Jan 16 10:56:13.584: INFO: 	Container querier ready: true, restart count 0
Jan 16 10:56:13.584: INFO: 	Container webserver ready: true, restart count 0
Jan 16 10:56:13.584: INFO: e2e-fwcfp-gwchs started at 2023-01-16 10:56:05 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:56:13.584: INFO: 	Container c ready: false, restart count 0
Jan 16 10:56:15.940: INFO: 
Latency metrics for node nodes-us-east1-b-2xs4
Jan 16 10:56:15.940: INFO: 
Logging node info for node nodes-us-east1-b-9h4h
Jan 16 10:56:15.977: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east1-b-9h4h    672ac3b7-ea1d-4e3e-bd88-42fa1b6384a8 43495 0 2023-01-16 10:34:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east1-b-9h4h kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east1-b topology.hostpath.csi/node:nodes-us-east1-b-9h4h topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/nodes-us-east1-b-9h4h"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.5/32 projectcalico.org/IPv4IPIPTunnelAddr:100.103.14.192 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-16 10:34:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:34:59 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-16 10:34:59 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:35:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {calico-node Update v1 2023-01-16 10:35:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-16 10:55:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/nodes-us-east1-b-9h4h,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:35:24 +0000 UTC,LastTransitionTime:2023-01-16 10:35:24 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 10:54:04 +0000 UTC,LastTransitionTime:2023-01-16 10:34:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 10:54:04 +0000 UTC,LastTransitionTime:2023-01-16 10:34:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 10:54:04 +0000 UTC,LastTransitionTime:2023-01-16 10:34:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 10:54:04 +0000 UTC,LastTransitionTime:2023-01-16 10:35:13 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.5,},NodeAddress{Type:ExternalIP,Address:35.196.180.243,},NodeAddress{Type:Hostname,Address:nodes-us-east1-b-9h4h,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:828dcdb67e74b8a327b01dc0797be5e1,SystemUUID:828dcdb6-7e74-b8a3-27b0-1dc0797be5e1,BootID:dd05deb0-ef00-47e1-83af-c902277fe4b7,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 16 10:56:15.978: INFO: 
Logging kubelet events for node nodes-us-east1-b-9h4h
Jan 16 10:56:16.024: INFO: 
Logging pods the kubelet thinks is on node nodes-us-east1-b-9h4h
Jan 16 10:56:16.074: INFO: exceed-active-deadline-ghgb2 started at <nil> (0+0 container statuses recorded)
Jan 16 10:56:16.075: INFO: dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74 started at 2023-01-16 10:49:57 +0000 UTC (0+3 container statuses recorded)
Jan 16 10:56:16.075: INFO: 	Container jessie-querier ready: true, restart count 5
Jan 16 10:56:16.075: INFO: 	Container querier ready: true, restart count 5
Jan 16 10:56:16.075: INFO: 	Container webserver ready: true, restart count 0
Jan 16 10:56:16.075: INFO: kube-proxy-nodes-us-east1-b-9h4h started at 2023-01-16 10:34:55 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:56:16.075: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 10:56:16.075: INFO: var-expansion-b86cdc0a-b736-486f-b035-28747ca64937 started at 2023-01-16 10:56:13 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:56:16.075: INFO: 	Container dapi-container ready: false, restart count 0
Jan 16 10:56:16.075: INFO: test-grpc-65ab9736-a3aa-4fc1-bba5-6ddbf2c4a17a started at 2023-01-16 10:52:39 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:56:16.075: INFO: 	Container etcd ready: true, restart count 0
Jan 16 10:56:16.075: INFO: netserver-1 started at 2023-01-16 10:55:37 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:56:16.075: INFO: 	Container webserver ready: true, restart count 0
Jan 16 10:56:16.075: INFO: pod-terminate-status-1-14 started at 2023-01-16 10:56:11 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:56:16.075: INFO: 	Container fail ready: false, restart count 0
Jan 16 10:56:16.075: INFO: pause-pod-1 started at 2023-01-16 10:55:21 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:56:16.075: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 16 10:56:16.075: INFO: coredns-autoscaler-7cb5c5b969-mpv8x started at 2023-01-16 10:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:56:16.075: INFO: 	Container autoscaler ready: true, restart count 0
Jan 16 10:56:16.075: INFO: busybox-readonly-fs5478f72f-ec37-4958-87ee-5afed9fe6830 started at 2023-01-16 10:55:53 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:56:16.075: INFO: 	Container busybox-readonly-fs5478f72f-ec37-4958-87ee-5afed9fe6830 ready: true, restart count 0
Jan 16 10:56:16.075: INFO: e2e-fwcfp-fppkx started at 2023-01-16 10:55:58 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:56:16.075: INFO: 	Container c ready: false, restart count 0
Jan 16 10:56:16.075: INFO: csi-gce-pd-node-ncgj4 started at 2023-01-16 10:35:01 +0000 UTC (0+2 container statuses recorded)
Jan 16 10:56:16.075: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 10:56:16.075: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 10:56:16.075: INFO: calico-node-gmwsc started at 2023-01-16 10:35:01 +0000 UTC (3+1 container statuses recorded)
Jan 16 10:56:16.075: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 10:56:16.075: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 10:56:16.075: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 10:56:16.075: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 10:56:16.075: INFO: coredns-7bc44848df-zs55k started at 2023-01-16 10:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:56:16.075: INFO: 	Container coredns ready: true, restart count 0
Jan 16 10:56:16.075: INFO: pod-secrets-75dc4f50-9475-4a3c-aa79-5a0f4c6bdc77 started at <nil> (0+0 container statuses recorded)
Jan 16 10:56:16.075: INFO: dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94 started at 2023-01-16 10:49:18 +0000 UTC (0+3 container statuses recorded)
Jan 16 10:56:16.075: INFO: 	Container jessie-querier ready: true, restart count 0
Jan 16 10:56:16.075: INFO: 	Container querier ready: true, restart count 0
Jan 16 10:56:16.075: INFO: 	Container webserver ready: true, restart count 0
Jan 16 10:56:16.075: INFO: host-test-container-pod started at 2023-01-16 10:56:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:56:16.075: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 16 10:56:16.075: INFO: e2e-fwcfp-qgst4 started at 2023-01-16 10:55:58 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:56:16.075: INFO: 	Container c ready: false, restart count 0
Jan 16 10:56:16.075: INFO: e2e-fwcfp-lbsrj started at 2023-01-16 10:56:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:56:16.075: INFO: 	Container c ready: false, restart count 0
Jan 16 10:56:16.526: INFO: 
Latency metrics for node nodes-us-east1-b-9h4h
Jan 16 10:56:16.526: INFO: 
Logging node info for node nodes-us-east1-b-rn9p
Jan 16 10:56:16.562: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east1-b-rn9p    59f4f25d-24bf-4d96-a4bf-2cf266b5c083 46046 0 2023-01-16 10:34:59 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east1-b-rn9p kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east1-b topology.hostpath.csi/node:nodes-us-east1-b-rn9p topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-volume-expand-9322":"nodes-us-east1-b-rn9p","pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/nodes-us-east1-b-rn9p"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.3/32 projectcalico.org/IPv4IPIPTunnelAddr:100.98.60.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-16 10:34:59 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:00 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-16 10:35:01 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {calico-node Update v1 2023-01-16 10:35:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-16 10:56:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/nodes-us-east1-b-rn9p,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:35:26 +0000 UTC,LastTransitionTime:2023-01-16 10:35:26 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 10:55:58 +0000 UTC,LastTransitionTime:2023-01-16 10:34:59 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 10:55:58 +0000 UTC,LastTransitionTime:2023-01-16 10:34:59 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 10:55:58 +0000 UTC,LastTransitionTime:2023-01-16 10:34:59 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 10:55:58 +0000 UTC,LastTransitionTime:2023-01-16 10:35:14 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.3,},NodeAddress{Type:ExternalIP,Address:34.75.49.181,},NodeAddress{Type:Hostname,Address:nodes-us-east1-b-rn9p,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:9f39c983773df4ca6a15315227d6fd51,SystemUUID:9f39c983-773d-f4ca-6a15-315227d6fd51,BootID:7e9ad329-1a6b-4405-ba71-ca92e45658b3,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:c0ddb4794bc8a3631e3373015f913c00b230ee54f87bde9ade195b3a3415c60f registry.k8s.io/build-image/distroless-iptables:v0.1.2],SizeBytes:7685585,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 16 10:56:16.562: INFO: 
Logging kubelet events for node nodes-us-east1-b-rn9p
Jan 16 10:56:16.604: INFO: 
Logging pods the kubelet thinks is on node nodes-us-east1-b-rn9p
Jan 16 10:56:16.667: INFO: csi-gce-pd-node-88f4v started at 2023-01-16 10:35:03 +0000 UTC (0+2 container statuses recorded)
Jan 16 10:56:16.667: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 10:56:16.667: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 10:56:16.667: INFO: exceed-active-deadline-ldsmd started at 2023-01-16 10:56:14 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:56:16.667: INFO: 	Container c ready: false, restart count 0
Jan 16 10:56:16.667: INFO: test-container-pod started at 2023-01-16 10:56:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:56:16.667: INFO: 	Container webserver ready: true, restart count 0
Jan 16 10:56:16.667: INFO: kube-proxy-nodes-us-east1-b-rn9p started at 2023-01-16 10:34:56 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:56:16.667: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 10:56:16.667: INFO: test-grpc-64fb82d3-b8fc-44ab-a9e1-db2212d8632b started at 2023-01-16 10:56:03 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:56:16.667: INFO: 	Container etcd ready: true, restart count 0
Jan 16 10:56:16.667: INFO: netserver-2 started at 2023-01-16 10:55:37 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:56:16.667: INFO: 	Container webserver ready: true, restart count 0
Jan 16 10:56:16.667: INFO: pod-projected-configmaps-96a14278-a0f9-41d2-9458-b8cf42936004 started at 2023-01-16 10:54:59 +0000 UTC (0+3 container statuses recorded)
Jan 16 10:56:16.667: INFO: 	Container createcm-volume-test ready: true, restart count 0
Jan 16 10:56:16.667: INFO: 	Container delcm-volume-test ready: true, restart count 0
Jan 16 10:56:16.667: INFO: 	Container updcm-volume-test ready: true, restart count 0
Jan 16 10:56:16.667: INFO: webserver-pod started at 2023-01-16 10:55:08 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:56:16.667: INFO: 	Container agnhost ready: false, restart count 0
Jan 16 10:56:16.667: INFO: csi-hostpathplugin-0 started at 2023-01-16 10:55:26 +0000 UTC (0+7 container statuses recorded)
Jan 16 10:56:16.667: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 16 10:56:16.667: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 16 10:56:16.667: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 16 10:56:16.667: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 16 10:56:16.667: INFO: 	Container hostpath ready: true, restart count 0
Jan 16 10:56:16.667: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 16 10:56:16.667: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 16 10:56:16.667: INFO: busybox-readonly-false-1f1747a2-779b-4b81-b02d-175b372fb54d started at 2023-01-16 10:56:16 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:56:16.667: INFO: 	Container busybox-readonly-false-1f1747a2-779b-4b81-b02d-175b372fb54d ready: false, restart count 0
Jan 16 10:56:16.667: INFO: calico-node-ntgj5 started at 2023-01-16 10:35:03 +0000 UTC (3+1 container statuses recorded)
Jan 16 10:56:16.667: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 10:56:16.667: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 10:56:16.667: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 10:56:16.667: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 10:56:16.969: INFO: 
Latency metrics for node nodes-us-east1-b-rn9p
Jan 16 10:56:16.969: INFO: 
Logging node info for node nodes-us-east1-b-wcrf
Jan 16 10:56:17.006: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east1-b-wcrf    509e8852-b60d-4ccc-864a-4efd7f571608 46254 0 2023-01-16 10:35:00 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east1-b-wcrf kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east1-b topology.hostpath.csi/node:nodes-us-east1-b-wcrf topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-6351":"nodes-us-east1-b-wcrf","csi-hostpath-provisioning-2138":"nodes-us-east1-b-wcrf","pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/nodes-us-east1-b-wcrf"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.2/32 projectcalico.org/IPv4IPIPTunnelAddr:100.110.242.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-16 10:35:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:01 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-16 10:35:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {calico-node Update v1 2023-01-16 10:35:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:56:00 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-16 10:56:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/nodes-us-east1-b-wcrf,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:35:27 +0000 UTC,LastTransitionTime:2023-01-16 10:35:27 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 10:56:08 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 10:56:08 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 10:56:08 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 10:56:08 +0000 UTC,LastTransitionTime:2023-01-16 10:35:15 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.2,},NodeAddress{Type:ExternalIP,Address:35.237.110.203,},NodeAddress{Type:Hostname,Address:nodes-us-east1-b-wcrf,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:90256d4292845f855978b781ab31ded0,SystemUUID:90256d42-9284-5f85-5978-b781ab31ded0,BootID:b6764560-f26d-4d17-83ba-c17bdd70bced,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-6351^5c861bb6-958c-11ed-ba1a-2e0438eef1ab kubernetes.io/csi/csi-hostpath-provisioning-2138^5780c417-958c-11ed-ae7c-56d8138820a0],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-2138^5780c417-958c-11ed-ae7c-56d8138820a0,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-6351^5c861bb6-958c-11ed-ba1a-2e0438eef1ab,DevicePath:,},},Config:nil,},}
Jan 16 10:56:17.007: INFO: 
Logging kubelet events for node nodes-us-east1-b-wcrf
Jan 16 10:56:17.063: INFO: 
Logging pods the kubelet thinks is on node nodes-us-east1-b-wcrf
Jan 16 10:56:17.146: INFO: csi-gce-pd-node-v2gwp started at 2023-01-16 10:35:01 +0000 UTC (0+2 container statuses recorded)
Jan 16 10:56:17.146: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 10:56:17.146: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 10:56:17.146: INFO: netserver-3 started at 2023-01-16 10:55:37 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:56:17.146: INFO: 	Container webserver ready: true, restart count 0
Jan 16 10:56:17.146: INFO: inline-volume-tester-lqw2j started at 2023-01-16 10:56:00 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:56:17.146: INFO: 	Container csi-volume-tester ready: true, restart count 0
Jan 16 10:56:17.146: INFO: csi-hostpathplugin-0 started at 2023-01-16 10:55:49 +0000 UTC (0+7 container statuses recorded)
Jan 16 10:56:17.146: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 16 10:56:17.146: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 16 10:56:17.146: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 16 10:56:17.146: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 16 10:56:17.146: INFO: 	Container hostpath ready: true, restart count 0
Jan 16 10:56:17.146: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 16 10:56:17.146: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 16 10:56:17.146: INFO: calico-node-tvbl7 started at 2023-01-16 10:35:01 +0000 UTC (3+1 container statuses recorded)
Jan 16 10:56:17.146: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 10:56:17.146: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 10:56:17.146: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 10:56:17.146: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 10:56:17.146: INFO: webserver-pod started at 2023-01-16 10:51:27 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:56:17.146: INFO: 	Container agnhost ready: false, restart count 0
Jan 16 10:56:17.146: INFO: kube-proxy-nodes-us-east1-b-wcrf started at 2023-01-16 10:34:57 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:56:17.146: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 10:56:17.146: INFO: csi-hostpathplugin-0 started at 2023-01-16 10:55:55 +0000 UTC (0+7 container statuses recorded)
Jan 16 10:56:17.146: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 16 10:56:17.146: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 16 10:56:17.146: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 16 10:56:17.146: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 16 10:56:17.146: INFO: 	Container hostpath ready: true, restart count 0
Jan 16 10:56:17.146: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 16 10:56:17.146: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 16 10:56:17.146: INFO: coredns-7bc44848df-rn2pc started at 2023-01-16 10:35:31 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:56:17.146: INFO: 	Container coredns ready: true, restart count 0
Jan 16 10:56:17.458: INFO: 
Latency metrics for node nodes-us-east1-b-wcrf
[DeferCleanup (Each)] [sig-cli] Kubectl client
  tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "kubectl-4365" for this suite. �[38;5;243m01/16/23 10:56:17.458�[0m

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-cli] Kubectl client Update Demo should scale a replication controller [Conformance] 5m51s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-cli\]\sKubectl\sclient\sUpdate\sDemo\sshould\sscale\sa\sreplication\scontroller\s\s\[Conformance\]$'

test/e2e/kubectl/kubectl.go:2431
k8s.io/kubernetes/test/e2e/kubectl.validateController({0x801e128, 0xc003910340}, {0xc0006c7110?, 0xc004448104?}, 0x2, {0x75cf5a1, 0xb}, {0x75e78bb, 0x10}, 0xc004b9f230, ...)
	test/e2e/kubectl/kubectl.go:2431 +0x49d
k8s.io/kubernetes/test/e2e/kubectl.glob..func1.6.3()
	test/e2e/kubectl/kubectl.go:357 +0x205
				[BeforeEach] [sig-cli] Kubectl client
  set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/16/23 10:45:16.975�[0m
Jan 16 10:45:16.975: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename kubectl �[38;5;243m01/16/23 10:45:16.976�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/16/23 10:45:17.083�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/16/23 10:45:17.151�[0m
[BeforeEach] [sig-cli] Kubectl client
  test/e2e/framework/metrics/init/init.go:31
[BeforeEach] [sig-cli] Kubectl client
  test/e2e/kubectl/kubectl.go:274
[BeforeEach] Update Demo
  test/e2e/kubectl/kubectl.go:326
[It] should scale a replication controller  [Conformance]
  test/e2e/kubectl/kubectl.go:352
�[1mSTEP:�[0m creating a replication controller �[38;5;243m01/16/23 10:45:17.218�[0m
Jan 16 10:45:17.218: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 create -f -'
Jan 16 10:45:19.077: INFO: stderr: ""
Jan 16 10:45:19.077: INFO: stdout: "replicationcontroller/update-demo-nautilus created\n"
�[1mSTEP:�[0m waiting for all containers in name=update-demo pods to come up. �[38;5;243m01/16/23 10:45:19.077�[0m
Jan 16 10:45:19.077: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo'
Jan 16 10:45:19.268: INFO: stderr: ""
Jan 16 10:45:19.268: INFO: stdout: "update-demo-nautilus-6g9m5 update-demo-nautilus-llkgr "
Jan 16 10:45:19.268: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 get pods update-demo-nautilus-6g9m5 -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}'
Jan 16 10:45:19.486: INFO: stderr: ""
Jan 16 10:45:19.486: INFO: stdout: ""
Jan 16 10:45:19.486: INFO: update-demo-nautilus-6g9m5 is created but not running
Jan 16 10:45:24.486: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo'
Jan 16 10:45:24.702: INFO: stderr: ""
Jan 16 10:45:24.702: INFO: stdout: "update-demo-nautilus-6g9m5 update-demo-nautilus-llkgr "
Jan 16 10:45:24.702: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 get pods update-demo-nautilus-6g9m5 -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}'
Jan 16 10:45:24.908: INFO: stderr: ""
Jan 16 10:45:24.908: INFO: stdout: "true"
Jan 16 10:45:24.908: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 get pods update-demo-nautilus-6g9m5 -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}'
Jan 16 10:45:25.132: INFO: stderr: ""
Jan 16 10:45:25.132: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.7"
Jan 16 10:45:25.132: INFO: validating pod update-demo-nautilus-6g9m5
Jan 16 10:45:25.206: INFO: got data: {
  "image": "nautilus.jpg"
}

Jan 16 10:45:25.206: INFO: Unmarshalled json jpg/img => {nautilus.jpg} , expecting nautilus.jpg .
Jan 16 10:45:25.207: INFO: update-demo-nautilus-6g9m5 is verified up and running
Jan 16 10:45:25.207: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 get pods update-demo-nautilus-llkgr -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}'
Jan 16 10:45:25.410: INFO: stderr: ""
Jan 16 10:45:25.410: INFO: stdout: ""
Jan 16 10:45:25.410: INFO: update-demo-nautilus-llkgr is created but not running
Jan 16 10:45:30.411: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo'
Jan 16 10:45:30.626: INFO: stderr: ""
Jan 16 10:45:30.626: INFO: stdout: "update-demo-nautilus-6g9m5 update-demo-nautilus-llkgr "
Jan 16 10:45:30.626: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 get pods update-demo-nautilus-6g9m5 -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}'
Jan 16 10:45:30.812: INFO: stderr: ""
Jan 16 10:45:30.812: INFO: stdout: "true"
Jan 16 10:45:30.812: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 get pods update-demo-nautilus-6g9m5 -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}'
Jan 16 10:45:31.010: INFO: stderr: ""
Jan 16 10:45:31.010: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.7"
Jan 16 10:45:31.010: INFO: validating pod update-demo-nautilus-6g9m5
Jan 16 10:45:31.052: INFO: got data: {
  "image": "nautilus.jpg"
}

Jan 16 10:45:31.052: INFO: Unmarshalled json jpg/img => {nautilus.jpg} , expecting nautilus.jpg .
Jan 16 10:45:31.052: INFO: update-demo-nautilus-6g9m5 is verified up and running
Jan 16 10:45:31.052: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 get pods update-demo-nautilus-llkgr -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}'
Jan 16 10:45:31.280: INFO: stderr: ""
Jan 16 10:45:31.280: INFO: stdout: "true"
Jan 16 10:45:31.280: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 get pods update-demo-nautilus-llkgr -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}'
Jan 16 10:45:31.486: INFO: stderr: ""
Jan 16 10:45:31.486: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.7"
Jan 16 10:45:31.486: INFO: validating pod update-demo-nautilus-llkgr
Jan 16 10:46:01.540: INFO: update-demo-nautilus-llkgr is running right image but validator function failed: the server is currently unable to handle the request (get pods update-demo-nautilus-llkgr)
Jan 16 10:46:06.542: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo'
Jan 16 10:46:06.807: INFO: stderr: ""
Jan 16 10:46:06.807: INFO: stdout: "update-demo-nautilus-6g9m5 update-demo-nautilus-llkgr "
Jan 16 10:46:06.807: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 get pods update-demo-nautilus-6g9m5 -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}'
Jan 16 10:46:07.027: INFO: stderr: ""
Jan 16 10:46:07.027: INFO: stdout: "true"
Jan 16 10:46:07.027: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 get pods update-demo-nautilus-6g9m5 -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}'
Jan 16 10:46:07.209: INFO: stderr: ""
Jan 16 10:46:07.209: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.7"
Jan 16 10:46:07.209: INFO: validating pod update-demo-nautilus-6g9m5
Jan 16 10:46:07.256: INFO: got data: {
  "image": "nautilus.jpg"
}

Jan 16 10:46:07.256: INFO: Unmarshalled json jpg/img => {nautilus.jpg} , expecting nautilus.jpg .
Jan 16 10:46:07.256: INFO: update-demo-nautilus-6g9m5 is verified up and running
Jan 16 10:46:07.256: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 get pods update-demo-nautilus-llkgr -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}'
Jan 16 10:46:07.460: INFO: stderr: ""
Jan 16 10:46:07.460: INFO: stdout: "true"
Jan 16 10:46:07.460: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 get pods update-demo-nautilus-llkgr -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}'
Jan 16 10:46:07.653: INFO: stderr: ""
Jan 16 10:46:07.653: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.7"
Jan 16 10:46:07.653: INFO: validating pod update-demo-nautilus-llkgr
Jan 16 10:46:37.692: INFO: update-demo-nautilus-llkgr is running right image but validator function failed: the server is currently unable to handle the request (get pods update-demo-nautilus-llkgr)
Jan 16 10:46:42.693: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo'
Jan 16 10:46:42.931: INFO: stderr: ""
Jan 16 10:46:42.931: INFO: stdout: "update-demo-nautilus-6g9m5 update-demo-nautilus-llkgr "
Jan 16 10:46:42.932: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 get pods update-demo-nautilus-6g9m5 -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}'
Jan 16 10:46:43.167: INFO: stderr: ""
Jan 16 10:46:43.167: INFO: stdout: "true"
Jan 16 10:46:43.167: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 get pods update-demo-nautilus-6g9m5 -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}'
Jan 16 10:46:43.344: INFO: stderr: ""
Jan 16 10:46:43.344: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.7"
Jan 16 10:46:43.344: INFO: validating pod update-demo-nautilus-6g9m5
Jan 16 10:46:43.386: INFO: got data: {
  "image": "nautilus.jpg"
}

Jan 16 10:46:43.386: INFO: Unmarshalled json jpg/img => {nautilus.jpg} , expecting nautilus.jpg .
Jan 16 10:46:43.386: INFO: update-demo-nautilus-6g9m5 is verified up and running
Jan 16 10:46:43.386: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 get pods update-demo-nautilus-llkgr -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}'
Jan 16 10:46:43.571: INFO: stderr: ""
Jan 16 10:46:43.571: INFO: stdout: "true"
Jan 16 10:46:43.571: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 get pods update-demo-nautilus-llkgr -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}'
Jan 16 10:46:43.756: INFO: stderr: ""
Jan 16 10:46:43.756: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.7"
Jan 16 10:46:43.756: INFO: validating pod update-demo-nautilus-llkgr
Jan 16 10:47:13.790: INFO: update-demo-nautilus-llkgr is running right image but validator function failed: the server is currently unable to handle the request (get pods update-demo-nautilus-llkgr)
Jan 16 10:47:18.791: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo'
Jan 16 10:47:19.006: INFO: stderr: ""
Jan 16 10:47:19.006: INFO: stdout: "update-demo-nautilus-6g9m5 update-demo-nautilus-llkgr "
Jan 16 10:47:19.006: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 get pods update-demo-nautilus-6g9m5 -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}'
Jan 16 10:47:19.187: INFO: stderr: ""
Jan 16 10:47:19.187: INFO: stdout: "true"
Jan 16 10:47:19.187: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 get pods update-demo-nautilus-6g9m5 -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}'
Jan 16 10:47:19.364: INFO: stderr: ""
Jan 16 10:47:19.364: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.7"
Jan 16 10:47:19.364: INFO: validating pod update-demo-nautilus-6g9m5
Jan 16 10:47:19.403: INFO: got data: {
  "image": "nautilus.jpg"
}

Jan 16 10:47:19.403: INFO: Unmarshalled json jpg/img => {nautilus.jpg} , expecting nautilus.jpg .
Jan 16 10:47:19.403: INFO: update-demo-nautilus-6g9m5 is verified up and running
Jan 16 10:47:19.403: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 get pods update-demo-nautilus-llkgr -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}'
Jan 16 10:47:19.590: INFO: stderr: ""
Jan 16 10:47:19.590: INFO: stdout: "true"
Jan 16 10:47:19.590: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 get pods update-demo-nautilus-llkgr -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}'
Jan 16 10:47:19.778: INFO: stderr: ""
Jan 16 10:47:19.778: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.7"
Jan 16 10:47:19.778: INFO: validating pod update-demo-nautilus-llkgr
Jan 16 10:47:49.830: INFO: update-demo-nautilus-llkgr is running right image but validator function failed: the server is currently unable to handle the request (get pods update-demo-nautilus-llkgr)
Jan 16 10:47:54.830: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo'
Jan 16 10:47:55.066: INFO: stderr: ""
Jan 16 10:47:55.066: INFO: stdout: "update-demo-nautilus-6g9m5 update-demo-nautilus-llkgr "
Jan 16 10:47:55.066: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 get pods update-demo-nautilus-6g9m5 -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}'
Jan 16 10:47:55.248: INFO: stderr: ""
Jan 16 10:47:55.248: INFO: stdout: "true"
Jan 16 10:47:55.248: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 get pods update-demo-nautilus-6g9m5 -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}'
Jan 16 10:47:55.427: INFO: stderr: ""
Jan 16 10:47:55.427: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.7"
Jan 16 10:47:55.427: INFO: validating pod update-demo-nautilus-6g9m5
Jan 16 10:47:55.468: INFO: got data: {
  "image": "nautilus.jpg"
}

Jan 16 10:47:55.468: INFO: Unmarshalled json jpg/img => {nautilus.jpg} , expecting nautilus.jpg .
Jan 16 10:47:55.468: INFO: update-demo-nautilus-6g9m5 is verified up and running
Jan 16 10:47:55.468: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 get pods update-demo-nautilus-llkgr -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}'
Jan 16 10:47:55.649: INFO: stderr: ""
Jan 16 10:47:55.649: INFO: stdout: "true"
Jan 16 10:47:55.649: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 get pods update-demo-nautilus-llkgr -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}'
Jan 16 10:47:55.832: INFO: stderr: ""
Jan 16 10:47:55.832: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.7"
Jan 16 10:47:55.832: INFO: validating pod update-demo-nautilus-llkgr
Jan 16 10:48:25.868: INFO: update-demo-nautilus-llkgr is running right image but validator function failed: the server is currently unable to handle the request (get pods update-demo-nautilus-llkgr)
Jan 16 10:48:30.869: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo'
Jan 16 10:48:31.087: INFO: stderr: ""
Jan 16 10:48:31.087: INFO: stdout: "update-demo-nautilus-6g9m5 update-demo-nautilus-llkgr "
Jan 16 10:48:31.087: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 get pods update-demo-nautilus-6g9m5 -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}'
Jan 16 10:48:31.273: INFO: stderr: ""
Jan 16 10:48:31.273: INFO: stdout: "true"
Jan 16 10:48:31.273: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 get pods update-demo-nautilus-6g9m5 -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}'
Jan 16 10:48:31.503: INFO: stderr: ""
Jan 16 10:48:31.503: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.7"
Jan 16 10:48:31.503: INFO: validating pod update-demo-nautilus-6g9m5
Jan 16 10:48:31.548: INFO: got data: {
  "image": "nautilus.jpg"
}

Jan 16 10:48:31.548: INFO: Unmarshalled json jpg/img => {nautilus.jpg} , expecting nautilus.jpg .
Jan 16 10:48:31.548: INFO: update-demo-nautilus-6g9m5 is verified up and running
Jan 16 10:48:31.548: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 get pods update-demo-nautilus-llkgr -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}'
Jan 16 10:48:31.754: INFO: stderr: ""
Jan 16 10:48:31.754: INFO: stdout: "true"
Jan 16 10:48:31.754: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 get pods update-demo-nautilus-llkgr -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}'
Jan 16 10:48:31.981: INFO: stderr: ""
Jan 16 10:48:31.981: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.7"
Jan 16 10:48:31.981: INFO: validating pod update-demo-nautilus-llkgr
Jan 16 10:49:02.033: INFO: update-demo-nautilus-llkgr is running right image but validator function failed: the server is currently unable to handle the request (get pods update-demo-nautilus-llkgr)
Jan 16 10:49:07.033: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo'
Jan 16 10:49:07.243: INFO: stderr: ""
Jan 16 10:49:07.243: INFO: stdout: "update-demo-nautilus-6g9m5 update-demo-nautilus-llkgr "
Jan 16 10:49:07.244: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 get pods update-demo-nautilus-6g9m5 -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}'
Jan 16 10:49:07.423: INFO: stderr: ""
Jan 16 10:49:07.423: INFO: stdout: "true"
Jan 16 10:49:07.423: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 get pods update-demo-nautilus-6g9m5 -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}'
Jan 16 10:49:07.602: INFO: stderr: ""
Jan 16 10:49:07.602: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.7"
Jan 16 10:49:07.602: INFO: validating pod update-demo-nautilus-6g9m5
Jan 16 10:49:07.640: INFO: got data: {
  "image": "nautilus.jpg"
}

Jan 16 10:49:07.640: INFO: Unmarshalled json jpg/img => {nautilus.jpg} , expecting nautilus.jpg .
Jan 16 10:49:07.640: INFO: update-demo-nautilus-6g9m5 is verified up and running
Jan 16 10:49:07.640: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 get pods update-demo-nautilus-llkgr -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}'
Jan 16 10:49:07.817: INFO: stderr: ""
Jan 16 10:49:07.817: INFO: stdout: "true"
Jan 16 10:49:07.817: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 get pods update-demo-nautilus-llkgr -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}'
Jan 16 10:49:07.995: INFO: stderr: ""
Jan 16 10:49:07.995: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.7"
Jan 16 10:49:07.995: INFO: validating pod update-demo-nautilus-llkgr
Jan 16 10:49:38.029: INFO: update-demo-nautilus-llkgr is running right image but validator function failed: the server is currently unable to handle the request (get pods update-demo-nautilus-llkgr)
Jan 16 10:49:43.030: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo'
Jan 16 10:49:43.256: INFO: stderr: ""
Jan 16 10:49:43.256: INFO: stdout: "update-demo-nautilus-6g9m5 update-demo-nautilus-llkgr "
Jan 16 10:49:43.256: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 get pods update-demo-nautilus-6g9m5 -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}'
Jan 16 10:49:43.438: INFO: stderr: ""
Jan 16 10:49:43.438: INFO: stdout: "true"
Jan 16 10:49:43.438: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 get pods update-demo-nautilus-6g9m5 -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}'
Jan 16 10:49:43.626: INFO: stderr: ""
Jan 16 10:49:43.626: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.7"
Jan 16 10:49:43.626: INFO: validating pod update-demo-nautilus-6g9m5
Jan 16 10:49:43.665: INFO: got data: {
  "image": "nautilus.jpg"
}

Jan 16 10:49:43.665: INFO: Unmarshalled json jpg/img => {nautilus.jpg} , expecting nautilus.jpg .
Jan 16 10:49:43.665: INFO: update-demo-nautilus-6g9m5 is verified up and running
Jan 16 10:49:43.665: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 get pods update-demo-nautilus-llkgr -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}'
Jan 16 10:49:43.844: INFO: stderr: ""
Jan 16 10:49:43.844: INFO: stdout: "true"
Jan 16 10:49:43.844: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 get pods update-demo-nautilus-llkgr -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}'
Jan 16 10:49:44.022: INFO: stderr: ""
Jan 16 10:49:44.022: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.7"
Jan 16 10:49:44.022: INFO: validating pod update-demo-nautilus-llkgr
Jan 16 10:50:14.057: INFO: update-demo-nautilus-llkgr is running right image but validator function failed: the server is currently unable to handle the request (get pods update-demo-nautilus-llkgr)
Jan 16 10:50:19.057: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo'
Jan 16 10:50:19.281: INFO: stderr: ""
Jan 16 10:50:19.281: INFO: stdout: "update-demo-nautilus-6g9m5 update-demo-nautilus-llkgr "
Jan 16 10:50:19.281: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 get pods update-demo-nautilus-6g9m5 -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}'
Jan 16 10:50:19.465: INFO: stderr: ""
Jan 16 10:50:19.465: INFO: stdout: "true"
Jan 16 10:50:19.465: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 get pods update-demo-nautilus-6g9m5 -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}'
Jan 16 10:50:19.656: INFO: stderr: ""
Jan 16 10:50:19.656: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.7"
Jan 16 10:50:19.656: INFO: validating pod update-demo-nautilus-6g9m5
Jan 16 10:50:19.706: INFO: got data: {
  "image": "nautilus.jpg"
}

Jan 16 10:50:19.706: INFO: Unmarshalled json jpg/img => {nautilus.jpg} , expecting nautilus.jpg .
Jan 16 10:50:19.706: INFO: update-demo-nautilus-6g9m5 is verified up and running
Jan 16 10:50:19.706: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 get pods update-demo-nautilus-llkgr -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}'
Jan 16 10:50:19.894: INFO: stderr: ""
Jan 16 10:50:19.894: INFO: stdout: "true"
Jan 16 10:50:19.894: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 get pods update-demo-nautilus-llkgr -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}'
Jan 16 10:50:20.075: INFO: stderr: ""
Jan 16 10:50:20.075: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.7"
Jan 16 10:50:20.075: INFO: validating pod update-demo-nautilus-llkgr
Jan 16 10:50:50.145: INFO: update-demo-nautilus-llkgr is running right image but validator function failed: the server is currently unable to handle the request (get pods update-demo-nautilus-llkgr)
Jan 16 10:50:55.145: FAIL: Timed out after 300 seconds waiting for name=update-demo pods to reach valid state

Full Stack Trace
k8s.io/kubernetes/test/e2e/kubectl.validateController({0x801e128, 0xc003910340}, {0xc0006c7110?, 0xc004448104?}, 0x2, {0x75cf5a1, 0xb}, {0x75e78bb, 0x10}, 0xc004b9f230, ...)
	test/e2e/kubectl/kubectl.go:2431 +0x49d
k8s.io/kubernetes/test/e2e/kubectl.glob..func1.6.3()
	test/e2e/kubectl/kubectl.go:357 +0x205
�[1mSTEP:�[0m using delete to clean up resources �[38;5;243m01/16/23 10:50:55.145�[0m
Jan 16 10:50:55.146: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 delete --grace-period=0 --force -f -'
Jan 16 10:50:56.353: INFO: stderr: "Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely.\n"
Jan 16 10:50:56.353: INFO: stdout: "replicationcontroller \"update-demo-nautilus\" force deleted\n"
Jan 16 10:50:56.353: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 get rc,svc -l name=update-demo --no-headers'
Jan 16 10:50:57.646: INFO: stderr: "No resources found in kubectl-4248 namespace.\n"
Jan 16 10:50:57.646: INFO: stdout: ""
Jan 16 10:50:57.646: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/6590cdcc-9588-11ed-bd5d-72eebb4d772a/kubectl --server=https://35.185.63.242 --kubeconfig=/root/.kube/config --namespace=kubectl-4248 get pods -l name=update-demo -o go-template={{ range .items }}{{ if not .metadata.deletionTimestamp }}{{ .metadata.name }}{{ "\n" }}{{ end }}{{ end }}'
Jan 16 10:50:57.873: INFO: stderr: ""
Jan 16 10:50:57.873: INFO: stdout: ""
[AfterEach] [sig-cli] Kubectl client
  test/e2e/framework/node/init/init.go:32
Jan 16 10:50:57.873: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-cli] Kubectl client
  test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-cli] Kubectl client
  dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/16/23 10:50:57.969�[0m
�[1mSTEP:�[0m Collecting events from namespace "kubectl-4248". �[38;5;243m01/16/23 10:50:57.969�[0m
�[1mSTEP:�[0m Found 14 events. �[38;5;243m01/16/23 10:50:58.044�[0m
Jan 16 10:50:58.044: INFO: At 2023-01-16 10:45:19 +0000 UTC - event for update-demo-nautilus: {replication-controller } SuccessfulCreate: Created pod: update-demo-nautilus-6g9m5
Jan 16 10:50:58.044: INFO: At 2023-01-16 10:45:19 +0000 UTC - event for update-demo-nautilus: {replication-controller } SuccessfulCreate: Created pod: update-demo-nautilus-llkgr
Jan 16 10:50:58.044: INFO: At 2023-01-16 10:45:19 +0000 UTC - event for update-demo-nautilus-6g9m5: {default-scheduler } Scheduled: Successfully assigned kubectl-4248/update-demo-nautilus-6g9m5 to nodes-us-east1-b-wcrf
Jan 16 10:50:58.044: INFO: At 2023-01-16 10:45:19 +0000 UTC - event for update-demo-nautilus-llkgr: {default-scheduler } Scheduled: Successfully assigned kubectl-4248/update-demo-nautilus-llkgr to nodes-us-east1-b-9h4h
Jan 16 10:50:58.044: INFO: At 2023-01-16 10:45:20 +0000 UTC - event for update-demo-nautilus-6g9m5: {kubelet nodes-us-east1-b-wcrf} Pulling: Pulling image "registry.k8s.io/e2e-test-images/nautilus:1.7"
Jan 16 10:50:58.044: INFO: At 2023-01-16 10:45:20 +0000 UTC - event for update-demo-nautilus-llkgr: {kubelet nodes-us-east1-b-9h4h} Pulling: Pulling image "registry.k8s.io/e2e-test-images/nautilus:1.7"
Jan 16 10:50:58.044: INFO: At 2023-01-16 10:45:23 +0000 UTC - event for update-demo-nautilus-6g9m5: {kubelet nodes-us-east1-b-wcrf} Pulled: Successfully pulled image "registry.k8s.io/e2e-test-images/nautilus:1.7" in 3.69263416s (3.692641746s including waiting)
Jan 16 10:50:58.044: INFO: At 2023-01-16 10:45:24 +0000 UTC - event for update-demo-nautilus-6g9m5: {kubelet nodes-us-east1-b-wcrf} Created: Created container update-demo
Jan 16 10:50:58.044: INFO: At 2023-01-16 10:45:24 +0000 UTC - event for update-demo-nautilus-6g9m5: {kubelet nodes-us-east1-b-wcrf} Started: Started container update-demo
Jan 16 10:50:58.044: INFO: At 2023-01-16 10:45:26 +0000 UTC - event for update-demo-nautilus-llkgr: {kubelet nodes-us-east1-b-9h4h} Pulled: Successfully pulled image "registry.k8s.io/e2e-test-images/nautilus:1.7" in 5.58477851s (5.584806043s including waiting)
Jan 16 10:50:58.045: INFO: At 2023-01-16 10:45:26 +0000 UTC - event for update-demo-nautilus-llkgr: {kubelet nodes-us-east1-b-9h4h} Created: Created container update-demo
Jan 16 10:50:58.045: INFO: At 2023-01-16 10:45:26 +0000 UTC - event for update-demo-nautilus-llkgr: {kubelet nodes-us-east1-b-9h4h} Started: Started container update-demo
Jan 16 10:50:58.045: INFO: At 2023-01-16 10:50:57 +0000 UTC - event for update-demo-nautilus-6g9m5: {kubelet nodes-us-east1-b-wcrf} Killing: Stopping container update-demo
Jan 16 10:50:58.045: INFO: At 2023-01-16 10:50:57 +0000 UTC - event for update-demo-nautilus-llkgr: {kubelet nodes-us-east1-b-9h4h} Killing: Stopping container update-demo
Jan 16 10:50:58.140: INFO: POD                         NODE                   PHASE    GRACE  CONDITIONS
Jan 16 10:50:58.140: INFO: update-demo-nautilus-6g9m5  nodes-us-east1-b-wcrf  Running  30s    [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-16 10:45:19 +0000 UTC  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-01-16 10:45:24 +0000 UTC  } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-01-16 10:45:24 +0000 UTC  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-16 10:45:19 +0000 UTC  }]
Jan 16 10:50:58.140: INFO: update-demo-nautilus-llkgr  nodes-us-east1-b-9h4h  Running  30s    [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-16 10:45:19 +0000 UTC  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-01-16 10:45:26 +0000 UTC  } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-01-16 10:45:26 +0000 UTC  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-16 10:45:19 +0000 UTC  }]
Jan 16 10:50:58.140: INFO: 
Jan 16 10:50:59.026: INFO: 
Logging node info for node control-plane-us-east1-b-nc4v
Jan 16 10:50:59.087: INFO: Node Info: &Node{ObjectMeta:{control-plane-us-east1-b-nc4v    3e043433-4a0a-4797-aed2-d532c70362c4 31161 0 2023-01-16 10:33:51 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-standard-2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:control-plane-us-east1-b-nc4v kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node-role.kubernetes.io/node: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:e2-standard-2 topology.gke.io/zone:us-east1-b topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/control-plane-us-east1-b-nc4v"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.4/32 projectcalico.org/IPv4IPIPTunnelAddr:100.126.126.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-16 10:33:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-16 10:34:31 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:34:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {calico-node Update v1 2023-01-16 10:34:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-16 10:34:51 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:34:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:34:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-16 10:50:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/control-plane-us-east1-b-nc4v,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8332767232 0} {<nil>} 8137468Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8227909632 0} {<nil>} 8035068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:34:56 +0000 UTC,LastTransitionTime:2023-01-16 10:34:56 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 10:50:22 +0000 UTC,LastTransitionTime:2023-01-16 10:33:51 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 10:50:22 +0000 UTC,LastTransitionTime:2023-01-16 10:33:51 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 10:50:22 +0000 UTC,LastTransitionTime:2023-01-16 10:33:51 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 10:50:22 +0000 UTC,LastTransitionTime:2023-01-16 10:34:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.4,},NodeAddress{Type:ExternalIP,Address:35.243.145.107,},NodeAddress{Type:Hostname,Address:control-plane-us-east1-b-nc4v,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e5ac4d7bf983c1b4a0fb9c7211b86ad9,SystemUUID:e5ac4d7b-f983-c1b4-a0fb-9c7211b86ad9,BootID:66119c47-44e2-4c4c-ac93-902592bb3d86,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.0],SizeBytes:135162323,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.0],SizeBytes:124991801,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.0],SizeBytes:57657656,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43637878,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42802014,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:2b6acd7f677f76ffe12ecf3ea7df92eb9b1bdb07336d1ac2a54c7631fb753f7e docker.io/calico/kube-controllers:v3.24.5],SizeBytes:31137169,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2 registry.k8s.io/sig-storage/csi-provisioner:v2.1.0],SizeBytes:21205045,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:50c3cfd458fc8e0bf3c8c521eac39172009382fc66dc5044a330d137c6ed0b09 registry.k8s.io/sig-storage/csi-attacher:v3.1.0],SizeBytes:20103959,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a registry.k8s.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:9af9bf28430b00a0cedeb2ec29acadce45e6afcecd8bdf31c793c624cfa75fa7 registry.k8s.io/sig-storage/csi-snapshotter:v3.0.3],SizeBytes:19500777,},ContainerImage{Names:[docker.io/k8scloudprovidergcp/cloud-controller-manager@sha256:881fd1095937638040723973ade90e6700f1c831a78fb585a3227c4d021b0df9 docker.io/k8scloudprovidergcp/cloud-controller-manager:latest],SizeBytes:18702875,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4967322,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 16 10:50:59.087: INFO: 
Logging kubelet events for node control-plane-us-east1-b-nc4v
Jan 16 10:50:59.181: INFO: 
Logging pods the kubelet thinks is on node control-plane-us-east1-b-nc4v
Jan 16 10:50:59.254: INFO: kube-proxy-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:50:59.254: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 10:50:59.254: INFO: calico-node-5jgkc started at 2023-01-16 10:34:24 +0000 UTC (3+1 container statuses recorded)
Jan 16 10:50:59.254: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 10:50:59.254: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 10:50:59.254: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 10:50:59.254: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 10:50:59.254: INFO: cloud-controller-manager-b5qds started at 2023-01-16 10:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:50:59.254: INFO: 	Container cloud-controller-manager ready: true, restart count 0
Jan 16 10:50:59.254: INFO: calico-kube-controllers-55f488656-hcbkw started at 2023-01-16 10:34:50 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:50:59.254: INFO: 	Container calico-kube-controllers ready: true, restart count 0
Jan 16 10:50:59.254: INFO: kube-controller-manager-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:50:59.254: INFO: 	Container kube-controller-manager ready: true, restart count 2
Jan 16 10:50:59.254: INFO: etcd-manager-events-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:50:59.254: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 16 10:50:59.254: INFO: etcd-manager-main-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:50:59.254: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 16 10:50:59.254: INFO: kube-apiserver-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+2 container statuses recorded)
Jan 16 10:50:59.254: INFO: 	Container healthcheck ready: true, restart count 0
Jan 16 10:50:59.254: INFO: 	Container kube-apiserver ready: true, restart count 1
Jan 16 10:50:59.254: INFO: csi-gce-pd-node-kz9xf started at 2023-01-16 10:34:14 +0000 UTC (0+2 container statuses recorded)
Jan 16 10:50:59.254: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 10:50:59.254: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 10:50:59.254: INFO: dns-controller-6d5f4bf5d6-kqf4d started at 2023-01-16 10:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:50:59.254: INFO: 	Container dns-controller ready: true, restart count 0
Jan 16 10:50:59.254: INFO: csi-gce-pd-controller-78fc966fff-m86hh started at 2023-01-16 10:34:31 +0000 UTC (0+5 container statuses recorded)
Jan 16 10:50:59.254: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 16 10:50:59.254: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 16 10:50:59.254: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 16 10:50:59.254: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 16 10:50:59.254: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 10:50:59.254: INFO: kops-controller-smdjr started at 2023-01-16 10:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:50:59.254: INFO: 	Container kops-controller ready: true, restart count 0
Jan 16 10:50:59.254: INFO: kube-scheduler-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:50:59.254: INFO: 	Container kube-scheduler ready: true, restart count 0
Jan 16 10:50:59.758: INFO: 
Latency metrics for node control-plane-us-east1-b-nc4v
Jan 16 10:50:59.758: INFO: 
Logging node info for node nodes-us-east1-b-2xs4
Jan 16 10:50:59.813: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east1-b-2xs4    5523b1af-a125-4437-baf4-a87ff6e2a424 25128 0 2023-01-16 10:35:00 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east1-b-2xs4 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east1-b topology.hostpath.csi/node:nodes-us-east1-b-2xs4 topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/nodes-us-east1-b-2xs4"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.6/32 projectcalico.org/IPv4IPIPTunnelAddr:100.123.6.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2023-01-16 10:35:00 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2023-01-16 10:35:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-16 10:35:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {calico-node Update v1 2023-01-16 10:35:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-16 10:47:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/nodes-us-east1-b-2xs4,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:35:32 +0000 UTC,LastTransitionTime:2023-01-16 10:35:32 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 10:47:26 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 10:47:26 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 10:47:26 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 10:47:26 +0000 UTC,LastTransitionTime:2023-01-16 10:35:20 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.6,},NodeAddress{Type:ExternalIP,Address:35.196.42.74,},NodeAddress{Type:Hostname,Address:nodes-us-east1-b-2xs4,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:39f2b9ba1d525f08f837cadb4248f14d,SystemUUID:39f2b9ba-1d52-5f08-f837-cadb4248f14d,BootID:7acec4fd-f02a-4704-a113-25a81be183ce,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 16 10:50:59.813: INFO: 
Logging kubelet events for node nodes-us-east1-b-2xs4
Jan 16 10:50:59.875: INFO: 
Logging pods the kubelet thinks is on node nodes-us-east1-b-2xs4
Jan 16 10:50:59.991: INFO: kube-proxy-nodes-us-east1-b-2xs4 started at 2023-01-16 10:34:50 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:50:59.991: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 10:50:59.991: INFO: csi-gce-pd-node-jc8jn started at 2023-01-16 10:35:10 +0000 UTC (0+2 container statuses recorded)
Jan 16 10:50:59.991: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 10:50:59.991: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 10:50:59.991: INFO: calico-node-qlnmx started at 2023-01-16 10:35:10 +0000 UTC (3+1 container statuses recorded)
Jan 16 10:50:59.991: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 10:50:59.991: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 10:50:59.991: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 10:50:59.991: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 10:50:59.991: INFO: dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1 started at 2023-01-16 10:43:45 +0000 UTC (0+3 container statuses recorded)
Jan 16 10:50:59.991: INFO: 	Container jessie-querier ready: true, restart count 0
Jan 16 10:50:59.991: INFO: 	Container querier ready: true, restart count 0
Jan 16 10:50:59.991: INFO: 	Container webserver ready: true, restart count 0
Jan 16 10:50:59.991: INFO: webserver-7f5969cbc7-pjclp started at 2023-01-16 10:50:46 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:50:59.991: INFO: 	Container httpd ready: true, restart count 0
Jan 16 10:50:59.991: INFO: webserver-7f5969cbc7-zlnz9 started at 2023-01-16 10:50:30 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:50:59.991: INFO: 	Container httpd ready: true, restart count 0
Jan 16 10:50:59.991: INFO: agnhost started at 2023-01-16 10:46:16 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:50:59.991: INFO: 	Container agnhost ready: true, restart count 0
Jan 16 10:50:59.991: INFO: liveness-29020903-3c58-4a32-91fa-c5fe091750aa started at 2023-01-16 10:50:10 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:50:59.991: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 16 10:50:59.991: INFO: sample-crd-conversion-webhook-deployment-74ff66dd47-rn7tn started at 2023-01-16 10:49:44 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:50:59.991: INFO: 	Container sample-crd-conversion-webhook ready: true, restart count 0
Jan 16 10:50:59.991: INFO: ss2-1 started at 2023-01-16 10:50:57 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:50:59.991: INFO: 	Container webserver ready: true, restart count 0
Jan 16 10:50:59.991: INFO: dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf started at 2023-01-16 10:41:08 +0000 UTC (0+3 container statuses recorded)
Jan 16 10:50:59.991: INFO: 	Container jessie-querier ready: true, restart count 0
Jan 16 10:50:59.991: INFO: 	Container querier ready: true, restart count 0
Jan 16 10:50:59.991: INFO: 	Container webserver ready: true, restart count 0
Jan 16 10:51:00.401: INFO: 
Latency metrics for node nodes-us-east1-b-2xs4
Jan 16 10:51:00.401: INFO: 
Logging node info for node nodes-us-east1-b-9h4h
Jan 16 10:51:00.535: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east1-b-9h4h    672ac3b7-ea1d-4e3e-bd88-42fa1b6384a8 32249 0 2023-01-16 10:34:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east1-b-9h4h kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east1-b topology.hostpath.csi/node:nodes-us-east1-b-9h4h topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-6300":"nodes-us-east1-b-9h4h","pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/nodes-us-east1-b-9h4h"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.5/32 projectcalico.org/IPv4IPIPTunnelAddr:100.103.14.192 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-16 10:34:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:34:59 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-16 10:34:59 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:35:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {calico-node Update v1 2023-01-16 10:35:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-16 10:50:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/nodes-us-east1-b-9h4h,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:35:24 +0000 UTC,LastTransitionTime:2023-01-16 10:35:24 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 10:48:04 +0000 UTC,LastTransitionTime:2023-01-16 10:34:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 10:48:04 +0000 UTC,LastTransitionTime:2023-01-16 10:34:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 10:48:04 +0000 UTC,LastTransitionTime:2023-01-16 10:34:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 10:48:04 +0000 UTC,LastTransitionTime:2023-01-16 10:35:13 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.5,},NodeAddress{Type:ExternalIP,Address:35.196.180.243,},NodeAddress{Type:Hostname,Address:nodes-us-east1-b-9h4h,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:828dcdb67e74b8a327b01dc0797be5e1,SystemUUID:828dcdb6-7e74-b8a3-27b0-1dc0797be5e1,BootID:dd05deb0-ef00-47e1-83af-c902277fe4b7,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 16 10:51:00.536: INFO: 
Logging kubelet events for node nodes-us-east1-b-9h4h
Jan 16 10:51:00.607: INFO: 
Logging pods the kubelet thinks is on node nodes-us-east1-b-9h4h
Jan 16 10:51:00.844: INFO: csi-gce-pd-node-ncgj4 started at 2023-01-16 10:35:01 +0000 UTC (0+2 container statuses recorded)
Jan 16 10:51:00.844: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 10:51:00.844: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 10:51:00.844: INFO: calico-node-gmwsc started at 2023-01-16 10:35:01 +0000 UTC (3+1 container statuses recorded)
Jan 16 10:51:00.844: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 10:51:00.844: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 10:51:00.844: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 10:51:00.844: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 10:51:00.844: INFO: coredns-autoscaler-7cb5c5b969-mpv8x started at 2023-01-16 10:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:00.844: INFO: 	Container autoscaler ready: true, restart count 0
Jan 16 10:51:00.844: INFO: update-demo-nautilus-llkgr started at 2023-01-16 10:45:19 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:00.844: INFO: 	Container update-demo ready: true, restart count 0
Jan 16 10:51:00.844: INFO: webserver-7f5969cbc7-md4kx started at 2023-01-16 10:50:46 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:00.844: INFO: 	Container httpd ready: false, restart count 0
Jan 16 10:51:00.844: INFO: csi-hostpathplugin-0 started at 2023-01-16 10:50:40 +0000 UTC (0+7 container statuses recorded)
Jan 16 10:51:00.844: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 16 10:51:00.844: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 16 10:51:00.844: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 16 10:51:00.844: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 16 10:51:00.844: INFO: 	Container hostpath ready: true, restart count 0
Jan 16 10:51:00.844: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 16 10:51:00.844: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 16 10:51:00.844: INFO: coredns-7bc44848df-zs55k started at 2023-01-16 10:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:00.844: INFO: 	Container coredns ready: true, restart count 0
Jan 16 10:51:00.844: INFO: dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94 started at 2023-01-16 10:49:18 +0000 UTC (0+3 container statuses recorded)
Jan 16 10:51:00.844: INFO: 	Container jessie-querier ready: true, restart count 0
Jan 16 10:51:00.844: INFO: 	Container querier ready: true, restart count 0
Jan 16 10:51:00.844: INFO: 	Container webserver ready: true, restart count 0
Jan 16 10:51:00.844: INFO: ss2-0 started at 2023-01-16 10:50:42 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:00.844: INFO: 	Container webserver ready: true, restart count 0
Jan 16 10:51:00.844: INFO: inline-volume-tester-4xdb4 started at 2023-01-16 10:50:40 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:00.844: INFO: 	Container csi-volume-tester ready: false, restart count 0
Jan 16 10:51:00.844: INFO: kube-proxy-nodes-us-east1-b-9h4h started at 2023-01-16 10:34:55 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:00.844: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 10:51:00.844: INFO: ss2-0 started at 2023-01-16 10:50:21 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:00.844: INFO: 	Container webserver ready: true, restart count 0
Jan 16 10:51:00.844: INFO: dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74 started at 2023-01-16 10:49:57 +0000 UTC (0+3 container statuses recorded)
Jan 16 10:51:00.844: INFO: 	Container jessie-querier ready: true, restart count 1
Jan 16 10:51:00.844: INFO: 	Container querier ready: true, restart count 1
Jan 16 10:51:00.844: INFO: 	Container webserver ready: true, restart count 0
Jan 16 10:51:06.095: INFO: 
Latency metrics for node nodes-us-east1-b-9h4h
Jan 16 10:51:06.095: INFO: 
Logging node info for node nodes-us-east1-b-rn9p
Jan 16 10:51:06.206: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east1-b-rn9p    59f4f25d-24bf-4d96-a4bf-2cf266b5c083 31091 0 2023-01-16 10:34:59 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east1-b-rn9p kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east1-b topology.hostpath.csi/node:nodes-us-east1-b-rn9p topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/nodes-us-east1-b-rn9p"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.3/32 projectcalico.org/IPv4IPIPTunnelAddr:100.98.60.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-16 10:34:59 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:00 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-16 10:35:01 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {calico-node Update v1 2023-01-16 10:35:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-16 10:50:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/nodes-us-east1-b-rn9p,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:35:26 +0000 UTC,LastTransitionTime:2023-01-16 10:35:26 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 10:48:25 +0000 UTC,LastTransitionTime:2023-01-16 10:34:59 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 10:48:25 +0000 UTC,LastTransitionTime:2023-01-16 10:34:59 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 10:48:25 +0000 UTC,LastTransitionTime:2023-01-16 10:34:59 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 10:48:25 +0000 UTC,LastTransitionTime:2023-01-16 10:35:14 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.3,},NodeAddress{Type:ExternalIP,Address:34.75.49.181,},NodeAddress{Type:Hostname,Address:nodes-us-east1-b-rn9p,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:9f39c983773df4ca6a15315227d6fd51,SystemUUID:9f39c983-773d-f4ca-6a15-315227d6fd51,BootID:7e9ad329-1a6b-4405-ba71-ca92e45658b3,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:c0ddb4794bc8a3631e3373015f913c00b230ee54f87bde9ade195b3a3415c60f registry.k8s.io/build-image/distroless-iptables:v0.1.2],SizeBytes:7685585,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 16 10:51:06.206: INFO: 
Logging kubelet events for node nodes-us-east1-b-rn9p
Jan 16 10:51:06.250: INFO: 
Logging pods the kubelet thinks is on node nodes-us-east1-b-rn9p
Jan 16 10:51:06.341: INFO: kube-proxy-nodes-us-east1-b-rn9p started at 2023-01-16 10:34:56 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:06.341: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 10:51:06.341: INFO: webserver-7f5969cbc7-nzgww started at 2023-01-16 10:50:30 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:06.341: INFO: 	Container httpd ready: true, restart count 0
Jan 16 10:51:06.341: INFO: privileged-pod started at 2023-01-16 10:50:49 +0000 UTC (0+2 container statuses recorded)
Jan 16 10:51:06.341: INFO: 	Container not-privileged-container ready: true, restart count 0
Jan 16 10:51:06.341: INFO: 	Container privileged-container ready: true, restart count 0
Jan 16 10:51:06.341: INFO: webserver-9575cd774-2gjng started at 2023-01-16 10:51:05 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:06.341: INFO: 	Container httpd ready: false, restart count 0
Jan 16 10:51:06.341: INFO: webserver-7f5969cbc7-656bj started at 2023-01-16 10:50:46 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:06.341: INFO: 	Container httpd ready: true, restart count 0
Jan 16 10:51:06.341: INFO: pod-configmaps-78df8d8c-c9ac-4cd6-b8bf-6ec773acae1d started at 2023-01-16 10:50:53 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:06.341: INFO: 	Container agnhost-container ready: false, restart count 0
Jan 16 10:51:06.341: INFO: test-ss-0 started at 2023-01-16 10:50:56 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:06.341: INFO: 	Container webserver ready: true, restart count 0
Jan 16 10:51:06.341: INFO: successful-jobs-history-limit-27897771-87642 started at 2023-01-16 10:51:00 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:06.341: INFO: 	Container c ready: false, restart count 0
Jan 16 10:51:06.341: INFO: calico-node-ntgj5 started at 2023-01-16 10:35:03 +0000 UTC (3+1 container statuses recorded)
Jan 16 10:51:06.341: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 10:51:06.341: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 10:51:06.341: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 10:51:06.341: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 10:51:06.341: INFO: csi-gce-pd-node-88f4v started at 2023-01-16 10:35:03 +0000 UTC (0+2 container statuses recorded)
Jan 16 10:51:06.341: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 10:51:06.341: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 10:51:06.341: INFO: ss2-1 started at 2023-01-16 10:50:51 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:06.341: INFO: 	Container webserver ready: true, restart count 0
Jan 16 10:51:06.341: INFO: downwardapi-volume-0f300999-7b8b-4be5-ace0-52ee16acaa72 started at 2023-01-16 10:51:03 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:06.341: INFO: 	Container client-container ready: false, restart count 0
Jan 16 10:51:06.341: INFO: ss2-2 started at 2023-01-16 10:50:44 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:06.341: INFO: 	Container webserver ready: true, restart count 0
Jan 16 10:51:07.447: INFO: 
Latency metrics for node nodes-us-east1-b-rn9p
Jan 16 10:51:07.447: INFO: 
Logging node info for node nodes-us-east1-b-wcrf
Jan 16 10:51:07.484: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east1-b-wcrf    509e8852-b60d-4ccc-864a-4efd7f571608 32820 0 2023-01-16 10:35:00 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east1-b-wcrf kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east1-b topology.hostpath.csi/node:nodes-us-east1-b-wcrf topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-volume-expand-6126":"nodes-us-east1-b-wcrf","pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/nodes-us-east1-b-wcrf"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.2/32 projectcalico.org/IPv4IPIPTunnelAddr:100.110.242.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-16 10:35:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:01 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-16 10:35:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {calico-node Update v1 2023-01-16 10:35:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-16 10:51:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {kube-controller-manager Update v1 2023-01-16 10:51:06 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/nodes-us-east1-b-wcrf,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:35:27 +0000 UTC,LastTransitionTime:2023-01-16 10:35:27 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 10:50:31 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 10:50:31 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 10:50:31 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 10:50:31 +0000 UTC,LastTransitionTime:2023-01-16 10:35:15 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.2,},NodeAddress{Type:ExternalIP,Address:35.237.110.203,},NodeAddress{Type:Hostname,Address:nodes-us-east1-b-wcrf,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:90256d4292845f855978b781ab31ded0,SystemUUID:90256d42-9284-5f85-5978-b781ab31ded0,BootID:b6764560-f26d-4d17-83ba-c17bdd70bced,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-volume-expand-6126^acf06ee7-958b-11ed-8f85-aa136efeb01c,DevicePath:,},},Config:nil,},}
Jan 16 10:51:07.484: INFO: 
Logging kubelet events for node nodes-us-east1-b-wcrf
Jan 16 10:51:07.541: INFO: 
Logging pods the kubelet thinks is on node nodes-us-east1-b-wcrf
Jan 16 10:51:07.672: INFO: webserver-9575cd774-4l6mn started at 2023-01-16 10:51:05 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:07.672: INFO: 	Container httpd ready: false, restart count 0
Jan 16 10:51:07.672: INFO: calico-node-tvbl7 started at 2023-01-16 10:35:01 +0000 UTC (3+1 container statuses recorded)
Jan 16 10:51:07.672: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 10:51:07.672: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 10:51:07.672: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 10:51:07.672: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 10:51:07.672: INFO: webserver-7f5969cbc7-v8gh4 started at 2023-01-16 10:50:46 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:07.672: INFO: 	Container httpd ready: true, restart count 0
Jan 16 10:51:07.672: INFO: csi-hostpathplugin-0 started at 2023-01-16 10:51:01 +0000 UTC (0+7 container statuses recorded)
Jan 16 10:51:07.672: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 16 10:51:07.672: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 16 10:51:07.672: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 16 10:51:07.672: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 16 10:51:07.672: INFO: 	Container hostpath ready: true, restart count 0
Jan 16 10:51:07.672: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 16 10:51:07.672: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 16 10:51:07.672: INFO: pod-c5a510e7-5467-4930-9ac5-fb694f209456 started at 2023-01-16 10:51:05 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:07.672: INFO: 	Container write-pod ready: false, restart count 0
Jan 16 10:51:07.672: INFO: kube-proxy-nodes-us-east1-b-wcrf started at 2023-01-16 10:34:57 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:07.672: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 10:51:07.672: INFO: pod-subpath-test-configmap-9kzs started at 2023-01-16 10:49:56 +0000 UTC (1+2 container statuses recorded)
Jan 16 10:51:07.672: INFO: 	Init container init-volume-configmap-9kzs ready: true, restart count 0
Jan 16 10:51:07.672: INFO: 	Container test-container-subpath-configmap-9kzs ready: true, restart count 3
Jan 16 10:51:07.672: INFO: 	Container test-container-volume-configmap-9kzs ready: true, restart count 0
Jan 16 10:51:07.672: INFO: successful-jobs-history-limit-27897770-qnr6s started at 2023-01-16 10:50:00 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:07.672: INFO: 	Container c ready: false, restart count 0
Jan 16 10:51:07.672: INFO: coredns-7bc44848df-rn2pc started at 2023-01-16 10:35:31 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:07.672: INFO: 	Container coredns ready: true, restart count 0
Jan 16 10:51:07.673: INFO: pod-failure-failjob-fp8dh started at 2023-01-16 10:50:56 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:07.673: INFO: 	Container c ready: false, restart count 0
Jan 16 10:51:07.673: INFO: csi-gce-pd-node-v2gwp started at 2023-01-16 10:35:01 +0000 UTC (0+2 container statuses recorded)
Jan 16 10:51:07.673: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 10:51:07.673: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 10:51:07.673: INFO: pod-ephm-test-configmap-qpm4 started at 2023-01-16 10:49:49 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:07.673: INFO: 	Container test-container-subpath-configmap-qpm4 ready: false, restart count 0
Jan 16 10:51:07.673: INFO: agnhost-primary-87tt6 started at 2023-01-16 10:50:49 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:51:07.673: INFO: 	Container agnhost-primary ready: true, restart count 0
Jan 16 10:51:07.989: INFO: 
Latency metrics for node nodes-us-east1-b-wcrf
[DeferCleanup (Each)] [sig-cli] Kubectl client
  tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "kubectl-4248" for this suite. �[38;5;243m01/16/23 10:51:07.989�[0m

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-network] DNS should provide DNS for ExternalName services [Conformance] 12m56s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-network\]\sDNS\sshould\sprovide\sDNS\sfor\sExternalName\sservices\s\[Conformance\]$'

test/e2e/network/dns_common.go:455
k8s.io/kubernetes/test/e2e/network.assertFilesContain({0xc004c0f080?, 0x2?, 0x2?}, {0x75bfff4?, 0x7?}, 0xc0016bc900?, {0x801e128?, 0xc00257e820?}, 0x1?, {0x75e701b, ...})
	test/e2e/network/dns_common.go:455 +0x1dc
k8s.io/kubernetes/test/e2e/network.validateTargetedProbeOutput(0xc00100be00, 0xc0016bc900, {0xc004c0f080, 0x2, 0x2}, {0x75e701b, 0x10})
	test/e2e/network/dns_common.go:540 +0x469
k8s.io/kubernetes/test/e2e/network.glob..func2.9()
	test/e2e/network/dns.go:356 +0x545
				[BeforeEach] [sig-network] DNS
  set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/16/23 10:49:56.747�[0m
Jan 16 10:49:56.747: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename dns �[38;5;243m01/16/23 10:49:56.748�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/16/23 10:49:56.873�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/16/23 10:49:56.939�[0m
[BeforeEach] [sig-network] DNS
  test/e2e/framework/metrics/init/init.go:31
[It] should provide DNS for ExternalName services [Conformance]
  test/e2e/network/dns.go:333
�[1mSTEP:�[0m Creating a test externalName service �[38;5;243m01/16/23 10:49:57.007�[0m
�[1mSTEP:�[0m Running these commands on wheezy: for i in `seq 1 30`; do dig +short dns-test-service-3.dns-8824.svc.cluster.local CNAME > /results/wheezy_udp@dns-test-service-3.dns-8824.svc.cluster.local; sleep 1; done
 �[38;5;243m01/16/23 10:49:57.044�[0m
�[1mSTEP:�[0m Running these commands on jessie: for i in `seq 1 30`; do dig +short dns-test-service-3.dns-8824.svc.cluster.local CNAME > /results/jessie_udp@dns-test-service-3.dns-8824.svc.cluster.local; sleep 1; done
 �[38;5;243m01/16/23 10:49:57.044�[0m
�[1mSTEP:�[0m creating a pod to probe DNS �[38;5;243m01/16/23 10:49:57.044�[0m
�[1mSTEP:�[0m submitting the pod to kubernetes �[38;5;243m01/16/23 10:49:57.044�[0m
Jan 16 10:49:57.100: INFO: Waiting up to 15m0s for pod "dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74" in namespace "dns-8824" to be "running"
Jan 16 10:49:57.136: INFO: Pod "dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74": Phase="Pending", Reason="", readiness=false. Elapsed: 36.520154ms
Jan 16 10:49:59.179: INFO: Pod "dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74": Phase="Pending", Reason="", readiness=false. Elapsed: 2.079741607s
Jan 16 10:50:01.194: INFO: Pod "dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74": Phase="Running", Reason="", readiness=true. Elapsed: 4.094032588s
Jan 16 10:50:01.194: INFO: Pod "dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74" satisfied condition "running"
�[1mSTEP:�[0m retrieving the pod �[38;5;243m01/16/23 10:50:01.194�[0m
�[1mSTEP:�[0m looking for the results for each expected name from probers �[38;5;243m01/16/23 10:50:01.24�[0m
Jan 16 10:50:31.277: INFO: Unable to read wheezy_udp@dns-test-service-3.dns-8824.svc.cluster.local from pod dns-8824/dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74: the server is currently unable to handle the request (get pods dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74)
Jan 16 10:51:01.314: INFO: Unable to read jessie_udp@dns-test-service-3.dns-8824.svc.cluster.local from pod dns-8824/dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74: the server is currently unable to handle the request (get pods dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74)
Jan 16 10:51:01.314: INFO: Lookups using dns-8824/dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74 failed for: [wheezy_udp@dns-test-service-3.dns-8824.svc.cluster.local jessie_udp@dns-test-service-3.dns-8824.svc.cluster.local]

Jan 16 10:51:36.351: INFO: Unable to read wheezy_udp@dns-test-service-3.dns-8824.svc.cluster.local from pod dns-8824/dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74: the server is currently unable to handle the request (get pods dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74)
Jan 16 10:52:06.406: INFO: Unable to read jessie_udp@dns-test-service-3.dns-8824.svc.cluster.local from pod dns-8824/dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74: the server is currently unable to handle the request (get pods dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74)
Jan 16 10:52:06.406: INFO: Lookups using dns-8824/dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74 failed for: [wheezy_udp@dns-test-service-3.dns-8824.svc.cluster.local jessie_udp@dns-test-service-3.dns-8824.svc.cluster.local]

Jan 16 10:52:41.358: INFO: Unable to read wheezy_udp@dns-test-service-3.dns-8824.svc.cluster.local from pod dns-8824/dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74: the server is currently unable to handle the request (get pods dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74)
Jan 16 10:53:11.403: INFO: Unable to read jessie_udp@dns-test-service-3.dns-8824.svc.cluster.local from pod dns-8824/dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74: the server is currently unable to handle the request (get pods dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74)
Jan 16 10:53:11.403: INFO: Lookups using dns-8824/dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74 failed for: [wheezy_udp@dns-test-service-3.dns-8824.svc.cluster.local jessie_udp@dns-test-service-3.dns-8824.svc.cluster.local]

Jan 16 10:53:46.353: INFO: Unable to read wheezy_udp@dns-test-service-3.dns-8824.svc.cluster.local from pod dns-8824/dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74: the server is currently unable to handle the request (get pods dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74)
Jan 16 10:54:16.390: INFO: Unable to read jessie_udp@dns-test-service-3.dns-8824.svc.cluster.local from pod dns-8824/dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74: the server is currently unable to handle the request (get pods dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74)
Jan 16 10:54:16.390: INFO: Lookups using dns-8824/dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74 failed for: [wheezy_udp@dns-test-service-3.dns-8824.svc.cluster.local jessie_udp@dns-test-service-3.dns-8824.svc.cluster.local]

Jan 16 10:54:51.350: INFO: Unable to read wheezy_udp@dns-test-service-3.dns-8824.svc.cluster.local from pod dns-8824/dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74: the server is currently unable to handle the request (get pods dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74)
Jan 16 10:55:21.397: INFO: Unable to read jessie_udp@dns-test-service-3.dns-8824.svc.cluster.local from pod dns-8824/dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74: the server is currently unable to handle the request (get pods dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74)
Jan 16 10:55:21.397: INFO: Lookups using dns-8824/dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74 failed for: [wheezy_udp@dns-test-service-3.dns-8824.svc.cluster.local jessie_udp@dns-test-service-3.dns-8824.svc.cluster.local]

Jan 16 10:55:56.351: INFO: Unable to read wheezy_udp@dns-test-service-3.dns-8824.svc.cluster.local from pod dns-8824/dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74: the server is currently unable to handle the request (get pods dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74)
Jan 16 10:56:26.388: INFO: Unable to read jessie_udp@dns-test-service-3.dns-8824.svc.cluster.local from pod dns-8824/dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74: the server is currently unable to handle the request (get pods dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74)
Jan 16 10:56:26.388: INFO: Lookups using dns-8824/dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74 failed for: [wheezy_udp@dns-test-service-3.dns-8824.svc.cluster.local jessie_udp@dns-test-service-3.dns-8824.svc.cluster.local]

Jan 16 10:57:01.353: INFO: Unable to read wheezy_udp@dns-test-service-3.dns-8824.svc.cluster.local from pod dns-8824/dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74: the server is currently unable to handle the request (get pods dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74)
Jan 16 10:57:31.399: INFO: Unable to read jessie_udp@dns-test-service-3.dns-8824.svc.cluster.local from pod dns-8824/dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74: the server is currently unable to handle the request (get pods dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74)
Jan 16 10:57:31.399: INFO: Lookups using dns-8824/dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74 failed for: [wheezy_udp@dns-test-service-3.dns-8824.svc.cluster.local jessie_udp@dns-test-service-3.dns-8824.svc.cluster.local]

Jan 16 10:58:06.394: INFO: Unable to read wheezy_udp@dns-test-service-3.dns-8824.svc.cluster.local from pod dns-8824/dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74: the server is currently unable to handle the request (get pods dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74)
Jan 16 10:58:36.430: INFO: Unable to read jessie_udp@dns-test-service-3.dns-8824.svc.cluster.local from pod dns-8824/dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74: the server is currently unable to handle the request (get pods dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74)
Jan 16 10:58:36.430: INFO: Lookups using dns-8824/dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74 failed for: [wheezy_udp@dns-test-service-3.dns-8824.svc.cluster.local jessie_udp@dns-test-service-3.dns-8824.svc.cluster.local]

Jan 16 10:59:11.350: INFO: Unable to read wheezy_udp@dns-test-service-3.dns-8824.svc.cluster.local from pod dns-8824/dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74: the server is currently unable to handle the request (get pods dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74)
Jan 16 10:59:41.387: INFO: Unable to read jessie_udp@dns-test-service-3.dns-8824.svc.cluster.local from pod dns-8824/dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74: the server is currently unable to handle the request (get pods dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74)
Jan 16 10:59:41.387: INFO: Lookups using dns-8824/dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74 failed for: [wheezy_udp@dns-test-service-3.dns-8824.svc.cluster.local jessie_udp@dns-test-service-3.dns-8824.svc.cluster.local]

Jan 16 11:00:16.355: INFO: Unable to read wheezy_udp@dns-test-service-3.dns-8824.svc.cluster.local from pod dns-8824/dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74: the server is currently unable to handle the request (get pods dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74)
Jan 16 11:00:46.390: INFO: Unable to read jessie_udp@dns-test-service-3.dns-8824.svc.cluster.local from pod dns-8824/dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74: the server is currently unable to handle the request (get pods dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74)
Jan 16 11:00:46.390: INFO: Lookups using dns-8824/dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74 failed for: [wheezy_udp@dns-test-service-3.dns-8824.svc.cluster.local jessie_udp@dns-test-service-3.dns-8824.svc.cluster.local]

Jan 16 11:01:21.350: INFO: Unable to read wheezy_udp@dns-test-service-3.dns-8824.svc.cluster.local from pod dns-8824/dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74: the server is currently unable to handle the request (get pods dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74)
Jan 16 11:01:51.385: INFO: Unable to read jessie_udp@dns-test-service-3.dns-8824.svc.cluster.local from pod dns-8824/dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74: the server is currently unable to handle the request (get pods dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74)
Jan 16 11:01:51.385: INFO: Lookups using dns-8824/dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74 failed for: [wheezy_udp@dns-test-service-3.dns-8824.svc.cluster.local jessie_udp@dns-test-service-3.dns-8824.svc.cluster.local]

Jan 16 11:02:21.419: INFO: Unable to read wheezy_udp@dns-test-service-3.dns-8824.svc.cluster.local from pod dns-8824/dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74: the server is currently unable to handle the request (get pods dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74)
Jan 16 11:02:51.454: INFO: Unable to read jessie_udp@dns-test-service-3.dns-8824.svc.cluster.local from pod dns-8824/dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74: the server is currently unable to handle the request (get pods dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74)
Jan 16 11:02:51.454: INFO: Lookups using dns-8824/dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74 failed for: [wheezy_udp@dns-test-service-3.dns-8824.svc.cluster.local jessie_udp@dns-test-service-3.dns-8824.svc.cluster.local]

Jan 16 11:02:51.454: INFO: Unexpected error: 
    <*errors.errorString | 0xc00023b9b0>: {
        s: "timed out waiting for the condition",
    }
Jan 16 11:02:51.454: FAIL: timed out waiting for the condition

Full Stack Trace
k8s.io/kubernetes/test/e2e/network.assertFilesContain({0xc004c0f080?, 0x2?, 0x2?}, {0x75bfff4?, 0x7?}, 0xc0016bc900?, {0x801e128?, 0xc00257e820?}, 0x1?, {0x75e701b, ...})
	test/e2e/network/dns_common.go:455 +0x1dc
k8s.io/kubernetes/test/e2e/network.validateTargetedProbeOutput(0xc00100be00, 0xc0016bc900, {0xc004c0f080, 0x2, 0x2}, {0x75e701b, 0x10})
	test/e2e/network/dns_common.go:540 +0x469
k8s.io/kubernetes/test/e2e/network.glob..func2.9()
	test/e2e/network/dns.go:356 +0x545
�[1mSTEP:�[0m deleting the pod �[38;5;243m01/16/23 11:02:51.455�[0m
�[1mSTEP:�[0m deleting the test externalName service �[38;5;243m01/16/23 11:02:51.509�[0m
[AfterEach] [sig-network] DNS
  test/e2e/framework/node/init/init.go:32
Jan 16 11:02:51.550: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-network] DNS
  test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-network] DNS
  dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/16/23 11:02:51.586�[0m
�[1mSTEP:�[0m Collecting events from namespace "dns-8824". �[38;5;243m01/16/23 11:02:51.587�[0m
�[1mSTEP:�[0m Found 12 events. �[38;5;243m01/16/23 11:02:51.622�[0m
Jan 16 11:02:51.622: INFO: At 2023-01-16 10:49:57 +0000 UTC - event for dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74: {default-scheduler } Scheduled: Successfully assigned dns-8824/dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74 to nodes-us-east1-b-9h4h
Jan 16 11:02:51.622: INFO: At 2023-01-16 10:49:58 +0000 UTC - event for dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74: {kubelet nodes-us-east1-b-9h4h} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine
Jan 16 11:02:51.622: INFO: At 2023-01-16 10:49:58 +0000 UTC - event for dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74: {kubelet nodes-us-east1-b-9h4h} Created: Created container webserver
Jan 16 11:02:51.622: INFO: At 2023-01-16 10:49:59 +0000 UTC - event for dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74: {kubelet nodes-us-east1-b-9h4h} Started: Started container webserver
Jan 16 11:02:51.622: INFO: At 2023-01-16 10:49:59 +0000 UTC - event for dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74: {kubelet nodes-us-east1-b-9h4h} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine
Jan 16 11:02:51.622: INFO: At 2023-01-16 10:49:59 +0000 UTC - event for dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74: {kubelet nodes-us-east1-b-9h4h} Created: Created container querier
Jan 16 11:02:51.622: INFO: At 2023-01-16 10:49:59 +0000 UTC - event for dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74: {kubelet nodes-us-east1-b-9h4h} Started: Started container querier
Jan 16 11:02:51.622: INFO: At 2023-01-16 10:49:59 +0000 UTC - event for dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74: {kubelet nodes-us-east1-b-9h4h} Pulled: Container image "registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7" already present on machine
Jan 16 11:02:51.622: INFO: At 2023-01-16 10:49:59 +0000 UTC - event for dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74: {kubelet nodes-us-east1-b-9h4h} Created: Created container jessie-querier
Jan 16 11:02:51.622: INFO: At 2023-01-16 10:49:59 +0000 UTC - event for dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74: {kubelet nodes-us-east1-b-9h4h} Started: Started container jessie-querier
Jan 16 11:02:51.622: INFO: At 2023-01-16 10:51:14 +0000 UTC - event for dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74: {kubelet nodes-us-east1-b-9h4h} BackOff: Back-off restarting failed container jessie-querier in pod dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74_dns-8824(f7958683-806a-4bf9-8984-f80b86f3ad5f)
Jan 16 11:02:51.622: INFO: At 2023-01-16 10:51:16 +0000 UTC - event for dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74: {kubelet nodes-us-east1-b-9h4h} BackOff: Back-off restarting failed container querier in pod dns-test-7fe3ef67-85a9-4dac-8564-027d2158ba74_dns-8824(f7958683-806a-4bf9-8984-f80b86f3ad5f)
Jan 16 11:02:51.656: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Jan 16 11:02:51.656: INFO: 
Jan 16 11:02:51.694: INFO: 
Logging node info for node control-plane-us-east1-b-nc4v
Jan 16 11:02:51.729: INFO: Node Info: &Node{ObjectMeta:{control-plane-us-east1-b-nc4v    3e043433-4a0a-4797-aed2-d532c70362c4 55531 0 2023-01-16 10:33:51 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-standard-2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:control-plane-us-east1-b-nc4v kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node-role.kubernetes.io/node: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:e2-standard-2 topology.gke.io/zone:us-east1-b topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/control-plane-us-east1-b-nc4v"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.4/32 projectcalico.org/IPv4IPIPTunnelAddr:100.126.126.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-16 10:33:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-16 10:34:31 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:34:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {calico-node Update v1 2023-01-16 10:34:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-16 10:34:51 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:34:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:34:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-16 11:00:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/control-plane-us-east1-b-nc4v,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8332767232 0} {<nil>} 8137468Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8227909632 0} {<nil>} 8035068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:34:56 +0000 UTC,LastTransitionTime:2023-01-16 10:34:56 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 11:00:34 +0000 UTC,LastTransitionTime:2023-01-16 10:33:51 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 11:00:34 +0000 UTC,LastTransitionTime:2023-01-16 10:33:51 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 11:00:34 +0000 UTC,LastTransitionTime:2023-01-16 10:33:51 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 11:00:34 +0000 UTC,LastTransitionTime:2023-01-16 10:34:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.4,},NodeAddress{Type:ExternalIP,Address:35.243.145.107,},NodeAddress{Type:Hostname,Address:control-plane-us-east1-b-nc4v,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e5ac4d7bf983c1b4a0fb9c7211b86ad9,SystemUUID:e5ac4d7b-f983-c1b4-a0fb-9c7211b86ad9,BootID:66119c47-44e2-4c4c-ac93-902592bb3d86,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.0],SizeBytes:135162323,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.0],SizeBytes:124991801,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.0],SizeBytes:57657656,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43637878,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42802014,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:2b6acd7f677f76ffe12ecf3ea7df92eb9b1bdb07336d1ac2a54c7631fb753f7e docker.io/calico/kube-controllers:v3.24.5],SizeBytes:31137169,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2 registry.k8s.io/sig-storage/csi-provisioner:v2.1.0],SizeBytes:21205045,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:50c3cfd458fc8e0bf3c8c521eac39172009382fc66dc5044a330d137c6ed0b09 registry.k8s.io/sig-storage/csi-attacher:v3.1.0],SizeBytes:20103959,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a registry.k8s.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:9af9bf28430b00a0cedeb2ec29acadce45e6afcecd8bdf31c793c624cfa75fa7 registry.k8s.io/sig-storage/csi-snapshotter:v3.0.3],SizeBytes:19500777,},ContainerImage{Names:[docker.io/k8scloudprovidergcp/cloud-controller-manager@sha256:881fd1095937638040723973ade90e6700f1c831a78fb585a3227c4d021b0df9 docker.io/k8scloudprovidergcp/cloud-controller-manager:latest],SizeBytes:18702875,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4967322,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 16 11:02:51.729: INFO: 
Logging kubelet events for node control-plane-us-east1-b-nc4v
Jan 16 11:02:51.767: INFO: 
Logging pods the kubelet thinks is on node control-plane-us-east1-b-nc4v
Jan 16 11:02:51.823: INFO: kube-scheduler-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 11:02:51.823: INFO: 	Container kube-scheduler ready: true, restart count 0
Jan 16 11:02:51.823: INFO: kube-apiserver-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+2 container statuses recorded)
Jan 16 11:02:51.823: INFO: 	Container healthcheck ready: true, restart count 0
Jan 16 11:02:51.823: INFO: 	Container kube-apiserver ready: true, restart count 1
Jan 16 11:02:51.823: INFO: dns-controller-6d5f4bf5d6-kqf4d started at 2023-01-16 10:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 16 11:02:51.823: INFO: 	Container dns-controller ready: true, restart count 0
Jan 16 11:02:51.823: INFO: calico-kube-controllers-55f488656-hcbkw started at 2023-01-16 10:34:50 +0000 UTC (0+1 container statuses recorded)
Jan 16 11:02:51.823: INFO: 	Container calico-kube-controllers ready: true, restart count 0
Jan 16 11:02:51.823: INFO: etcd-manager-events-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 11:02:51.823: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 16 11:02:51.823: INFO: etcd-manager-main-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 11:02:51.823: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 16 11:02:51.823: INFO: csi-gce-pd-node-kz9xf started at 2023-01-16 10:34:14 +0000 UTC (0+2 container statuses recorded)
Jan 16 11:02:51.823: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 11:02:51.823: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 11:02:51.823: INFO: csi-gce-pd-controller-78fc966fff-m86hh started at 2023-01-16 10:34:31 +0000 UTC (0+5 container statuses recorded)
Jan 16 11:02:51.823: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 16 11:02:51.823: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 16 11:02:51.823: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 16 11:02:51.823: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 16 11:02:51.823: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 11:02:51.823: INFO: kops-controller-smdjr started at 2023-01-16 10:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 16 11:02:51.823: INFO: 	Container kops-controller ready: true, restart count 0
Jan 16 11:02:51.823: INFO: kube-controller-manager-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 11:02:51.823: INFO: 	Container kube-controller-manager ready: true, restart count 2
Jan 16 11:02:51.823: INFO: kube-proxy-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 11:02:51.823: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 11:02:51.823: INFO: calico-node-5jgkc started at 2023-01-16 10:34:24 +0000 UTC (3+1 container statuses recorded)
Jan 16 11:02:51.823: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 11:02:51.823: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 11:02:51.823: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 11:02:51.823: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 11:02:51.823: INFO: cloud-controller-manager-b5qds started at 2023-01-16 10:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 16 11:02:51.823: INFO: 	Container cloud-controller-manager ready: true, restart count 0
Jan 16 11:02:52.176: INFO: 
Latency metrics for node control-plane-us-east1-b-nc4v
Jan 16 11:02:52.176: INFO: 
Logging node info for node nodes-us-east1-b-2xs4
Jan 16 11:02:52.211: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east1-b-2xs4    5523b1af-a125-4437-baf4-a87ff6e2a424 55689 0 2023-01-16 10:35:00 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east1-b-2xs4 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east1-b topology.hostpath.csi/node:nodes-us-east1-b-2xs4 topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/nodes-us-east1-b-2xs4"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.6/32 projectcalico.org/IPv4IPIPTunnelAddr:100.123.6.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2023-01-16 10:35:00 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2023-01-16 10:35:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-16 10:35:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {calico-node Update v1 2023-01-16 10:35:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-16 11:01:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/nodes-us-east1-b-2xs4,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:35:32 +0000 UTC,LastTransitionTime:2023-01-16 10:35:32 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 11:01:06 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 11:01:06 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 11:01:06 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 11:01:06 +0000 UTC,LastTransitionTime:2023-01-16 10:35:20 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.6,},NodeAddress{Type:ExternalIP,Address:35.196.42.74,},NodeAddress{Type:Hostname,Address:nodes-us-east1-b-2xs4,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:39f2b9ba1d525f08f837cadb4248f14d,SystemUUID:39f2b9ba-1d52-5f08-f837-cadb4248f14d,BootID:7acec4fd-f02a-4704-a113-25a81be183ce,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 16 11:02:52.211: INFO: 
Logging kubelet events for node nodes-us-east1-b-2xs4
Jan 16 11:02:52.249: INFO: 
Logging pods the kubelet thinks is on node nodes-us-east1-b-2xs4
Jan 16 11:02:52.300: INFO: agnhost started at 2023-01-16 10:46:16 +0000 UTC (0+1 container statuses recorded)
Jan 16 11:02:52.300: INFO: 	Container agnhost ready: true, restart count 0
Jan 16 11:02:52.300: INFO: proxy-service-cgkvp-fj8m5 started at 2023-01-16 10:54:34 +0000 UTC (0+1 container statuses recorded)
Jan 16 11:02:52.300: INFO: 	Container proxy-service-cgkvp ready: true, restart count 0
Jan 16 11:02:52.300: INFO: kube-proxy-nodes-us-east1-b-2xs4 started at 2023-01-16 10:34:50 +0000 UTC (0+1 container statuses recorded)
Jan 16 11:02:52.300: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 11:02:52.300: INFO: csi-gce-pd-node-jc8jn started at 2023-01-16 10:35:10 +0000 UTC (0+2 container statuses recorded)
Jan 16 11:02:52.300: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 11:02:52.300: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 11:02:52.300: INFO: calico-node-qlnmx started at 2023-01-16 10:35:10 +0000 UTC (3+1 container statuses recorded)
Jan 16 11:02:52.300: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 11:02:52.300: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 11:02:52.300: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 11:02:52.300: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 11:02:52.300: INFO: dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1 started at 2023-01-16 10:43:45 +0000 UTC (0+3 container statuses recorded)
Jan 16 11:02:52.300: INFO: 	Container jessie-querier ready: true, restart count 1
Jan 16 11:02:52.300: INFO: 	Container querier ready: true, restart count 1
Jan 16 11:02:52.300: INFO: 	Container webserver ready: true, restart count 0
Jan 16 11:02:52.300: INFO: dns-test-9ac02aeb-ccb8-4dbf-a031-3f8abf3c41bb started at 2023-01-16 10:56:17 +0000 UTC (0+3 container statuses recorded)
Jan 16 11:02:52.300: INFO: 	Container jessie-querier ready: true, restart count 0
Jan 16 11:02:52.300: INFO: 	Container querier ready: true, restart count 0
Jan 16 11:02:52.300: INFO: 	Container webserver ready: true, restart count 0
Jan 16 11:02:52.522: INFO: 
Latency metrics for node nodes-us-east1-b-2xs4
Jan 16 11:02:52.522: INFO: 
Logging node info for node nodes-us-east1-b-9h4h
Jan 16 11:02:52.558: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east1-b-9h4h    672ac3b7-ea1d-4e3e-bd88-42fa1b6384a8 54576 0 2023-01-16 10:34:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east1-b-9h4h kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east1-b topology.hostpath.csi/node:nodes-us-east1-b-9h4h topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/nodes-us-east1-b-9h4h"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.5/32 projectcalico.org/IPv4IPIPTunnelAddr:100.103.14.192 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-16 10:34:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:34:59 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-16 10:34:59 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:35:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {calico-node Update v1 2023-01-16 10:35:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-16 10:59:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/nodes-us-east1-b-9h4h,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:35:24 +0000 UTC,LastTransitionTime:2023-01-16 10:35:24 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 10:59:30 +0000 UTC,LastTransitionTime:2023-01-16 10:34:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 10:59:30 +0000 UTC,LastTransitionTime:2023-01-16 10:34:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 10:59:30 +0000 UTC,LastTransitionTime:2023-01-16 10:34:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 10:59:30 +0000 UTC,LastTransitionTime:2023-01-16 10:35:13 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.5,},NodeAddress{Type:ExternalIP,Address:35.196.180.243,},NodeAddress{Type:Hostname,Address:nodes-us-east1-b-9h4h,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:828dcdb67e74b8a327b01dc0797be5e1,SystemUUID:828dcdb6-7e74-b8a3-27b0-1dc0797be5e1,BootID:dd05deb0-ef00-47e1-83af-c902277fe4b7,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 16 11:02:52.559: INFO: 
Logging kubelet events for node nodes-us-east1-b-9h4h
Jan 16 11:02:52.596: INFO: 
Logging pods the kubelet thinks is on node nodes-us-east1-b-9h4h
Jan 16 11:02:52.648: INFO: dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94 started at 2023-01-16 10:49:18 +0000 UTC (0+3 container statuses recorded)
Jan 16 11:02:52.648: INFO: 	Container jessie-querier ready: true, restart count 1
Jan 16 11:02:52.648: INFO: 	Container querier ready: true, restart count 1
Jan 16 11:02:52.648: INFO: 	Container webserver ready: true, restart count 0
Jan 16 11:02:52.648: INFO: kube-proxy-nodes-us-east1-b-9h4h started at 2023-01-16 10:34:55 +0000 UTC (0+1 container statuses recorded)
Jan 16 11:02:52.648: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 11:02:52.648: INFO: csi-gce-pd-node-ncgj4 started at 2023-01-16 10:35:01 +0000 UTC (0+2 container statuses recorded)
Jan 16 11:02:52.648: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 11:02:52.648: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 11:02:52.648: INFO: calico-node-gmwsc started at 2023-01-16 10:35:01 +0000 UTC (3+1 container statuses recorded)
Jan 16 11:02:52.648: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 11:02:52.648: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 11:02:52.648: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 11:02:52.648: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 11:02:52.648: INFO: coredns-autoscaler-7cb5c5b969-mpv8x started at 2023-01-16 10:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 16 11:02:52.648: INFO: 	Container autoscaler ready: true, restart count 0
Jan 16 11:02:52.648: INFO: coredns-7bc44848df-zs55k started at 2023-01-16 10:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 16 11:02:52.648: INFO: 	Container coredns ready: true, restart count 0
Jan 16 11:02:52.868: INFO: 
Latency metrics for node nodes-us-east1-b-9h4h
Jan 16 11:02:52.869: INFO: 
Logging node info for node nodes-us-east1-b-rn9p
Jan 16 11:02:52.904: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east1-b-rn9p    59f4f25d-24bf-4d96-a4bf-2cf266b5c083 55992 0 2023-01-16 10:34:59 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east1-b-rn9p kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east1-b topology.hostpath.csi/node:nodes-us-east1-b-rn9p topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/nodes-us-east1-b-rn9p"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.3/32 projectcalico.org/IPv4IPIPTunnelAddr:100.98.60.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-16 10:34:59 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:00 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-16 10:35:01 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {calico-node Update v1 2023-01-16 10:35:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-16 11:02:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/nodes-us-east1-b-rn9p,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:35:26 +0000 UTC,LastTransitionTime:2023-01-16 10:35:26 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 11:02:00 +0000 UTC,LastTransitionTime:2023-01-16 10:34:59 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 11:02:00 +0000 UTC,LastTransitionTime:2023-01-16 10:34:59 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 11:02:00 +0000 UTC,LastTransitionTime:2023-01-16 10:34:59 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 11:02:00 +0000 UTC,LastTransitionTime:2023-01-16 10:35:14 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.3,},NodeAddress{Type:ExternalIP,Address:34.75.49.181,},NodeAddress{Type:Hostname,Address:nodes-us-east1-b-rn9p,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:9f39c983773df4ca6a15315227d6fd51,SystemUUID:9f39c983-773d-f4ca-6a15-315227d6fd51,BootID:7e9ad329-1a6b-4405-ba71-ca92e45658b3,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:c0ddb4794bc8a3631e3373015f913c00b230ee54f87bde9ade195b3a3415c60f registry.k8s.io/build-image/distroless-iptables:v0.1.2],SizeBytes:7685585,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 16 11:02:52.904: INFO: 
Logging kubelet events for node nodes-us-east1-b-rn9p
Jan 16 11:02:52.949: INFO: 
Logging pods the kubelet thinks is on node nodes-us-east1-b-rn9p
Jan 16 11:02:52.989: INFO: calico-node-ntgj5 started at 2023-01-16 10:35:03 +0000 UTC (3+1 container statuses recorded)
Jan 16 11:02:52.989: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 11:02:52.989: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 11:02:52.989: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 11:02:52.989: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 11:02:52.989: INFO: csi-gce-pd-node-88f4v started at 2023-01-16 10:35:03 +0000 UTC (0+2 container statuses recorded)
Jan 16 11:02:52.989: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 11:02:52.989: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 11:02:52.989: INFO: kube-proxy-nodes-us-east1-b-rn9p started at 2023-01-16 10:34:56 +0000 UTC (0+1 container statuses recorded)
Jan 16 11:02:52.989: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 11:02:53.186: INFO: 
Latency metrics for node nodes-us-east1-b-rn9p
Jan 16 11:02:53.186: INFO: 
Logging node info for node nodes-us-east1-b-wcrf
Jan 16 11:02:53.221: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east1-b-wcrf    509e8852-b60d-4ccc-864a-4efd7f571608 55387 0 2023-01-16 10:35:00 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east1-b-wcrf kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east1-b topology.hostpath.csi/node:nodes-us-east1-b-wcrf topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/nodes-us-east1-b-wcrf"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.2/32 projectcalico.org/IPv4IPIPTunnelAddr:100.110.242.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-16 10:35:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:01 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-16 10:35:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {calico-node Update v1 2023-01-16 10:35:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-16 11:00:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/nodes-us-east1-b-wcrf,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:35:27 +0000 UTC,LastTransitionTime:2023-01-16 10:35:27 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 11:00:15 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 11:00:15 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 11:00:15 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 11:00:15 +0000 UTC,LastTransitionTime:2023-01-16 10:35:15 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.2,},NodeAddress{Type:ExternalIP,Address:35.237.110.203,},NodeAddress{Type:Hostname,Address:nodes-us-east1-b-wcrf,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:90256d4292845f855978b781ab31ded0,SystemUUID:90256d42-9284-5f85-5978-b781ab31ded0,BootID:b6764560-f26d-4d17-83ba-c17bdd70bced,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 16 11:02:53.222: INFO: 
Logging kubelet events for node nodes-us-east1-b-wcrf
Jan 16 11:02:53.260: INFO: 
Logging pods the kubelet thinks is on node nodes-us-east1-b-wcrf
Jan 16 11:02:53.308: INFO: coredns-7bc44848df-rn2pc started at 2023-01-16 10:35:31 +0000 UTC (0+1 container statuses recorded)
Jan 16 11:02:53.308: INFO: 	Container coredns ready: true, restart count 0
Jan 16 11:02:53.308: INFO: csi-gce-pd-node-v2gwp started at 2023-01-16 10:35:01 +0000 UTC (0+2 container statuses recorded)
Jan 16 11:02:53.308: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 11:02:53.308: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 11:02:53.308: INFO: calico-node-tvbl7 started at 2023-01-16 10:35:01 +0000 UTC (3+1 container statuses recorded)
Jan 16 11:02:53.308: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 11:02:53.308: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 11:02:53.308: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 11:02:53.308: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 11:02:53.308: INFO: kube-proxy-nodes-us-east1-b-wcrf started at 2023-01-16 10:34:57 +0000 UTC (0+1 container statuses recorded)
Jan 16 11:02:53.308: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 11:02:53.527: INFO: 
Latency metrics for node nodes-us-east1-b-wcrf
[DeferCleanup (Each)] [sig-network] DNS
  tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "dns-8824" for this suite. �[38;5;243m01/16/23 11:02:53.527�[0m

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-network] DNS should provide DNS for pods for Hostname [Conformance] 14m51s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-network\]\sDNS\sshould\sprovide\sDNS\sfor\spods\sfor\sHostname\s\[Conformance\]$'

test/e2e/network/dns_common.go:455
k8s.io/kubernetes/test/e2e/network.assertFilesContain({0xc0015264c0?, 0x4?, 0x4?}, {0x75bfff4?, 0x7?}, 0xc0026d9200?, {0x801e128?, 0xc001413ba0?}, 0x0?, {0x0, ...})
	test/e2e/network/dns_common.go:455 +0x1dc
k8s.io/kubernetes/test/e2e/network.assertFilesExist(...)
	test/e2e/network/dns_common.go:449
k8s.io/kubernetes/test/e2e/network.validateDNSResults(0xc000d86e10, 0xc0026d9200, {0xc0015264c0, 0x4, 0x4})
	test/e2e/network/dns_common.go:512 +0x452
k8s.io/kubernetes/test/e2e/network.glob..func2.7()
	test/e2e/network/dns.go:281 +0x8b4
				[BeforeEach] [sig-network] DNS
  set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/16/23 10:49:18.163�[0m
Jan 16 10:49:18.163: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename dns �[38;5;243m01/16/23 10:49:18.165�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/16/23 10:49:18.291�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/16/23 10:49:18.356�[0m
[BeforeEach] [sig-network] DNS
  test/e2e/framework/metrics/init/init.go:31
[It] should provide DNS for pods for Hostname [Conformance]
  test/e2e/network/dns.go:248
�[1mSTEP:�[0m Creating a test headless service �[38;5;243m01/16/23 10:49:18.423�[0m
�[1mSTEP:�[0m Running these commands on wheezy: for i in `seq 1 600`; do test -n "$$(getent hosts dns-querier-2.dns-test-service-2.dns-4230.svc.cluster.local)" && echo OK > /results/wheezy_hosts@dns-querier-2.dns-test-service-2.dns-4230.svc.cluster.local;test -n "$$(getent hosts dns-querier-2)" && echo OK > /results/wheezy_hosts@dns-querier-2;sleep 1; done
 �[38;5;243m01/16/23 10:49:18.463�[0m
�[1mSTEP:�[0m Running these commands on jessie: for i in `seq 1 600`; do test -n "$$(getent hosts dns-querier-2.dns-test-service-2.dns-4230.svc.cluster.local)" && echo OK > /results/jessie_hosts@dns-querier-2.dns-test-service-2.dns-4230.svc.cluster.local;test -n "$$(getent hosts dns-querier-2)" && echo OK > /results/jessie_hosts@dns-querier-2;sleep 1; done
 �[38;5;243m01/16/23 10:49:18.463�[0m
�[1mSTEP:�[0m creating a pod to probe DNS �[38;5;243m01/16/23 10:49:18.464�[0m
�[1mSTEP:�[0m submitting the pod to kubernetes �[38;5;243m01/16/23 10:49:18.464�[0m
Jan 16 10:49:18.516: INFO: Waiting up to 15m0s for pod "dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94" in namespace "dns-4230" to be "running"
Jan 16 10:49:18.551: INFO: Pod "dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94": Phase="Pending", Reason="", readiness=false. Elapsed: 35.2492ms
Jan 16 10:49:20.591: INFO: Pod "dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94": Phase="Pending", Reason="", readiness=false. Elapsed: 2.074843476s
Jan 16 10:49:22.604: INFO: Pod "dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94": Phase="Pending", Reason="", readiness=false. Elapsed: 4.087868453s
Jan 16 10:49:24.588: INFO: Pod "dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94": Phase="Pending", Reason="", readiness=false. Elapsed: 6.07172132s
Jan 16 10:49:26.589: INFO: Pod "dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94": Phase="Pending", Reason="", readiness=false. Elapsed: 8.072940555s
Jan 16 10:49:28.588: INFO: Pod "dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94": Phase="Pending", Reason="", readiness=false. Elapsed: 10.072055547s
Jan 16 10:49:30.588: INFO: Pod "dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94": Phase="Pending", Reason="", readiness=false. Elapsed: 12.072483805s
Jan 16 10:49:32.589: INFO: Pod "dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94": Phase="Pending", Reason="", readiness=false. Elapsed: 14.072943287s
Jan 16 10:49:34.589: INFO: Pod "dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94": Phase="Pending", Reason="", readiness=false. Elapsed: 16.072650993s
Jan 16 10:49:36.588: INFO: Pod "dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94": Phase="Pending", Reason="", readiness=false. Elapsed: 18.072232861s
Jan 16 10:49:38.588: INFO: Pod "dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94": Phase="Pending", Reason="", readiness=false. Elapsed: 20.072351089s
Jan 16 10:49:40.588: INFO: Pod "dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94": Phase="Pending", Reason="", readiness=false. Elapsed: 22.072186731s
Jan 16 10:49:42.589: INFO: Pod "dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94": Phase="Running", Reason="", readiness=true. Elapsed: 24.072636172s
Jan 16 10:49:42.589: INFO: Pod "dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94" satisfied condition "running"
�[1mSTEP:�[0m retrieving the pod �[38;5;243m01/16/23 10:49:42.589�[0m
�[1mSTEP:�[0m looking for the results for each expected name from probers �[38;5;243m01/16/23 10:49:42.625�[0m
Jan 16 10:50:12.664: INFO: Unable to read wheezy_hosts@dns-querier-2.dns-test-service-2.dns-4230.svc.cluster.local from pod dns-4230/dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94: the server is currently unable to handle the request (get pods dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94)
Jan 16 10:50:42.707: INFO: Unable to read wheezy_hosts@dns-querier-2 from pod dns-4230/dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94: the server is currently unable to handle the request (get pods dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94)
Jan 16 10:51:12.745: INFO: Unable to read jessie_hosts@dns-querier-2.dns-test-service-2.dns-4230.svc.cluster.local from pod dns-4230/dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94: the server is currently unable to handle the request (get pods dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94)
Jan 16 10:51:42.780: INFO: Unable to read jessie_hosts@dns-querier-2 from pod dns-4230/dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94: the server is currently unable to handle the request (get pods dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94)
Jan 16 10:51:42.780: INFO: Lookups using dns-4230/dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94 failed for: [wheezy_hosts@dns-querier-2.dns-test-service-2.dns-4230.svc.cluster.local wheezy_hosts@dns-querier-2 jessie_hosts@dns-querier-2.dns-test-service-2.dns-4230.svc.cluster.local jessie_hosts@dns-querier-2]

Jan 16 10:52:17.818: INFO: Unable to read wheezy_hosts@dns-querier-2.dns-test-service-2.dns-4230.svc.cluster.local from pod dns-4230/dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94: the server is currently unable to handle the request (get pods dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94)
Jan 16 10:52:47.877: INFO: Unable to read wheezy_hosts@dns-querier-2 from pod dns-4230/dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94: the server is currently unable to handle the request (get pods dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94)
Jan 16 10:53:17.915: INFO: Unable to read jessie_hosts@dns-querier-2.dns-test-service-2.dns-4230.svc.cluster.local from pod dns-4230/dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94: the server is currently unable to handle the request (get pods dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94)
Jan 16 10:53:47.950: INFO: Unable to read jessie_hosts@dns-querier-2 from pod dns-4230/dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94: the server is currently unable to handle the request (get pods dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94)
Jan 16 10:53:47.950: INFO: Lookups using dns-4230/dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94 failed for: [wheezy_hosts@dns-querier-2.dns-test-service-2.dns-4230.svc.cluster.local wheezy_hosts@dns-querier-2 jessie_hosts@dns-querier-2.dns-test-service-2.dns-4230.svc.cluster.local jessie_hosts@dns-querier-2]

Jan 16 10:54:22.818: INFO: Unable to read wheezy_hosts@dns-querier-2.dns-test-service-2.dns-4230.svc.cluster.local from pod dns-4230/dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94: the server is currently unable to handle the request (get pods dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94)
Jan 16 10:54:52.853: INFO: Unable to read wheezy_hosts@dns-querier-2 from pod dns-4230/dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94: the server is currently unable to handle the request (get pods dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94)
Jan 16 10:55:22.888: INFO: Unable to read jessie_hosts@dns-querier-2.dns-test-service-2.dns-4230.svc.cluster.local from pod dns-4230/dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94: the server is currently unable to handle the request (get pods dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94)
Jan 16 10:55:52.923: INFO: Unable to read jessie_hosts@dns-querier-2 from pod dns-4230/dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94: the server is currently unable to handle the request (get pods dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94)
Jan 16 10:55:52.923: INFO: Lookups using dns-4230/dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94 failed for: [wheezy_hosts@dns-querier-2.dns-test-service-2.dns-4230.svc.cluster.local wheezy_hosts@dns-querier-2 jessie_hosts@dns-querier-2.dns-test-service-2.dns-4230.svc.cluster.local jessie_hosts@dns-querier-2]

Jan 16 10:56:27.816: INFO: Unable to read wheezy_hosts@dns-querier-2.dns-test-service-2.dns-4230.svc.cluster.local from pod dns-4230/dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94: the server is currently unable to handle the request (get pods dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94)
Jan 16 10:56:57.854: INFO: Unable to read wheezy_hosts@dns-querier-2 from pod dns-4230/dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94: the server is currently unable to handle the request (get pods dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94)
Jan 16 10:57:27.899: INFO: Unable to read jessie_hosts@dns-querier-2.dns-test-service-2.dns-4230.svc.cluster.local from pod dns-4230/dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94: the server is currently unable to handle the request (get pods dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94)
Jan 16 10:57:57.948: INFO: Unable to read jessie_hosts@dns-querier-2 from pod dns-4230/dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94: the server is currently unable to handle the request (get pods dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94)
Jan 16 10:57:57.948: INFO: Lookups using dns-4230/dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94 failed for: [wheezy_hosts@dns-querier-2.dns-test-service-2.dns-4230.svc.cluster.local wheezy_hosts@dns-querier-2 jessie_hosts@dns-querier-2.dns-test-service-2.dns-4230.svc.cluster.local jessie_hosts@dns-querier-2]

Jan 16 10:58:32.816: INFO: Unable to read wheezy_hosts@dns-querier-2.dns-test-service-2.dns-4230.svc.cluster.local from pod dns-4230/dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94: the server is currently unable to handle the request (get pods dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94)
Jan 16 10:59:02.849: INFO: Unable to read wheezy_hosts@dns-querier-2 from pod dns-4230/dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94: the server is currently unable to handle the request (get pods dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94)
Jan 16 10:59:32.884: INFO: Unable to read jessie_hosts@dns-querier-2.dns-test-service-2.dns-4230.svc.cluster.local from pod dns-4230/dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94: the server is currently unable to handle the request (get pods dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94)
Jan 16 11:00:02.919: INFO: Unable to read jessie_hosts@dns-querier-2 from pod dns-4230/dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94: the server is currently unable to handle the request (get pods dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94)
Jan 16 11:00:02.919: INFO: Lookups using dns-4230/dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94 failed for: [wheezy_hosts@dns-querier-2.dns-test-service-2.dns-4230.svc.cluster.local wheezy_hosts@dns-querier-2 jessie_hosts@dns-querier-2.dns-test-service-2.dns-4230.svc.cluster.local jessie_hosts@dns-querier-2]

Jan 16 11:00:37.816: INFO: Unable to read wheezy_hosts@dns-querier-2.dns-test-service-2.dns-4230.svc.cluster.local from pod dns-4230/dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94: the server is currently unable to handle the request (get pods dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94)
Jan 16 11:01:07.851: INFO: Unable to read wheezy_hosts@dns-querier-2 from pod dns-4230/dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94: the server is currently unable to handle the request (get pods dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94)
Jan 16 11:01:37.889: INFO: Unable to read jessie_hosts@dns-querier-2.dns-test-service-2.dns-4230.svc.cluster.local from pod dns-4230/dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94: the server is currently unable to handle the request (get pods dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94)
Jan 16 11:02:07.924: INFO: Unable to read jessie_hosts@dns-querier-2 from pod dns-4230/dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94: the server is currently unable to handle the request (get pods dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94)
Jan 16 11:02:07.924: INFO: Lookups using dns-4230/dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94 failed for: [wheezy_hosts@dns-querier-2.dns-test-service-2.dns-4230.svc.cluster.local wheezy_hosts@dns-querier-2 jessie_hosts@dns-querier-2.dns-test-service-2.dns-4230.svc.cluster.local jessie_hosts@dns-querier-2]

Jan 16 11:02:37.958: INFO: Unable to read wheezy_hosts@dns-querier-2.dns-test-service-2.dns-4230.svc.cluster.local from pod dns-4230/dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94: the server is currently unable to handle the request (get pods dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94)
Jan 16 11:03:07.993: INFO: Unable to read wheezy_hosts@dns-querier-2 from pod dns-4230/dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94: the server is currently unable to handle the request (get pods dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94)
Jan 16 11:03:38.029: INFO: Unable to read jessie_hosts@dns-querier-2.dns-test-service-2.dns-4230.svc.cluster.local from pod dns-4230/dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94: the server is currently unable to handle the request (get pods dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94)
Jan 16 11:04:08.064: INFO: Unable to read jessie_hosts@dns-querier-2 from pod dns-4230/dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94: the server is currently unable to handle the request (get pods dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94)
Jan 16 11:04:08.064: INFO: Lookups using dns-4230/dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94 failed for: [wheezy_hosts@dns-querier-2.dns-test-service-2.dns-4230.svc.cluster.local wheezy_hosts@dns-querier-2 jessie_hosts@dns-querier-2.dns-test-service-2.dns-4230.svc.cluster.local jessie_hosts@dns-querier-2]

Jan 16 11:04:08.064: INFO: Unexpected error: 
    <*errors.errorString | 0xc000205cb0>: {
        s: "timed out waiting for the condition",
    }
Jan 16 11:04:08.064: FAIL: timed out waiting for the condition

Full Stack Trace
k8s.io/kubernetes/test/e2e/network.assertFilesContain({0xc0015264c0?, 0x4?, 0x4?}, {0x75bfff4?, 0x7?}, 0xc0026d9200?, {0x801e128?, 0xc001413ba0?}, 0x0?, {0x0, ...})
	test/e2e/network/dns_common.go:455 +0x1dc
k8s.io/kubernetes/test/e2e/network.assertFilesExist(...)
	test/e2e/network/dns_common.go:449
k8s.io/kubernetes/test/e2e/network.validateDNSResults(0xc000d86e10, 0xc0026d9200, {0xc0015264c0, 0x4, 0x4})
	test/e2e/network/dns_common.go:512 +0x452
k8s.io/kubernetes/test/e2e/network.glob..func2.7()
	test/e2e/network/dns.go:281 +0x8b4
�[1mSTEP:�[0m deleting the pod �[38;5;243m01/16/23 11:04:08.064�[0m
�[1mSTEP:�[0m deleting the test headless service �[38;5;243m01/16/23 11:04:08.113�[0m
[AfterEach] [sig-network] DNS
  test/e2e/framework/node/init/init.go:32
Jan 16 11:04:08.161: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-network] DNS
  test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-network] DNS
  dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/16/23 11:04:08.219�[0m
�[1mSTEP:�[0m Collecting events from namespace "dns-4230". �[38;5;243m01/16/23 11:04:08.219�[0m
�[1mSTEP:�[0m Found 13 events. �[38;5;243m01/16/23 11:04:08.26�[0m
Jan 16 11:04:08.260: INFO: At 2023-01-16 10:49:18 +0000 UTC - event for dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94: {default-scheduler } Scheduled: Successfully assigned dns-4230/dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94 to nodes-us-east1-b-9h4h
Jan 16 11:04:08.260: INFO: At 2023-01-16 10:49:33 +0000 UTC - event for dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94: {kubelet nodes-us-east1-b-9h4h} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine
Jan 16 11:04:08.260: INFO: At 2023-01-16 10:49:34 +0000 UTC - event for dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94: {kubelet nodes-us-east1-b-9h4h} Created: Created container webserver
Jan 16 11:04:08.260: INFO: At 2023-01-16 10:49:36 +0000 UTC - event for dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94: {kubelet nodes-us-east1-b-9h4h} Started: Started container webserver
Jan 16 11:04:08.261: INFO: At 2023-01-16 10:49:36 +0000 UTC - event for dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94: {kubelet nodes-us-east1-b-9h4h} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine
Jan 16 11:04:08.261: INFO: At 2023-01-16 10:49:37 +0000 UTC - event for dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94: {kubelet nodes-us-east1-b-9h4h} Created: Created container querier
Jan 16 11:04:08.261: INFO: At 2023-01-16 10:49:37 +0000 UTC - event for dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94: {kubelet nodes-us-east1-b-9h4h} Started: Started container querier
Jan 16 11:04:08.261: INFO: At 2023-01-16 10:49:37 +0000 UTC - event for dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94: {kubelet nodes-us-east1-b-9h4h} Pulled: Container image "registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7" already present on machine
Jan 16 11:04:08.261: INFO: At 2023-01-16 10:49:38 +0000 UTC - event for dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94: {kubelet nodes-us-east1-b-9h4h} Created: Created container jessie-querier
Jan 16 11:04:08.261: INFO: At 2023-01-16 10:49:38 +0000 UTC - event for dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94: {kubelet nodes-us-east1-b-9h4h} Started: Started container jessie-querier
Jan 16 11:04:08.261: INFO: At 2023-01-16 11:04:08 +0000 UTC - event for dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94: {kubelet nodes-us-east1-b-9h4h} Killing: Stopping container webserver
Jan 16 11:04:08.261: INFO: At 2023-01-16 11:04:08 +0000 UTC - event for dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94: {kubelet nodes-us-east1-b-9h4h} Killing: Stopping container jessie-querier
Jan 16 11:04:08.261: INFO: At 2023-01-16 11:04:08 +0000 UTC - event for dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94: {kubelet nodes-us-east1-b-9h4h} Killing: Stopping container querier
Jan 16 11:04:08.308: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Jan 16 11:04:08.308: INFO: 
Jan 16 11:04:08.349: INFO: 
Logging node info for node control-plane-us-east1-b-nc4v
Jan 16 11:04:08.384: INFO: Node Info: &Node{ObjectMeta:{control-plane-us-east1-b-nc4v    3e043433-4a0a-4797-aed2-d532c70362c4 55531 0 2023-01-16 10:33:51 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-standard-2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:control-plane-us-east1-b-nc4v kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node-role.kubernetes.io/node: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:e2-standard-2 topology.gke.io/zone:us-east1-b topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/control-plane-us-east1-b-nc4v"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.4/32 projectcalico.org/IPv4IPIPTunnelAddr:100.126.126.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-16 10:33:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-16 10:34:31 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:34:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {calico-node Update v1 2023-01-16 10:34:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-16 10:34:51 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:34:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:34:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-16 11:00:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/control-plane-us-east1-b-nc4v,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8332767232 0} {<nil>} 8137468Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8227909632 0} {<nil>} 8035068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:34:56 +0000 UTC,LastTransitionTime:2023-01-16 10:34:56 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 11:00:34 +0000 UTC,LastTransitionTime:2023-01-16 10:33:51 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 11:00:34 +0000 UTC,LastTransitionTime:2023-01-16 10:33:51 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 11:00:34 +0000 UTC,LastTransitionTime:2023-01-16 10:33:51 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 11:00:34 +0000 UTC,LastTransitionTime:2023-01-16 10:34:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.4,},NodeAddress{Type:ExternalIP,Address:35.243.145.107,},NodeAddress{Type:Hostname,Address:control-plane-us-east1-b-nc4v,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e5ac4d7bf983c1b4a0fb9c7211b86ad9,SystemUUID:e5ac4d7b-f983-c1b4-a0fb-9c7211b86ad9,BootID:66119c47-44e2-4c4c-ac93-902592bb3d86,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.0],SizeBytes:135162323,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.0],SizeBytes:124991801,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.0],SizeBytes:57657656,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43637878,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42802014,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:2b6acd7f677f76ffe12ecf3ea7df92eb9b1bdb07336d1ac2a54c7631fb753f7e docker.io/calico/kube-controllers:v3.24.5],SizeBytes:31137169,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2 registry.k8s.io/sig-storage/csi-provisioner:v2.1.0],SizeBytes:21205045,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:50c3cfd458fc8e0bf3c8c521eac39172009382fc66dc5044a330d137c6ed0b09 registry.k8s.io/sig-storage/csi-attacher:v3.1.0],SizeBytes:20103959,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a registry.k8s.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:9af9bf28430b00a0cedeb2ec29acadce45e6afcecd8bdf31c793c624cfa75fa7 registry.k8s.io/sig-storage/csi-snapshotter:v3.0.3],SizeBytes:19500777,},ContainerImage{Names:[docker.io/k8scloudprovidergcp/cloud-controller-manager@sha256:881fd1095937638040723973ade90e6700f1c831a78fb585a3227c4d021b0df9 docker.io/k8scloudprovidergcp/cloud-controller-manager:latest],SizeBytes:18702875,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4967322,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 16 11:04:08.385: INFO: 
Logging kubelet events for node control-plane-us-east1-b-nc4v
Jan 16 11:04:08.422: INFO: 
Logging pods the kubelet thinks is on node control-plane-us-east1-b-nc4v
Jan 16 11:04:08.496: INFO: dns-controller-6d5f4bf5d6-kqf4d started at 2023-01-16 10:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 16 11:04:08.496: INFO: 	Container dns-controller ready: true, restart count 0
Jan 16 11:04:08.496: INFO: kube-scheduler-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 11:04:08.496: INFO: 	Container kube-scheduler ready: true, restart count 0
Jan 16 11:04:08.496: INFO: kube-apiserver-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+2 container statuses recorded)
Jan 16 11:04:08.496: INFO: 	Container healthcheck ready: true, restart count 0
Jan 16 11:04:08.496: INFO: 	Container kube-apiserver ready: true, restart count 1
Jan 16 11:04:08.496: INFO: calico-kube-controllers-55f488656-hcbkw started at 2023-01-16 10:34:50 +0000 UTC (0+1 container statuses recorded)
Jan 16 11:04:08.496: INFO: 	Container calico-kube-controllers ready: true, restart count 0
Jan 16 11:04:08.496: INFO: csi-gce-pd-node-kz9xf started at 2023-01-16 10:34:14 +0000 UTC (0+2 container statuses recorded)
Jan 16 11:04:08.496: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 11:04:08.496: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 11:04:08.496: INFO: csi-gce-pd-controller-78fc966fff-m86hh started at 2023-01-16 10:34:31 +0000 UTC (0+5 container statuses recorded)
Jan 16 11:04:08.496: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 16 11:04:08.496: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 16 11:04:08.496: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 16 11:04:08.496: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 16 11:04:08.496: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 11:04:08.496: INFO: kops-controller-smdjr started at 2023-01-16 10:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 16 11:04:08.496: INFO: 	Container kops-controller ready: true, restart count 0
Jan 16 11:04:08.496: INFO: etcd-manager-events-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 11:04:08.496: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 16 11:04:08.496: INFO: etcd-manager-main-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 11:04:08.496: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 16 11:04:08.496: INFO: calico-node-5jgkc started at 2023-01-16 10:34:24 +0000 UTC (3+1 container statuses recorded)
Jan 16 11:04:08.496: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 11:04:08.496: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 11:04:08.496: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 11:04:08.496: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 11:04:08.496: INFO: cloud-controller-manager-b5qds started at 2023-01-16 10:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 16 11:04:08.496: INFO: 	Container cloud-controller-manager ready: true, restart count 0
Jan 16 11:04:08.496: INFO: kube-controller-manager-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 11:04:08.496: INFO: 	Container kube-controller-manager ready: true, restart count 2
Jan 16 11:04:08.496: INFO: kube-proxy-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 11:04:08.496: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 11:04:08.700: INFO: 
Latency metrics for node control-plane-us-east1-b-nc4v
Jan 16 11:04:08.700: INFO: 
Logging node info for node nodes-us-east1-b-2xs4
Jan 16 11:04:08.735: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east1-b-2xs4    5523b1af-a125-4437-baf4-a87ff6e2a424 55689 0 2023-01-16 10:35:00 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east1-b-2xs4 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east1-b topology.hostpath.csi/node:nodes-us-east1-b-2xs4 topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/nodes-us-east1-b-2xs4"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.6/32 projectcalico.org/IPv4IPIPTunnelAddr:100.123.6.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2023-01-16 10:35:00 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2023-01-16 10:35:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-16 10:35:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {calico-node Update v1 2023-01-16 10:35:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-16 11:01:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/nodes-us-east1-b-2xs4,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:35:32 +0000 UTC,LastTransitionTime:2023-01-16 10:35:32 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 11:01:06 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 11:01:06 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 11:01:06 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 11:01:06 +0000 UTC,LastTransitionTime:2023-01-16 10:35:20 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.6,},NodeAddress{Type:ExternalIP,Address:35.196.42.74,},NodeAddress{Type:Hostname,Address:nodes-us-east1-b-2xs4,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:39f2b9ba1d525f08f837cadb4248f14d,SystemUUID:39f2b9ba-1d52-5f08-f837-cadb4248f14d,BootID:7acec4fd-f02a-4704-a113-25a81be183ce,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 16 11:04:08.736: INFO: 
Logging kubelet events for node nodes-us-east1-b-2xs4
Jan 16 11:04:08.773: INFO: 
Logging pods the kubelet thinks is on node nodes-us-east1-b-2xs4
Jan 16 11:04:08.815: INFO: kube-proxy-nodes-us-east1-b-2xs4 started at 2023-01-16 10:34:50 +0000 UTC (0+1 container statuses recorded)
Jan 16 11:04:08.815: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 11:04:08.815: INFO: csi-gce-pd-node-jc8jn started at 2023-01-16 10:35:10 +0000 UTC (0+2 container statuses recorded)
Jan 16 11:04:08.815: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 11:04:08.815: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 11:04:08.815: INFO: calico-node-qlnmx started at 2023-01-16 10:35:10 +0000 UTC (3+1 container statuses recorded)
Jan 16 11:04:08.815: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 11:04:08.815: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 11:04:08.815: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 11:04:08.815: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 11:04:08.815: INFO: dns-test-9ac02aeb-ccb8-4dbf-a031-3f8abf3c41bb started at 2023-01-16 10:56:17 +0000 UTC (0+3 container statuses recorded)
Jan 16 11:04:08.815: INFO: 	Container jessie-querier ready: true, restart count 0
Jan 16 11:04:08.815: INFO: 	Container querier ready: true, restart count 0
Jan 16 11:04:08.815: INFO: 	Container webserver ready: true, restart count 0
Jan 16 11:04:08.815: INFO: agnhost started at 2023-01-16 10:46:16 +0000 UTC (0+1 container statuses recorded)
Jan 16 11:04:08.815: INFO: 	Container agnhost ready: true, restart count 0
Jan 16 11:04:08.815: INFO: proxy-service-cgkvp-fj8m5 started at 2023-01-16 10:54:34 +0000 UTC (0+1 container statuses recorded)
Jan 16 11:04:08.815: INFO: 	Container proxy-service-cgkvp ready: true, restart count 0
Jan 16 11:04:09.028: INFO: 
Latency metrics for node nodes-us-east1-b-2xs4
Jan 16 11:04:09.028: INFO: 
Logging node info for node nodes-us-east1-b-9h4h
Jan 16 11:04:09.063: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east1-b-9h4h    672ac3b7-ea1d-4e3e-bd88-42fa1b6384a8 54576 0 2023-01-16 10:34:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east1-b-9h4h kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east1-b topology.hostpath.csi/node:nodes-us-east1-b-9h4h topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/nodes-us-east1-b-9h4h"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.5/32 projectcalico.org/IPv4IPIPTunnelAddr:100.103.14.192 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-16 10:34:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:34:59 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-16 10:34:59 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:35:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {calico-node Update v1 2023-01-16 10:35:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-16 10:59:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/nodes-us-east1-b-9h4h,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:35:24 +0000 UTC,LastTransitionTime:2023-01-16 10:35:24 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 10:59:30 +0000 UTC,LastTransitionTime:2023-01-16 10:34:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 10:59:30 +0000 UTC,LastTransitionTime:2023-01-16 10:34:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 10:59:30 +0000 UTC,LastTransitionTime:2023-01-16 10:34:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 10:59:30 +0000 UTC,LastTransitionTime:2023-01-16 10:35:13 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.5,},NodeAddress{Type:ExternalIP,Address:35.196.180.243,},NodeAddress{Type:Hostname,Address:nodes-us-east1-b-9h4h,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:828dcdb67e74b8a327b01dc0797be5e1,SystemUUID:828dcdb6-7e74-b8a3-27b0-1dc0797be5e1,BootID:dd05deb0-ef00-47e1-83af-c902277fe4b7,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 16 11:04:09.064: INFO: 
Logging kubelet events for node nodes-us-east1-b-9h4h
Jan 16 11:04:09.102: INFO: 
Logging pods the kubelet thinks is on node nodes-us-east1-b-9h4h
Jan 16 11:04:09.142: INFO: coredns-autoscaler-7cb5c5b969-mpv8x started at 2023-01-16 10:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 16 11:04:09.142: INFO: 	Container autoscaler ready: true, restart count 0
Jan 16 11:04:09.142: INFO: csi-gce-pd-node-ncgj4 started at 2023-01-16 10:35:01 +0000 UTC (0+2 container statuses recorded)
Jan 16 11:04:09.142: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 11:04:09.142: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 11:04:09.142: INFO: calico-node-gmwsc started at 2023-01-16 10:35:01 +0000 UTC (3+1 container statuses recorded)
Jan 16 11:04:09.142: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 11:04:09.142: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 11:04:09.142: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 11:04:09.142: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 11:04:09.142: INFO: coredns-7bc44848df-zs55k started at 2023-01-16 10:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 16 11:04:09.142: INFO: 	Container coredns ready: true, restart count 0
Jan 16 11:04:09.142: INFO: kube-proxy-nodes-us-east1-b-9h4h started at 2023-01-16 10:34:55 +0000 UTC (0+1 container statuses recorded)
Jan 16 11:04:09.142: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 11:04:09.375: INFO: 
Latency metrics for node nodes-us-east1-b-9h4h
Jan 16 11:04:09.375: INFO: 
Logging node info for node nodes-us-east1-b-rn9p
Jan 16 11:04:09.410: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east1-b-rn9p    59f4f25d-24bf-4d96-a4bf-2cf266b5c083 55992 0 2023-01-16 10:34:59 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east1-b-rn9p kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east1-b topology.hostpath.csi/node:nodes-us-east1-b-rn9p topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/nodes-us-east1-b-rn9p"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.3/32 projectcalico.org/IPv4IPIPTunnelAddr:100.98.60.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-16 10:34:59 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:00 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-16 10:35:01 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {calico-node Update v1 2023-01-16 10:35:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-16 11:02:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/nodes-us-east1-b-rn9p,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:35:26 +0000 UTC,LastTransitionTime:2023-01-16 10:35:26 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 11:02:00 +0000 UTC,LastTransitionTime:2023-01-16 10:34:59 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 11:02:00 +0000 UTC,LastTransitionTime:2023-01-16 10:34:59 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 11:02:00 +0000 UTC,LastTransitionTime:2023-01-16 10:34:59 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 11:02:00 +0000 UTC,LastTransitionTime:2023-01-16 10:35:14 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.3,},NodeAddress{Type:ExternalIP,Address:34.75.49.181,},NodeAddress{Type:Hostname,Address:nodes-us-east1-b-rn9p,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:9f39c983773df4ca6a15315227d6fd51,SystemUUID:9f39c983-773d-f4ca-6a15-315227d6fd51,BootID:7e9ad329-1a6b-4405-ba71-ca92e45658b3,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:c0ddb4794bc8a3631e3373015f913c00b230ee54f87bde9ade195b3a3415c60f registry.k8s.io/build-image/distroless-iptables:v0.1.2],SizeBytes:7685585,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 16 11:04:09.410: INFO: 
Logging kubelet events for node nodes-us-east1-b-rn9p
Jan 16 11:04:09.449: INFO: 
Logging pods the kubelet thinks is on node nodes-us-east1-b-rn9p
Jan 16 11:04:09.491: INFO: calico-node-ntgj5 started at 2023-01-16 10:35:03 +0000 UTC (3+1 container statuses recorded)
Jan 16 11:04:09.491: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 11:04:09.491: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 11:04:09.491: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 11:04:09.491: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 11:04:09.491: INFO: csi-gce-pd-node-88f4v started at 2023-01-16 10:35:03 +0000 UTC (0+2 container statuses recorded)
Jan 16 11:04:09.491: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 11:04:09.491: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 11:04:09.491: INFO: kube-proxy-nodes-us-east1-b-rn9p started at 2023-01-16 10:34:56 +0000 UTC (0+1 container statuses recorded)
Jan 16 11:04:09.491: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 11:04:09.692: INFO: 
Latency metrics for node nodes-us-east1-b-rn9p
Jan 16 11:04:09.692: INFO: 
Logging node info for node nodes-us-east1-b-wcrf
Jan 16 11:04:09.728: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east1-b-wcrf    509e8852-b60d-4ccc-864a-4efd7f571608 55387 0 2023-01-16 10:35:00 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east1-b-wcrf kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east1-b topology.hostpath.csi/node:nodes-us-east1-b-wcrf topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/nodes-us-east1-b-wcrf"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.2/32 projectcalico.org/IPv4IPIPTunnelAddr:100.110.242.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-16 10:35:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:01 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-16 10:35:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {calico-node Update v1 2023-01-16 10:35:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-16 11:00:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/nodes-us-east1-b-wcrf,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:35:27 +0000 UTC,LastTransitionTime:2023-01-16 10:35:27 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 11:00:15 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 11:00:15 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 11:00:15 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 11:00:15 +0000 UTC,LastTransitionTime:2023-01-16 10:35:15 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.2,},NodeAddress{Type:ExternalIP,Address:35.237.110.203,},NodeAddress{Type:Hostname,Address:nodes-us-east1-b-wcrf,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:90256d4292845f855978b781ab31ded0,SystemUUID:90256d42-9284-5f85-5978-b781ab31ded0,BootID:b6764560-f26d-4d17-83ba-c17bdd70bced,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 16 11:04:09.728: INFO: 
Logging kubelet events for node nodes-us-east1-b-wcrf
Jan 16 11:04:09.767: INFO: 
Logging pods the kubelet thinks is on node nodes-us-east1-b-wcrf
Jan 16 11:04:09.807: INFO: calico-node-tvbl7 started at 2023-01-16 10:35:01 +0000 UTC (3+1 container statuses recorded)
Jan 16 11:04:09.807: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 11:04:09.807: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 11:04:09.807: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 11:04:09.807: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 11:04:09.807: INFO: kube-proxy-nodes-us-east1-b-wcrf started at 2023-01-16 10:34:57 +0000 UTC (0+1 container statuses recorded)
Jan 16 11:04:09.807: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 11:04:09.807: INFO: coredns-7bc44848df-rn2pc started at 2023-01-16 10:35:31 +0000 UTC (0+1 container statuses recorded)
Jan 16 11:04:09.807: INFO: 	Container coredns ready: true, restart count 0
Jan 16 11:04:09.807: INFO: csi-gce-pd-node-v2gwp started at 2023-01-16 10:35:01 +0000 UTC (0+2 container statuses recorded)
Jan 16 11:04:09.807: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 11:04:09.807: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 11:04:10.028: INFO: 
Latency metrics for node nodes-us-east1-b-wcrf
[DeferCleanup (Each)] [sig-network] DNS
  tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "dns-4230" for this suite. �[38;5;243m01/16/23 11:04:10.028�[0m

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-network] DNS should provide DNS for pods for Subdomain [Conformance] 20m22s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-network\]\sDNS\sshould\sprovide\sDNS\sfor\spods\sfor\sSubdomain\s\[Conformance\]$'

test/e2e/network/dns_common.go:455
k8s.io/kubernetes/test/e2e/network.assertFilesContain({0xc0032e9780?, 0x8?, 0x8?}, {0x75bfff4?, 0x7?}, 0xc003bce000?, {0x801e128?, 0xc004570820?}, 0x0?, {0x0, ...})
	test/e2e/network/dns_common.go:455 +0x1dc
k8s.io/kubernetes/test/e2e/network.assertFilesExist(...)
	test/e2e/network/dns_common.go:449
k8s.io/kubernetes/test/e2e/network.validateDNSResults(0xc000e6cf00, 0xc003bce000, {0xc0032e9780, 0x8, 0x8})
	test/e2e/network/dns_common.go:512 +0x452
k8s.io/kubernetes/test/e2e/network.glob..func2.8()
	test/e2e/network/dns.go:324 +0x985
				[BeforeEach] [sig-network] DNS
  set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/16/23 10:43:45.478�[0m
Jan 16 10:43:45.478: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename dns �[38;5;243m01/16/23 10:43:45.479�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/16/23 10:43:45.613�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/16/23 10:43:45.681�[0m
[BeforeEach] [sig-network] DNS
  test/e2e/framework/metrics/init/init.go:31
[It] should provide DNS for pods for Subdomain [Conformance]
  test/e2e/network/dns.go:290
�[1mSTEP:�[0m Creating a test headless service �[38;5;243m01/16/23 10:43:45.766�[0m
�[1mSTEP:�[0m Running these commands on wheezy: for i in `seq 1 600`; do check="$$(dig +notcp +noall +answer +search dns-querier-2.dns-test-service-2.dns-9123.svc.cluster.local A)" && test -n "$$check" && echo OK > /results/wheezy_udp@dns-querier-2.dns-test-service-2.dns-9123.svc.cluster.local;check="$$(dig +tcp +noall +answer +search dns-querier-2.dns-test-service-2.dns-9123.svc.cluster.local A)" && test -n "$$check" && echo OK > /results/wheezy_tcp@dns-querier-2.dns-test-service-2.dns-9123.svc.cluster.local;check="$$(dig +notcp +noall +answer +search dns-test-service-2.dns-9123.svc.cluster.local A)" && test -n "$$check" && echo OK > /results/wheezy_udp@dns-test-service-2.dns-9123.svc.cluster.local;check="$$(dig +tcp +noall +answer +search dns-test-service-2.dns-9123.svc.cluster.local A)" && test -n "$$check" && echo OK > /results/wheezy_tcp@dns-test-service-2.dns-9123.svc.cluster.local;sleep 1; done
 �[38;5;243m01/16/23 10:43:45.806�[0m
�[1mSTEP:�[0m Running these commands on jessie: for i in `seq 1 600`; do check="$$(dig +notcp +noall +answer +search dns-querier-2.dns-test-service-2.dns-9123.svc.cluster.local A)" && test -n "$$check" && echo OK > /results/jessie_udp@dns-querier-2.dns-test-service-2.dns-9123.svc.cluster.local;check="$$(dig +tcp +noall +answer +search dns-querier-2.dns-test-service-2.dns-9123.svc.cluster.local A)" && test -n "$$check" && echo OK > /results/jessie_tcp@dns-querier-2.dns-test-service-2.dns-9123.svc.cluster.local;check="$$(dig +notcp +noall +answer +search dns-test-service-2.dns-9123.svc.cluster.local A)" && test -n "$$check" && echo OK > /results/jessie_udp@dns-test-service-2.dns-9123.svc.cluster.local;check="$$(dig +tcp +noall +answer +search dns-test-service-2.dns-9123.svc.cluster.local A)" && test -n "$$check" && echo OK > /results/jessie_tcp@dns-test-service-2.dns-9123.svc.cluster.local;sleep 1; done
 �[38;5;243m01/16/23 10:43:45.806�[0m
�[1mSTEP:�[0m creating a pod to probe DNS �[38;5;243m01/16/23 10:43:45.806�[0m
�[1mSTEP:�[0m submitting the pod to kubernetes �[38;5;243m01/16/23 10:43:45.807�[0m
Jan 16 10:43:45.852: INFO: Waiting up to 15m0s for pod "dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1" in namespace "dns-9123" to be "running"
Jan 16 10:43:45.901: INFO: Pod "dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1": Phase="Pending", Reason="", readiness=false. Elapsed: 49.512448ms
Jan 16 10:43:47.937: INFO: Pod "dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1": Phase="Pending", Reason="", readiness=false. Elapsed: 2.084786789s
Jan 16 10:43:49.940: INFO: Pod "dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1": Phase="Running", Reason="", readiness=true. Elapsed: 4.088332305s
Jan 16 10:43:49.940: INFO: Pod "dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1" satisfied condition "running"
�[1mSTEP:�[0m retrieving the pod �[38;5;243m01/16/23 10:43:49.94�[0m
�[1mSTEP:�[0m looking for the results for each expected name from probers �[38;5;243m01/16/23 10:43:49.981�[0m
Jan 16 10:44:20.020: INFO: Unable to read wheezy_udp@dns-querier-2.dns-test-service-2.dns-9123.svc.cluster.local from pod dns-9123/dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1: the server is currently unable to handle the request (get pods dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1)
Jan 16 10:44:50.152: INFO: Unable to read wheezy_tcp@dns-querier-2.dns-test-service-2.dns-9123.svc.cluster.local from pod dns-9123/dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1: the server is currently unable to handle the request (get pods dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1)
Jan 16 10:45:20.188: INFO: Unable to read wheezy_udp@dns-test-service-2.dns-9123.svc.cluster.local from pod dns-9123/dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1: the server is currently unable to handle the request (get pods dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1)
Jan 16 10:45:50.223: INFO: Unable to read wheezy_tcp@dns-test-service-2.dns-9123.svc.cluster.local from pod dns-9123/dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1: the server is currently unable to handle the request (get pods dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1)
Jan 16 10:46:20.258: INFO: Unable to read jessie_udp@dns-querier-2.dns-test-service-2.dns-9123.svc.cluster.local from pod dns-9123/dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1: the server is currently unable to handle the request (get pods dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1)
Jan 16 10:46:50.294: INFO: Unable to read jessie_tcp@dns-querier-2.dns-test-service-2.dns-9123.svc.cluster.local from pod dns-9123/dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1: the server is currently unable to handle the request (get pods dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1)
Jan 16 10:47:20.332: INFO: Unable to read jessie_udp@dns-test-service-2.dns-9123.svc.cluster.local from pod dns-9123/dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1: the server is currently unable to handle the request (get pods dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1)
Jan 16 10:47:50.367: INFO: Unable to read jessie_tcp@dns-test-service-2.dns-9123.svc.cluster.local from pod dns-9123/dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1: the server is currently unable to handle the request (get pods dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1)
Jan 16 10:47:50.367: INFO: Lookups using dns-9123/dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1 failed for: [wheezy_udp@dns-querier-2.dns-test-service-2.dns-9123.svc.cluster.local wheezy_tcp@dns-querier-2.dns-test-service-2.dns-9123.svc.cluster.local wheezy_udp@dns-test-service-2.dns-9123.svc.cluster.local wheezy_tcp@dns-test-service-2.dns-9123.svc.cluster.local jessie_udp@dns-querier-2.dns-test-service-2.dns-9123.svc.cluster.local jessie_tcp@dns-querier-2.dns-test-service-2.dns-9123.svc.cluster.local jessie_udp@dns-test-service-2.dns-9123.svc.cluster.local jessie_tcp@dns-test-service-2.dns-9123.svc.cluster.local]

Jan 16 10:48:25.412: INFO: Unable to read wheezy_udp@dns-querier-2.dns-test-service-2.dns-9123.svc.cluster.local from pod dns-9123/dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1: the server is currently unable to handle the request (get pods dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1)
Jan 16 10:48:55.454: INFO: Unable to read wheezy_tcp@dns-querier-2.dns-test-service-2.dns-9123.svc.cluster.local from pod dns-9123/dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1: the server is currently unable to handle the request (get pods dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1)
Jan 16 10:49:25.491: INFO: Unable to read wheezy_udp@dns-test-service-2.dns-9123.svc.cluster.local from pod dns-9123/dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1: the server is currently unable to handle the request (get pods dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1)
Jan 16 10:49:55.532: INFO: Unable to read wheezy_tcp@dns-test-service-2.dns-9123.svc.cluster.local from pod dns-9123/dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1: the server is currently unable to handle the request (get pods dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1)
Jan 16 10:50:25.572: INFO: Unable to read jessie_udp@dns-querier-2.dns-test-service-2.dns-9123.svc.cluster.local from pod dns-9123/dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1: the server is currently unable to handle the request (get pods dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1)
Jan 16 10:50:55.686: INFO: Unable to read jessie_tcp@dns-querier-2.dns-test-service-2.dns-9123.svc.cluster.local from pod dns-9123/dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1: the server is currently unable to handle the request (get pods dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1)
Jan 16 10:51:26.122: INFO: Unable to read jessie_udp@dns-test-service-2.dns-9123.svc.cluster.local from pod dns-9123/dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1: the server is currently unable to handle the request (get pods dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1)
Jan 16 10:51:56.164: INFO: Unable to read jessie_tcp@dns-test-service-2.dns-9123.svc.cluster.local from pod dns-9123/dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1: the server is currently unable to handle the request (get pods dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1)
Jan 16 10:51:56.164: INFO: Lookups using dns-9123/dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1 failed for: [wheezy_udp@dns-querier-2.dns-test-service-2.dns-9123.svc.cluster.local wheezy_tcp@dns-querier-2.dns-test-service-2.dns-9123.svc.cluster.local wheezy_udp@dns-test-service-2.dns-9123.svc.cluster.local wheezy_tcp@dns-test-service-2.dns-9123.svc.cluster.local jessie_udp@dns-querier-2.dns-test-service-2.dns-9123.svc.cluster.local jessie_tcp@dns-querier-2.dns-test-service-2.dns-9123.svc.cluster.local jessie_udp@dns-test-service-2.dns-9123.svc.cluster.local jessie_tcp@dns-test-service-2.dns-9123.svc.cluster.local]

Jan 16 10:52:30.414: INFO: Unable to read wheezy_udp@dns-querier-2.dns-test-service-2.dns-9123.svc.cluster.local from pod dns-9123/dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1: the server is currently unable to handle the request (get pods dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1)
Jan 16 10:53:00.483: INFO: Unable to read wheezy_tcp@dns-querier-2.dns-test-service-2.dns-9123.svc.cluster.local from pod dns-9123/dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1: the server is currently unable to handle the request (get pods dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1)
Jan 16 10:53:30.518: INFO: Unable to read wheezy_udp@dns-test-service-2.dns-9123.svc.cluster.local from pod dns-9123/dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1: the server is currently unable to handle the request (get pods dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1)
Jan 16 10:54:00.555: INFO: Unable to read wheezy_tcp@dns-test-service-2.dns-9123.svc.cluster.local from pod dns-9123/dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1: the server is currently unable to handle the request (get pods dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1)
Jan 16 10:54:30.593: INFO: Unable to read jessie_udp@dns-querier-2.dns-test-service-2.dns-9123.svc.cluster.local from pod dns-9123/dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1: the server is currently unable to handle the request (get pods dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1)
Jan 16 10:55:00.629: INFO: Unable to read jessie_tcp@dns-querier-2.dns-test-service-2.dns-9123.svc.cluster.local from pod dns-9123/dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1: the server is currently unable to handle the request (get pods dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1)
Jan 16 10:55:30.668: INFO: Unable to read jessie_udp@dns-test-service-2.dns-9123.svc.cluster.local from pod dns-9123/dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1: the server is currently unable to handle the request (get pods dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1)
Jan 16 10:56:00.703: INFO: Unable to read jessie_tcp@dns-test-service-2.dns-9123.svc.cluster.local from pod dns-9123/dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1: the server is currently unable to handle the request (get pods dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1)
Jan 16 10:56:00.703: INFO: Lookups using dns-9123/dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1 failed for: [wheezy_udp@dns-querier-2.dns-test-service-2.dns-9123.svc.cluster.local wheezy_tcp@dns-querier-2.dns-test-service-2.dns-9123.svc.cluster.local wheezy_udp@dns-test-service-2.dns-9123.svc.cluster.local wheezy_tcp@dns-test-service-2.dns-9123.svc.cluster.local jessie_udp@dns-querier-2.dns-test-service-2.dns-9123.svc.cluster.local jessie_tcp@dns-querier-2.dns-test-service-2.dns-9123.svc.cluster.local jessie_udp@dns-test-service-2.dns-9123.svc.cluster.local jessie_tcp@dns-test-service-2.dns-9123.svc.cluster.local]

Jan 16 10:56:35.433: INFO: Unable to read wheezy_udp@dns-querier-2.dns-test-service-2.dns-9123.svc.cluster.local from pod dns-9123/dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1: the server is currently unable to handle the request (get pods dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1)
Jan 16 10:57:05.476: INFO: Unable to read wheezy_tcp@dns-querier-2.dns-test-service-2.dns-9123.svc.cluster.local from pod dns-9123/dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1: the server is currently unable to handle the request (get pods dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1)
Jan 16 10:57:35.514: INFO: Unable to read wheezy_udp@dns-test-service-2.dns-9123.svc.cluster.local from pod dns-9123/dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1: the server is currently unable to handle the request (get pods dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1)
Jan 16 10:58:05.550: INFO: Unable to read wheezy_tcp@dns-test-service-2.dns-9123.svc.cluster.local from pod dns-9123/dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1: the server is currently unable to handle the request (get pods dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1)
Jan 16 10:58:35.610: INFO: Unable to read jessie_udp@dns-querier-2.dns-test-service-2.dns-9123.svc.cluster.local from pod dns-9123/dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1: the server is currently unable to handle the request (get pods dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1)
Jan 16 10:59:05.645: INFO: Unable to read jessie_tcp@dns-querier-2.dns-test-service-2.dns-9123.svc.cluster.local from pod dns-9123/dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1: the server is currently unable to handle the request (get pods dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1)
Jan 16 10:59:35.681: INFO: Unable to read jessie_udp@dns-test-service-2.dns-9123.svc.cluster.local from pod dns-9123/dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1: the server is currently unable to handle the request (get pods dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1)
Jan 16 11:00:05.719: INFO: Unable to read jessie_tcp@dns-test-service-2.dns-9123.svc.cluster.local from pod dns-9123/dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1: the server is currently unable to handle the request (get pods dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1)
Jan 16 11:00:05.719: INFO: Lookups using dns-9123/dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1 failed for: [wheezy_udp@dns-querier-2.dns-test-service-2.dns-9123.svc.cluster.local wheezy_tcp@dns-querier-2.dns-test-service-2.dns-9123.svc.cluster.local wheezy_udp@dns-test-service-2.dns-9123.svc.cluster.local wheezy_tcp@dns-test-service-2.dns-9123.svc.cluster.local jessie_udp@dns-querier-2.dns-test-service-2.dns-9123.svc.cluster.local jessie_tcp@dns-querier-2.dns-test-service-2.dns-9123.svc.cluster.local jessie_udp@dns-test-service-2.dns-9123.svc.cluster.local jessie_tcp@dns-test-service-2.dns-9123.svc.cluster.local]

Jan 16 11:00:35.756: INFO: Unable to read wheezy_udp@dns-querier-2.dns-test-service-2.dns-9123.svc.cluster.local from pod dns-9123/dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1: the server is currently unable to handle the request (get pods dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1)
Jan 16 11:01:05.849: INFO: Unable to read wheezy_tcp@dns-querier-2.dns-test-service-2.dns-9123.svc.cluster.local from pod dns-9123/dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1: the server is currently unable to handle the request (get pods dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1)
Jan 16 11:01:35.954: INFO: Unable to read wheezy_udp@dns-test-service-2.dns-9123.svc.cluster.local from pod dns-9123/dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1: the server is currently unable to handle the request (get pods dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1)
Jan 16 11:02:05.991: INFO: Unable to read wheezy_tcp@dns-test-service-2.dns-9123.svc.cluster.local from pod dns-9123/dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1: the server is currently unable to handle the request (get pods dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1)
Jan 16 11:02:36.027: INFO: Unable to read jessie_udp@dns-querier-2.dns-test-service-2.dns-9123.svc.cluster.local from pod dns-9123/dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1: the server is currently unable to handle the request (get pods dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1)
Jan 16 11:03:06.062: INFO: Unable to read jessie_tcp@dns-querier-2.dns-test-service-2.dns-9123.svc.cluster.local from pod dns-9123/dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1: the server is currently unable to handle the request (get pods dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1)
Jan 16 11:03:36.098: INFO: Unable to read jessie_udp@dns-test-service-2.dns-9123.svc.cluster.local from pod dns-9123/dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1: the server is currently unable to handle the request (get pods dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1)
Jan 16 11:04:06.141: INFO: Unable to read jessie_tcp@dns-test-service-2.dns-9123.svc.cluster.local from pod dns-9123/dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1: the server is currently unable to handle the request (get pods dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1)
Jan 16 11:04:06.141: INFO: Lookups using dns-9123/dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1 failed for: [wheezy_udp@dns-querier-2.dns-test-service-2.dns-9123.svc.cluster.local wheezy_tcp@dns-querier-2.dns-test-service-2.dns-9123.svc.cluster.local wheezy_udp@dns-test-service-2.dns-9123.svc.cluster.local wheezy_tcp@dns-test-service-2.dns-9123.svc.cluster.local jessie_udp@dns-querier-2.dns-test-service-2.dns-9123.svc.cluster.local jessie_tcp@dns-querier-2.dns-test-service-2.dns-9123.svc.cluster.local jessie_udp@dns-test-service-2.dns-9123.svc.cluster.local jessie_tcp@dns-test-service-2.dns-9123.svc.cluster.local]

Jan 16 11:04:06.141: INFO: Unexpected error: 
    <*errors.errorString | 0xc0001f1a40>: {
        s: "timed out waiting for the condition",
    }
Jan 16 11:04:06.141: FAIL: timed out waiting for the condition

Full Stack Trace
k8s.io/kubernetes/test/e2e/network.assertFilesContain({0xc0032e9780?, 0x8?, 0x8?}, {0x75bfff4?, 0x7?}, 0xc003bce000?, {0x801e128?, 0xc004570820?}, 0x0?, {0x0, ...})
	test/e2e/network/dns_common.go:455 +0x1dc
k8s.io/kubernetes/test/e2e/network.assertFilesExist(...)
	test/e2e/network/dns_common.go:449
k8s.io/kubernetes/test/e2e/network.validateDNSResults(0xc000e6cf00, 0xc003bce000, {0xc0032e9780, 0x8, 0x8})
	test/e2e/network/dns_common.go:512 +0x452
k8s.io/kubernetes/test/e2e/network.glob..func2.8()
	test/e2e/network/dns.go:324 +0x985
�[1mSTEP:�[0m deleting the pod �[38;5;243m01/16/23 11:04:06.141�[0m
�[1mSTEP:�[0m deleting the test headless service �[38;5;243m01/16/23 11:04:06.199�[0m
[AfterEach] [sig-network] DNS
  test/e2e/framework/node/init/init.go:32
Jan 16 11:04:06.248: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-network] DNS
  test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-network] DNS
  dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/16/23 11:04:06.29�[0m
�[1mSTEP:�[0m Collecting events from namespace "dns-9123". �[38;5;243m01/16/23 11:04:06.29�[0m
�[1mSTEP:�[0m Found 13 events. �[38;5;243m01/16/23 11:04:06.327�[0m
Jan 16 11:04:06.327: INFO: At 2023-01-16 10:43:45 +0000 UTC - event for dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1: {default-scheduler } Scheduled: Successfully assigned dns-9123/dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1 to nodes-us-east1-b-2xs4
Jan 16 11:04:06.327: INFO: At 2023-01-16 10:43:47 +0000 UTC - event for dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1: {kubelet nodes-us-east1-b-2xs4} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine
Jan 16 11:04:06.327: INFO: At 2023-01-16 10:43:47 +0000 UTC - event for dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1: {kubelet nodes-us-east1-b-2xs4} Created: Created container webserver
Jan 16 11:04:06.327: INFO: At 2023-01-16 10:43:47 +0000 UTC - event for dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1: {kubelet nodes-us-east1-b-2xs4} Started: Started container webserver
Jan 16 11:04:06.327: INFO: At 2023-01-16 10:43:47 +0000 UTC - event for dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1: {kubelet nodes-us-east1-b-2xs4} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine
Jan 16 11:04:06.327: INFO: At 2023-01-16 10:43:47 +0000 UTC - event for dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1: {kubelet nodes-us-east1-b-2xs4} Created: Created container querier
Jan 16 11:04:06.327: INFO: At 2023-01-16 10:43:47 +0000 UTC - event for dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1: {kubelet nodes-us-east1-b-2xs4} Started: Started container querier
Jan 16 11:04:06.327: INFO: At 2023-01-16 10:43:47 +0000 UTC - event for dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1: {kubelet nodes-us-east1-b-2xs4} Pulled: Container image "registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7" already present on machine
Jan 16 11:04:06.327: INFO: At 2023-01-16 10:43:47 +0000 UTC - event for dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1: {kubelet nodes-us-east1-b-2xs4} Created: Created container jessie-querier
Jan 16 11:04:06.327: INFO: At 2023-01-16 10:43:47 +0000 UTC - event for dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1: {kubelet nodes-us-east1-b-2xs4} Started: Started container jessie-querier
Jan 16 11:04:06.327: INFO: At 2023-01-16 11:04:06 +0000 UTC - event for dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1: {kubelet nodes-us-east1-b-2xs4} Killing: Stopping container webserver
Jan 16 11:04:06.327: INFO: At 2023-01-16 11:04:06 +0000 UTC - event for dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1: {kubelet nodes-us-east1-b-2xs4} Killing: Stopping container querier
Jan 16 11:04:06.327: INFO: At 2023-01-16 11:04:06 +0000 UTC - event for dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1: {kubelet nodes-us-east1-b-2xs4} Killing: Stopping container jessie-querier
Jan 16 11:04:06.362: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Jan 16 11:04:06.362: INFO: 
Jan 16 11:04:06.404: INFO: 
Logging node info for node control-plane-us-east1-b-nc4v
Jan 16 11:04:06.440: INFO: Node Info: &Node{ObjectMeta:{control-plane-us-east1-b-nc4v    3e043433-4a0a-4797-aed2-d532c70362c4 55531 0 2023-01-16 10:33:51 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-standard-2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:control-plane-us-east1-b-nc4v kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node-role.kubernetes.io/node: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:e2-standard-2 topology.gke.io/zone:us-east1-b topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/control-plane-us-east1-b-nc4v"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.4/32 projectcalico.org/IPv4IPIPTunnelAddr:100.126.126.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-16 10:33:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-16 10:34:31 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:34:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {calico-node Update v1 2023-01-16 10:34:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-16 10:34:51 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:34:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:34:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-16 11:00:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/control-plane-us-east1-b-nc4v,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8332767232 0} {<nil>} 8137468Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8227909632 0} {<nil>} 8035068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:34:56 +0000 UTC,LastTransitionTime:2023-01-16 10:34:56 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 11:00:34 +0000 UTC,LastTransitionTime:2023-01-16 10:33:51 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 11:00:34 +0000 UTC,LastTransitionTime:2023-01-16 10:33:51 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 11:00:34 +0000 UTC,LastTransitionTime:2023-01-16 10:33:51 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 11:00:34 +0000 UTC,LastTransitionTime:2023-01-16 10:34:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.4,},NodeAddress{Type:ExternalIP,Address:35.243.145.107,},NodeAddress{Type:Hostname,Address:control-plane-us-east1-b-nc4v,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e5ac4d7bf983c1b4a0fb9c7211b86ad9,SystemUUID:e5ac4d7b-f983-c1b4-a0fb-9c7211b86ad9,BootID:66119c47-44e2-4c4c-ac93-902592bb3d86,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.0],SizeBytes:135162323,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.0],SizeBytes:124991801,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.0],SizeBytes:57657656,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43637878,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42802014,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:2b6acd7f677f76ffe12ecf3ea7df92eb9b1bdb07336d1ac2a54c7631fb753f7e docker.io/calico/kube-controllers:v3.24.5],SizeBytes:31137169,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2 registry.k8s.io/sig-storage/csi-provisioner:v2.1.0],SizeBytes:21205045,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:50c3cfd458fc8e0bf3c8c521eac39172009382fc66dc5044a330d137c6ed0b09 registry.k8s.io/sig-storage/csi-attacher:v3.1.0],SizeBytes:20103959,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a registry.k8s.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:9af9bf28430b00a0cedeb2ec29acadce45e6afcecd8bdf31c793c624cfa75fa7 registry.k8s.io/sig-storage/csi-snapshotter:v3.0.3],SizeBytes:19500777,},ContainerImage{Names:[docker.io/k8scloudprovidergcp/cloud-controller-manager@sha256:881fd1095937638040723973ade90e6700f1c831a78fb585a3227c4d021b0df9 docker.io/k8scloudprovidergcp/cloud-controller-manager:latest],SizeBytes:18702875,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4967322,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 16 11:04:06.441: INFO: 
Logging kubelet events for node control-plane-us-east1-b-nc4v
Jan 16 11:04:06.479: INFO: 
Logging pods the kubelet thinks is on node control-plane-us-east1-b-nc4v
Jan 16 11:04:06.554: INFO: kube-controller-manager-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 11:04:06.554: INFO: 	Container kube-controller-manager ready: true, restart count 2
Jan 16 11:04:06.554: INFO: kube-proxy-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 11:04:06.554: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 11:04:06.554: INFO: calico-node-5jgkc started at 2023-01-16 10:34:24 +0000 UTC (3+1 container statuses recorded)
Jan 16 11:04:06.554: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 11:04:06.554: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 11:04:06.554: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 11:04:06.554: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 11:04:06.554: INFO: cloud-controller-manager-b5qds started at 2023-01-16 10:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 16 11:04:06.554: INFO: 	Container cloud-controller-manager ready: true, restart count 0
Jan 16 11:04:06.554: INFO: kube-scheduler-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 11:04:06.554: INFO: 	Container kube-scheduler ready: true, restart count 0
Jan 16 11:04:06.554: INFO: kube-apiserver-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+2 container statuses recorded)
Jan 16 11:04:06.554: INFO: 	Container healthcheck ready: true, restart count 0
Jan 16 11:04:06.554: INFO: 	Container kube-apiserver ready: true, restart count 1
Jan 16 11:04:06.554: INFO: dns-controller-6d5f4bf5d6-kqf4d started at 2023-01-16 10:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 16 11:04:06.554: INFO: 	Container dns-controller ready: true, restart count 0
Jan 16 11:04:06.554: INFO: calico-kube-controllers-55f488656-hcbkw started at 2023-01-16 10:34:50 +0000 UTC (0+1 container statuses recorded)
Jan 16 11:04:06.554: INFO: 	Container calico-kube-controllers ready: true, restart count 0
Jan 16 11:04:06.554: INFO: kops-controller-smdjr started at 2023-01-16 10:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 16 11:04:06.554: INFO: 	Container kops-controller ready: true, restart count 0
Jan 16 11:04:06.554: INFO: etcd-manager-events-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 11:04:06.554: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 16 11:04:06.554: INFO: etcd-manager-main-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 11:04:06.554: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 16 11:04:06.554: INFO: csi-gce-pd-node-kz9xf started at 2023-01-16 10:34:14 +0000 UTC (0+2 container statuses recorded)
Jan 16 11:04:06.554: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 11:04:06.554: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 11:04:06.554: INFO: csi-gce-pd-controller-78fc966fff-m86hh started at 2023-01-16 10:34:31 +0000 UTC (0+5 container statuses recorded)
Jan 16 11:04:06.554: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 16 11:04:06.554: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 16 11:04:06.554: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 16 11:04:06.554: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 16 11:04:06.554: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 11:04:06.747: INFO: 
Latency metrics for node control-plane-us-east1-b-nc4v
Jan 16 11:04:06.747: INFO: 
Logging node info for node nodes-us-east1-b-2xs4
Jan 16 11:04:06.783: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east1-b-2xs4    5523b1af-a125-4437-baf4-a87ff6e2a424 55689 0 2023-01-16 10:35:00 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east1-b-2xs4 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east1-b topology.hostpath.csi/node:nodes-us-east1-b-2xs4 topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/nodes-us-east1-b-2xs4"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.6/32 projectcalico.org/IPv4IPIPTunnelAddr:100.123.6.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2023-01-16 10:35:00 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2023-01-16 10:35:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-16 10:35:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {calico-node Update v1 2023-01-16 10:35:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-16 11:01:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/nodes-us-east1-b-2xs4,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:35:32 +0000 UTC,LastTransitionTime:2023-01-16 10:35:32 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 11:01:06 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 11:01:06 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 11:01:06 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 11:01:06 +0000 UTC,LastTransitionTime:2023-01-16 10:35:20 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.6,},NodeAddress{Type:ExternalIP,Address:35.196.42.74,},NodeAddress{Type:Hostname,Address:nodes-us-east1-b-2xs4,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:39f2b9ba1d525f08f837cadb4248f14d,SystemUUID:39f2b9ba-1d52-5f08-f837-cadb4248f14d,BootID:7acec4fd-f02a-4704-a113-25a81be183ce,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 16 11:04:06.784: INFO: 
Logging kubelet events for node nodes-us-east1-b-2xs4
Jan 16 11:04:06.822: INFO: 
Logging pods the kubelet thinks is on node nodes-us-east1-b-2xs4
Jan 16 11:04:06.876: INFO: kube-proxy-nodes-us-east1-b-2xs4 started at 2023-01-16 10:34:50 +0000 UTC (0+1 container statuses recorded)
Jan 16 11:04:06.876: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 11:04:06.876: INFO: csi-gce-pd-node-jc8jn started at 2023-01-16 10:35:10 +0000 UTC (0+2 container statuses recorded)
Jan 16 11:04:06.876: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 11:04:06.876: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 11:04:06.876: INFO: calico-node-qlnmx started at 2023-01-16 10:35:10 +0000 UTC (3+1 container statuses recorded)
Jan 16 11:04:06.876: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 11:04:06.876: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 11:04:06.876: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 11:04:06.876: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 11:04:06.876: INFO: dns-test-9ac02aeb-ccb8-4dbf-a031-3f8abf3c41bb started at 2023-01-16 10:56:17 +0000 UTC (0+3 container statuses recorded)
Jan 16 11:04:06.876: INFO: 	Container jessie-querier ready: true, restart count 0
Jan 16 11:04:06.876: INFO: 	Container querier ready: true, restart count 0
Jan 16 11:04:06.876: INFO: 	Container webserver ready: true, restart count 0
Jan 16 11:04:06.876: INFO: agnhost started at 2023-01-16 10:46:16 +0000 UTC (0+1 container statuses recorded)
Jan 16 11:04:06.876: INFO: 	Container agnhost ready: true, restart count 0
Jan 16 11:04:06.876: INFO: proxy-service-cgkvp-fj8m5 started at 2023-01-16 10:54:34 +0000 UTC (0+1 container statuses recorded)
Jan 16 11:04:06.876: INFO: 	Container proxy-service-cgkvp ready: true, restart count 0
Jan 16 11:04:07.111: INFO: 
Latency metrics for node nodes-us-east1-b-2xs4
Jan 16 11:04:07.112: INFO: 
Logging node info for node nodes-us-east1-b-9h4h
Jan 16 11:04:07.147: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east1-b-9h4h    672ac3b7-ea1d-4e3e-bd88-42fa1b6384a8 54576 0 2023-01-16 10:34:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east1-b-9h4h kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east1-b topology.hostpath.csi/node:nodes-us-east1-b-9h4h topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/nodes-us-east1-b-9h4h"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.5/32 projectcalico.org/IPv4IPIPTunnelAddr:100.103.14.192 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-16 10:34:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:34:59 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-16 10:34:59 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:35:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {calico-node Update v1 2023-01-16 10:35:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-16 10:59:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/nodes-us-east1-b-9h4h,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:35:24 +0000 UTC,LastTransitionTime:2023-01-16 10:35:24 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 10:59:30 +0000 UTC,LastTransitionTime:2023-01-16 10:34:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 10:59:30 +0000 UTC,LastTransitionTime:2023-01-16 10:34:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 10:59:30 +0000 UTC,LastTransitionTime:2023-01-16 10:34:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 10:59:30 +0000 UTC,LastTransitionTime:2023-01-16 10:35:13 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.5,},NodeAddress{Type:ExternalIP,Address:35.196.180.243,},NodeAddress{Type:Hostname,Address:nodes-us-east1-b-9h4h,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:828dcdb67e74b8a327b01dc0797be5e1,SystemUUID:828dcdb6-7e74-b8a3-27b0-1dc0797be5e1,BootID:dd05deb0-ef00-47e1-83af-c902277fe4b7,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 16 11:04:07.148: INFO: 
Logging kubelet events for node nodes-us-east1-b-9h4h
Jan 16 11:04:07.186: INFO: 
Logging pods the kubelet thinks is on node nodes-us-east1-b-9h4h
Jan 16 11:04:07.229: INFO: csi-gce-pd-node-ncgj4 started at 2023-01-16 10:35:01 +0000 UTC (0+2 container statuses recorded)
Jan 16 11:04:07.229: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 11:04:07.229: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 11:04:07.229: INFO: calico-node-gmwsc started at 2023-01-16 10:35:01 +0000 UTC (3+1 container statuses recorded)
Jan 16 11:04:07.229: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 11:04:07.229: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 11:04:07.229: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 11:04:07.229: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 11:04:07.229: INFO: coredns-autoscaler-7cb5c5b969-mpv8x started at 2023-01-16 10:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 16 11:04:07.229: INFO: 	Container autoscaler ready: true, restart count 0
Jan 16 11:04:07.229: INFO: coredns-7bc44848df-zs55k started at 2023-01-16 10:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 16 11:04:07.229: INFO: 	Container coredns ready: true, restart count 0
Jan 16 11:04:07.229: INFO: dns-test-e70f4979-a17e-4b6c-ad4a-72a960ea3a94 started at 2023-01-16 10:49:18 +0000 UTC (0+3 container statuses recorded)
Jan 16 11:04:07.229: INFO: 	Container jessie-querier ready: true, restart count 1
Jan 16 11:04:07.229: INFO: 	Container querier ready: true, restart count 1
Jan 16 11:04:07.229: INFO: 	Container webserver ready: true, restart count 0
Jan 16 11:04:07.229: INFO: kube-proxy-nodes-us-east1-b-9h4h started at 2023-01-16 10:34:55 +0000 UTC (0+1 container statuses recorded)
Jan 16 11:04:07.229: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 11:04:07.437: INFO: 
Latency metrics for node nodes-us-east1-b-9h4h
Jan 16 11:04:07.437: INFO: 
Logging node info for node nodes-us-east1-b-rn9p
Jan 16 11:04:07.473: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east1-b-rn9p    59f4f25d-24bf-4d96-a4bf-2cf266b5c083 55992 0 2023-01-16 10:34:59 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east1-b-rn9p kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east1-b topology.hostpath.csi/node:nodes-us-east1-b-rn9p topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/nodes-us-east1-b-rn9p"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.3/32 projectcalico.org/IPv4IPIPTunnelAddr:100.98.60.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-16 10:34:59 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:00 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-16 10:35:01 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {calico-node Update v1 2023-01-16 10:35:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-16 11:02:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/nodes-us-east1-b-rn9p,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:35:26 +0000 UTC,LastTransitionTime:2023-01-16 10:35:26 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 11:02:00 +0000 UTC,LastTransitionTime:2023-01-16 10:34:59 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 11:02:00 +0000 UTC,LastTransitionTime:2023-01-16 10:34:59 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 11:02:00 +0000 UTC,LastTransitionTime:2023-01-16 10:34:59 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 11:02:00 +0000 UTC,LastTransitionTime:2023-01-16 10:35:14 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.3,},NodeAddress{Type:ExternalIP,Address:34.75.49.181,},NodeAddress{Type:Hostname,Address:nodes-us-east1-b-rn9p,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:9f39c983773df4ca6a15315227d6fd51,SystemUUID:9f39c983-773d-f4ca-6a15-315227d6fd51,BootID:7e9ad329-1a6b-4405-ba71-ca92e45658b3,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:c0ddb4794bc8a3631e3373015f913c00b230ee54f87bde9ade195b3a3415c60f registry.k8s.io/build-image/distroless-iptables:v0.1.2],SizeBytes:7685585,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 16 11:04:07.473: INFO: 
Logging kubelet events for node nodes-us-east1-b-rn9p
Jan 16 11:04:07.513: INFO: 
Logging pods the kubelet thinks is on node nodes-us-east1-b-rn9p
Jan 16 11:04:07.553: INFO: calico-node-ntgj5 started at 2023-01-16 10:35:03 +0000 UTC (3+1 container statuses recorded)
Jan 16 11:04:07.553: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 11:04:07.553: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 11:04:07.553: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 11:04:07.553: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 11:04:07.553: INFO: csi-gce-pd-node-88f4v started at 2023-01-16 10:35:03 +0000 UTC (0+2 container statuses recorded)
Jan 16 11:04:07.553: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 11:04:07.553: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 11:04:07.553: INFO: kube-proxy-nodes-us-east1-b-rn9p started at 2023-01-16 10:34:56 +0000 UTC (0+1 container statuses recorded)
Jan 16 11:04:07.553: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 11:04:07.761: INFO: 
Latency metrics for node nodes-us-east1-b-rn9p
Jan 16 11:04:07.761: INFO: 
Logging node info for node nodes-us-east1-b-wcrf
Jan 16 11:04:07.797: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east1-b-wcrf    509e8852-b60d-4ccc-864a-4efd7f571608 55387 0 2023-01-16 10:35:00 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east1-b-wcrf kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east1-b topology.hostpath.csi/node:nodes-us-east1-b-wcrf topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/nodes-us-east1-b-wcrf"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.2/32 projectcalico.org/IPv4IPIPTunnelAddr:100.110.242.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-16 10:35:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:01 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-16 10:35:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {calico-node Update v1 2023-01-16 10:35:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-16 11:00:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/nodes-us-east1-b-wcrf,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:35:27 +0000 UTC,LastTransitionTime:2023-01-16 10:35:27 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 11:00:15 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 11:00:15 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 11:00:15 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 11:00:15 +0000 UTC,LastTransitionTime:2023-01-16 10:35:15 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.2,},NodeAddress{Type:ExternalIP,Address:35.237.110.203,},NodeAddress{Type:Hostname,Address:nodes-us-east1-b-wcrf,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:90256d4292845f855978b781ab31ded0,SystemUUID:90256d42-9284-5f85-5978-b781ab31ded0,BootID:b6764560-f26d-4d17-83ba-c17bdd70bced,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 16 11:04:07.797: INFO: 
Logging kubelet events for node nodes-us-east1-b-wcrf
Jan 16 11:04:07.836: INFO: 
Logging pods the kubelet thinks is on node nodes-us-east1-b-wcrf
Jan 16 11:04:07.877: INFO: kube-proxy-nodes-us-east1-b-wcrf started at 2023-01-16 10:34:57 +0000 UTC (0+1 container statuses recorded)
Jan 16 11:04:07.877: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 11:04:07.877: INFO: coredns-7bc44848df-rn2pc started at 2023-01-16 10:35:31 +0000 UTC (0+1 container statuses recorded)
Jan 16 11:04:07.877: INFO: 	Container coredns ready: true, restart count 0
Jan 16 11:04:07.877: INFO: csi-gce-pd-node-v2gwp started at 2023-01-16 10:35:01 +0000 UTC (0+2 container statuses recorded)
Jan 16 11:04:07.877: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 11:04:07.877: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 11:04:07.877: INFO: calico-node-tvbl7 started at 2023-01-16 10:35:01 +0000 UTC (3+1 container statuses recorded)
Jan 16 11:04:07.877: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 11:04:07.877: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 11:04:07.877: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 11:04:07.877: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 11:04:08.091: INFO: 
Latency metrics for node nodes-us-east1-b-wcrf
[DeferCleanup (Each)] [sig-network] DNS
  tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "dns-9123" for this suite. �[38;5;243m01/16/23 11:04:08.091�[0m

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-network] DNS should provide DNS for services [Conformance] 5m10s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-network\]\sDNS\sshould\sprovide\sDNS\sfor\sservices\s\s\[Conformance\]$'

test/e2e/network/dns_common.go:472
k8s.io/kubernetes/test/e2e/network.assertFilesContain.func1()
	test/e2e/network/dns_common.go:472 +0x845
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.ConditionFunc.WithContext.func1({0x18, 0xc000100400})
	vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:222 +0x1b
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext({0x7fe0e68?, 0xc000082048?}, 0xc0017ee7d8?)
	vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:235 +0x57
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.poll({0x7fe0e68, 0xc000082048}, 0x18?, 0x2fda505?, 0x60?)
	vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:582 +0x38
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediateWithContext({0x7fe0e68, 0xc000082048}, 0x7f8f998?, 0xc0017ee868?, 0x262a967?)
	vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:528 +0x4a
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediate(0x1e?, 0x1ff?, 0x0?)
	vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:514 +0x50
k8s.io/kubernetes/test/e2e/network.assertFilesContain({0xc00302b380, 0x10, 0x18}, {0x75bfff4, 0x7}, 0xc0034f7200, {0x801e128?, 0xc002cae4e0}, 0x0, {0x0, ...})
	test/e2e/network/dns_common.go:455 +0x1c5
k8s.io/kubernetes/test/e2e/network.assertFilesExist(...)
	test/e2e/network/dns_common.go:449
k8s.io/kubernetes/test/e2e/network.validateDNSResults(0xc000a42e10, 0xc0034f7200, {0xc00302b380, 0x10, 0x18})
	test/e2e/network/dns_common.go:512 +0x452
k8s.io/kubernetes/test/e2e/network.glob..func2.5()
	test/e2e/network/dns.go:184 +0xc45
				[BeforeEach] [sig-network] DNS
  set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/16/23 10:41:44.436�[0m
Jan 16 10:41:44.436: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename dns �[38;5;243m01/16/23 10:41:44.437�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/16/23 10:41:44.544�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/16/23 10:41:44.611�[0m
[BeforeEach] [sig-network] DNS
  test/e2e/framework/metrics/init/init.go:31
[It] should provide DNS for services  [Conformance]
  test/e2e/network/dns.go:137
�[1mSTEP:�[0m Creating a test headless service �[38;5;243m01/16/23 10:41:44.685�[0m
�[1mSTEP:�[0m Running these commands on wheezy: for i in `seq 1 600`; do check="$$(dig +notcp +noall +answer +search dns-test-service.dns-3438.svc.cluster.local A)" && test -n "$$check" && echo OK > /results/wheezy_udp@dns-test-service.dns-3438.svc.cluster.local;check="$$(dig +tcp +noall +answer +search dns-test-service.dns-3438.svc.cluster.local A)" && test -n "$$check" && echo OK > /results/wheezy_tcp@dns-test-service.dns-3438.svc.cluster.local;check="$$(dig +notcp +noall +answer +search _http._tcp.dns-test-service.dns-3438.svc.cluster.local SRV)" && test -n "$$check" && echo OK > /results/wheezy_udp@_http._tcp.dns-test-service.dns-3438.svc.cluster.local;check="$$(dig +tcp +noall +answer +search _http._tcp.dns-test-service.dns-3438.svc.cluster.local SRV)" && test -n "$$check" && echo OK > /results/wheezy_tcp@_http._tcp.dns-test-service.dns-3438.svc.cluster.local;check="$$(dig +notcp +noall +answer +search _http._tcp.test-service-2.dns-3438.svc.cluster.local SRV)" && test -n "$$check" && echo OK > /results/wheezy_udp@_http._tcp.test-service-2.dns-3438.svc.cluster.local;check="$$(dig +tcp +noall +answer +search _http._tcp.test-service-2.dns-3438.svc.cluster.local SRV)" && test -n "$$check" && echo OK > /results/wheezy_tcp@_http._tcp.test-service-2.dns-3438.svc.cluster.local;check="$$(dig +notcp +noall +answer +search 156.198.68.100.in-addr.arpa. PTR)" && test -n "$$check" && echo OK > /results/100.68.198.156_udp@PTR;check="$$(dig +tcp +noall +answer +search 156.198.68.100.in-addr.arpa. PTR)" && test -n "$$check" && echo OK > /results/100.68.198.156_tcp@PTR;sleep 1; done
 �[38;5;243m01/16/23 10:41:44.807�[0m
�[1mSTEP:�[0m Running these commands on jessie: for i in `seq 1 600`; do check="$$(dig +notcp +noall +answer +search dns-test-service.dns-3438.svc.cluster.local A)" && test -n "$$check" && echo OK > /results/jessie_udp@dns-test-service.dns-3438.svc.cluster.local;check="$$(dig +tcp +noall +answer +search dns-test-service.dns-3438.svc.cluster.local A)" && test -n "$$check" && echo OK > /results/jessie_tcp@dns-test-service.dns-3438.svc.cluster.local;check="$$(dig +notcp +noall +answer +search _http._tcp.dns-test-service.dns-3438.svc.cluster.local SRV)" && test -n "$$check" && echo OK > /results/jessie_udp@_http._tcp.dns-test-service.dns-3438.svc.cluster.local;check="$$(dig +tcp +noall +answer +search _http._tcp.dns-test-service.dns-3438.svc.cluster.local SRV)" && test -n "$$check" && echo OK > /results/jessie_tcp@_http._tcp.dns-test-service.dns-3438.svc.cluster.local;check="$$(dig +notcp +noall +answer +search _http._tcp.test-service-2.dns-3438.svc.cluster.local SRV)" && test -n "$$check" && echo OK > /results/jessie_udp@_http._tcp.test-service-2.dns-3438.svc.cluster.local;check="$$(dig +tcp +noall +answer +search _http._tcp.test-service-2.dns-3438.svc.cluster.local SRV)" && test -n "$$check" && echo OK > /results/jessie_tcp@_http._tcp.test-service-2.dns-3438.svc.cluster.local;check="$$(dig +notcp +noall +answer +search 156.198.68.100.in-addr.arpa. PTR)" && test -n "$$check" && echo OK > /results/100.68.198.156_udp@PTR;check="$$(dig +tcp +noall +answer +search 156.198.68.100.in-addr.arpa. PTR)" && test -n "$$check" && echo OK > /results/100.68.198.156_tcp@PTR;sleep 1; done
 �[38;5;243m01/16/23 10:41:44.807�[0m
�[1mSTEP:�[0m creating a pod to probe DNS �[38;5;243m01/16/23 10:41:44.807�[0m
�[1mSTEP:�[0m submitting the pod to kubernetes �[38;5;243m01/16/23 10:41:44.808�[0m
Jan 16 10:41:44.863: INFO: Waiting up to 15m0s for pod "dns-test-ad7cde41-0cdb-4042-81ab-76b053bbff58" in namespace "dns-3438" to be "running"
Jan 16 10:41:44.913: INFO: Pod "dns-test-ad7cde41-0cdb-4042-81ab-76b053bbff58": Phase="Pending", Reason="", readiness=false. Elapsed: 50.116585ms
Jan 16 10:41:46.958: INFO: Pod "dns-test-ad7cde41-0cdb-4042-81ab-76b053bbff58": Phase="Pending", Reason="", readiness=false. Elapsed: 2.095031821s
Jan 16 10:41:48.954: INFO: Pod "dns-test-ad7cde41-0cdb-4042-81ab-76b053bbff58": Phase="Pending", Reason="", readiness=false. Elapsed: 4.091649042s
Jan 16 10:41:50.961: INFO: Pod "dns-test-ad7cde41-0cdb-4042-81ab-76b053bbff58": Phase="Running", Reason="", readiness=true. Elapsed: 6.097916843s
Jan 16 10:41:50.961: INFO: Pod "dns-test-ad7cde41-0cdb-4042-81ab-76b053bbff58" satisfied condition "running"
�[1mSTEP:�[0m retrieving the pod �[38;5;243m01/16/23 10:41:50.961�[0m
�[1mSTEP:�[0m looking for the results for each expected name from probers �[38;5;243m01/16/23 10:41:51.007�[0m
Jan 16 10:42:21.054: INFO: Unable to read wheezy_udp@dns-test-service.dns-3438.svc.cluster.local from pod dns-3438/dns-test-ad7cde41-0cdb-4042-81ab-76b053bbff58: the server is currently unable to handle the request (get pods dns-test-ad7cde41-0cdb-4042-81ab-76b053bbff58)
Jan 16 10:42:51.089: INFO: Unable to read wheezy_tcp@dns-test-service.dns-3438.svc.cluster.local from pod dns-3438/dns-test-ad7cde41-0cdb-4042-81ab-76b053bbff58: the server is currently unable to handle the request (get pods dns-test-ad7cde41-0cdb-4042-81ab-76b053bbff58)
Jan 16 10:43:21.125: INFO: Unable to read wheezy_udp@_http._tcp.dns-test-service.dns-3438.svc.cluster.local from pod dns-3438/dns-test-ad7cde41-0cdb-4042-81ab-76b053bbff58: the server is currently unable to handle the request (get pods dns-test-ad7cde41-0cdb-4042-81ab-76b053bbff58)
Jan 16 10:43:51.162: INFO: Unable to read wheezy_tcp@_http._tcp.dns-test-service.dns-3438.svc.cluster.local from pod dns-3438/dns-test-ad7cde41-0cdb-4042-81ab-76b053bbff58: the server is currently unable to handle the request (get pods dns-test-ad7cde41-0cdb-4042-81ab-76b053bbff58)
Jan 16 10:44:21.204: INFO: Unable to read wheezy_udp@_http._tcp.test-service-2.dns-3438.svc.cluster.local from pod dns-3438/dns-test-ad7cde41-0cdb-4042-81ab-76b053bbff58: the server is currently unable to handle the request (get pods dns-test-ad7cde41-0cdb-4042-81ab-76b053bbff58)
Jan 16 10:44:51.249: INFO: Unable to read wheezy_tcp@_http._tcp.test-service-2.dns-3438.svc.cluster.local from pod dns-3438/dns-test-ad7cde41-0cdb-4042-81ab-76b053bbff58: the server is currently unable to handle the request (get pods dns-test-ad7cde41-0cdb-4042-81ab-76b053bbff58)
Jan 16 10:45:21.292: INFO: Unable to read 100.68.198.156_udp@PTR from pod dns-3438/dns-test-ad7cde41-0cdb-4042-81ab-76b053bbff58: the server is currently unable to handle the request (get pods dns-test-ad7cde41-0cdb-4042-81ab-76b053bbff58)
Jan 16 10:45:51.330: INFO: Unable to read 100.68.198.156_tcp@PTR from pod dns-3438/dns-test-ad7cde41-0cdb-4042-81ab-76b053bbff58: the server is currently unable to handle the request (get pods dns-test-ad7cde41-0cdb-4042-81ab-76b053bbff58)
Jan 16 10:46:21.365: INFO: Unable to read jessie_udp@dns-test-service.dns-3438.svc.cluster.local from pod dns-3438/dns-test-ad7cde41-0cdb-4042-81ab-76b053bbff58: the server is currently unable to handle the request (get pods dns-test-ad7cde41-0cdb-4042-81ab-76b053bbff58)
Jan 16 10:46:51.009: FAIL: Unable to read jessie_tcp@dns-test-service.dns-3438.svc.cluster.local from pod dns-3438/dns-test-ad7cde41-0cdb-4042-81ab-76b053bbff58: Get "https://35.185.63.242/api/v1/namespaces/dns-3438/pods/dns-test-ad7cde41-0cdb-4042-81ab-76b053bbff58/proxy/results/jessie_tcp@dns-test-service.dns-3438.svc.cluster.local": context deadline exceeded

Full Stack Trace
k8s.io/kubernetes/test/e2e/network.assertFilesContain.func1()
	test/e2e/network/dns_common.go:472 +0x845
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.ConditionFunc.WithContext.func1({0x18, 0xc000100400})
	vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:222 +0x1b
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext({0x7fe0e68?, 0xc000082048?}, 0xc0017ee7d8?)
	vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:235 +0x57
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.poll({0x7fe0e68, 0xc000082048}, 0x18?, 0x2fda505?, 0x60?)
	vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:582 +0x38
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediateWithContext({0x7fe0e68, 0xc000082048}, 0x7f8f998?, 0xc0017ee868?, 0x262a967?)
	vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:528 +0x4a
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediate(0x1e?, 0x1ff?, 0x0?)
	vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:514 +0x50
k8s.io/kubernetes/test/e2e/network.assertFilesContain({0xc00302b380, 0x10, 0x18}, {0x75bfff4, 0x7}, 0xc0034f7200, {0x801e128?, 0xc002cae4e0}, 0x0, {0x0, ...})
	test/e2e/network/dns_common.go:455 +0x1c5
k8s.io/kubernetes/test/e2e/network.assertFilesExist(...)
	test/e2e/network/dns_common.go:449
k8s.io/kubernetes/test/e2e/network.validateDNSResults(0xc000a42e10, 0xc0034f7200, {0xc00302b380, 0x10, 0x18})
	test/e2e/network/dns_common.go:512 +0x452
k8s.io/kubernetes/test/e2e/network.glob..func2.5()
	test/e2e/network/dns.go:184 +0xc45
E0116 10:46:51.009253    6985 runtime.go:79] Observed a panic: types.GinkgoError{Heading:"Your Test Panicked", Message:"When you, or your assertion library, calls Ginkgo's Fail(),\nGinkgo panics to prevent subsequent assertions from running.\n\nNormally Ginkgo rescues this panic so you shouldn't see it.\n\nHowever, if you make an assertion in a goroutine, Ginkgo can't capture the panic.\nTo circumvent this, you should call\n\n\tdefer GinkgoRecover()\n\nat the top of the goroutine that caused this panic.\n\nAlternatively, you may have made an assertion outside of a Ginkgo\nleaf node (e.g. in a container node or some out-of-band function) - please move your assertion to\nan appropriate Ginkgo node (e.g. a BeforeSuite, BeforeEach, It, etc...).", DocLink:"mental-model-how-ginkgo-handles-failure", CodeLocation:types.CodeLocation{FileName:"test/e2e/network/dns_common.go", LineNumber:472, FullStackTrace:"k8s.io/kubernetes/test/e2e/network.assertFilesContain.func1()\n\ttest/e2e/network/dns_common.go:472 +0x845\nk8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.ConditionFunc.WithContext.func1({0x18, 0xc000100400})\n\tvendor/k8s.io/apimachinery/pkg/util/wait/wait.go:222 +0x1b\nk8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext({0x7fe0e68?, 0xc000082048?}, 0xc0017ee7d8?)\n\tvendor/k8s.io/apimachinery/pkg/util/wait/wait.go:235 +0x57\nk8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.poll({0x7fe0e68, 0xc000082048}, 0x18?, 0x2fda505?, 0x60?)\n\tvendor/k8s.io/apimachinery/pkg/util/wait/wait.go:582 +0x38\nk8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediateWithContext({0x7fe0e68, 0xc000082048}, 0x7f8f998?, 0xc0017ee868?, 0x262a967?)\n\tvendor/k8s.io/apimachinery/pkg/util/wait/wait.go:528 +0x4a\nk8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediate(0x1e?, 0x1ff?, 0x0?)\n\tvendor/k8s.io/apimachinery/pkg/util/wait/wait.go:514 +0x50\nk8s.io/kubernetes/test/e2e/network.assertFilesContain({0xc00302b380, 0x10, 0x18}, {0x75bfff4, 0x7}, 0xc0034f7200, {0x801e128?, 0xc002cae4e0}, 0x0, {0x0, ...})\n\ttest/e2e/network/dns_common.go:455 +0x1c5\nk8s.io/kubernetes/test/e2e/network.assertFilesExist(...)\n\ttest/e2e/network/dns_common.go:449\nk8s.io/kubernetes/test/e2e/network.validateDNSResults(0xc000a42e10, 0xc0034f7200, {0xc00302b380, 0x10, 0x18})\n\ttest/e2e/network/dns_common.go:512 +0x452\nk8s.io/kubernetes/test/e2e/network.glob..func2.5()\n\ttest/e2e/network/dns.go:184 +0xc45", CustomMessage:""}} (�[1m�[38;5;9mYour Test Panicked�[0m
�[38;5;243mtest/e2e/network/dns_common.go:472�[0m
  When you, or your assertion library, calls Ginkgo's Fail(),
  Ginkgo panics to prevent subsequent assertions from running.

  Normally Ginkgo rescues this panic so you shouldn't see it.

  However, if you make an assertion in a goroutine, Ginkgo can't capture the
  panic.
  To circumvent this, you should call

  	defer GinkgoRecover()

  at the top of the goroutine that caused this panic.

  Alternatively, you may have made an assertion outside of a Ginkgo
  leaf node (e.g. in a container node or some out-of-band function) - please
  move your assertion to
  an appropriate Ginkgo node (e.g. a BeforeSuite, BeforeEach, It, etc...).

  �[1mLearn more at:�[0m
  �[38;5;14m�[4mhttp://onsi.github.io/ginkgo/#mental-model-how-ginkgo-handles-failure�[0m
)
goroutine 1097 [running]:
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/runtime.logPanic({0x70eb680?, 0xc000d34700})
	vendor/k8s.io/apimachinery/pkg/util/runtime/runtime.go:75 +0x99
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/runtime.HandleCrash({0x0, 0x0, 0xc0000c62d0?})
	vendor/k8s.io/apimachinery/pkg/util/runtime/runtime.go:49 +0x75
panic({0x70eb680, 0xc000d34700})
	/usr/local/go/src/runtime/panic.go:884 +0x212
k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2.Fail({0xc0032cc180, 0x165}, {0xc0017ee390?, 0x75b51fa?, 0xc0017ee3b8?})
	vendor/github.com/onsi/ginkgo/v2/core_dsl.go:352 +0x225
k8s.io/kubernetes/test/e2e/framework.Failf({0x767763a?, 0x2d?}, {0xc0017ee5e0?, 0x0?, 0x0?})
	test/e2e/framework/log.go:49 +0x12c
k8s.io/kubernetes/test/e2e/network.assertFilesContain.func1()
	test/e2e/network/dns_common.go:472 +0x845
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.ConditionFunc.WithContext.func1({0x18, 0xc000100400})
	vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:222 +0x1b
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext({0x7fe0e68?, 0xc000082048?}, 0xc0017ee7d8?)
	vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:235 +0x57
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.poll({0x7fe0e68, 0xc000082048}, 0x18?, 0x2fda505?, 0x60?)
	vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:582 +0x38
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediateWithContext({0x7fe0e68, 0xc000082048}, 0x7f8f998?, 0xc0017ee868?, 0x262a967?)
	vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:528 +0x4a
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediate(0x1e?, 0x1ff?, 0x0?)
	vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:514 +0x50
k8s.io/kubernetes/test/e2e/network.assertFilesContain({0xc00302b380, 0x10, 0x18}, {0x75bfff4, 0x7}, 0xc0034f7200, {0x801e128?, 0xc002cae4e0}, 0x0, {0x0, ...})
	test/e2e/network/dns_common.go:455 +0x1c5
k8s.io/kubernetes/test/e2e/network.assertFilesExist(...)
	test/e2e/network/dns_common.go:449
k8s.io/kubernetes/test/e2e/network.validateDNSResults(0xc000a42e10, 0xc0034f7200, {0xc00302b380, 0x10, 0x18})
	test/e2e/network/dns_common.go:512 +0x452
k8s.io/kubernetes/test/e2e/network.glob..func2.5()
	test/e2e/network/dns.go:184 +0xc45
k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func3({0xc003061050, 0xc00344cf00})
	vendor/github.com/onsi/ginkgo/v2/internal/node.go:449 +0x1b
k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func2()
	vendor/github.com/onsi/ginkgo/v2/internal/suite.go:750 +0x98
created by k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode
	vendor/github.com/onsi/ginkgo/v2/internal/suite.go:738 +0xe3d
�[1mSTEP:�[0m deleting the pod �[38;5;243m01/16/23 10:46:51.009�[0m
�[1mSTEP:�[0m deleting the test service �[38;5;243m01/16/23 10:46:51.1�[0m
�[1mSTEP:�[0m deleting the test headless service �[38;5;243m01/16/23 10:46:51.197�[0m
[AfterEach] [sig-network] DNS
  test/e2e/framework/node/init/init.go:32
Jan 16 10:46:51.269: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-network] DNS
  test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-network] DNS
  dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/16/23 10:46:51.312�[0m
�[1mSTEP:�[0m Collecting events from namespace "dns-3438". �[38;5;243m01/16/23 10:46:51.312�[0m
�[1mSTEP:�[0m Found 13 events. �[38;5;243m01/16/23 10:46:51.348�[0m
Jan 16 10:46:51.348: INFO: At 2023-01-16 10:41:44 +0000 UTC - event for dns-test-ad7cde41-0cdb-4042-81ab-76b053bbff58: {default-scheduler } Scheduled: Successfully assigned dns-3438/dns-test-ad7cde41-0cdb-4042-81ab-76b053bbff58 to nodes-us-east1-b-9h4h
Jan 16 10:46:51.348: INFO: At 2023-01-16 10:41:46 +0000 UTC - event for dns-test-ad7cde41-0cdb-4042-81ab-76b053bbff58: {kubelet nodes-us-east1-b-9h4h} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine
Jan 16 10:46:51.348: INFO: At 2023-01-16 10:41:46 +0000 UTC - event for dns-test-ad7cde41-0cdb-4042-81ab-76b053bbff58: {kubelet nodes-us-east1-b-9h4h} Created: Created container webserver
Jan 16 10:46:51.348: INFO: At 2023-01-16 10:41:46 +0000 UTC - event for dns-test-ad7cde41-0cdb-4042-81ab-76b053bbff58: {kubelet nodes-us-east1-b-9h4h} Started: Started container webserver
Jan 16 10:46:51.348: INFO: At 2023-01-16 10:41:46 +0000 UTC - event for dns-test-ad7cde41-0cdb-4042-81ab-76b053bbff58: {kubelet nodes-us-east1-b-9h4h} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine
Jan 16 10:46:51.348: INFO: At 2023-01-16 10:41:46 +0000 UTC - event for dns-test-ad7cde41-0cdb-4042-81ab-76b053bbff58: {kubelet nodes-us-east1-b-9h4h} Created: Created container querier
Jan 16 10:46:51.348: INFO: At 2023-01-16 10:41:46 +0000 UTC - event for dns-test-ad7cde41-0cdb-4042-81ab-76b053bbff58: {kubelet nodes-us-east1-b-9h4h} Started: Started container querier
Jan 16 10:46:51.348: INFO: At 2023-01-16 10:41:46 +0000 UTC - event for dns-test-ad7cde41-0cdb-4042-81ab-76b053bbff58: {kubelet nodes-us-east1-b-9h4h} Pulled: Container image "registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7" already present on machine
Jan 16 10:46:51.348: INFO: At 2023-01-16 10:41:46 +0000 UTC - event for dns-test-ad7cde41-0cdb-4042-81ab-76b053bbff58: {kubelet nodes-us-east1-b-9h4h} Created: Created container jessie-querier
Jan 16 10:46:51.348: INFO: At 2023-01-16 10:41:47 +0000 UTC - event for dns-test-ad7cde41-0cdb-4042-81ab-76b053bbff58: {kubelet nodes-us-east1-b-9h4h} Started: Started container jessie-querier
Jan 16 10:46:51.348: INFO: At 2023-01-16 10:46:51 +0000 UTC - event for dns-test-ad7cde41-0cdb-4042-81ab-76b053bbff58: {kubelet nodes-us-east1-b-9h4h} Killing: Stopping container webserver
Jan 16 10:46:51.348: INFO: At 2023-01-16 10:46:51 +0000 UTC - event for dns-test-ad7cde41-0cdb-4042-81ab-76b053bbff58: {kubelet nodes-us-east1-b-9h4h} Killing: Stopping container jessie-querier
Jan 16 10:46:51.348: INFO: At 2023-01-16 10:46:51 +0000 UTC - event for dns-test-ad7cde41-0cdb-4042-81ab-76b053bbff58: {kubelet nodes-us-east1-b-9h4h} Killing: Stopping container querier
Jan 16 10:46:51.386: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Jan 16 10:46:51.386: INFO: 
Jan 16 10:46:51.425: INFO: 
Logging node info for node control-plane-us-east1-b-nc4v
Jan 16 10:46:51.462: INFO: Node Info: &Node{ObjectMeta:{control-plane-us-east1-b-nc4v    3e043433-4a0a-4797-aed2-d532c70362c4 18893 0 2023-01-16 10:33:51 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-standard-2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:control-plane-us-east1-b-nc4v kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node-role.kubernetes.io/node: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:e2-standard-2 topology.gke.io/zone:us-east1-b topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/control-plane-us-east1-b-nc4v"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.4/32 projectcalico.org/IPv4IPIPTunnelAddr:100.126.126.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-16 10:33:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-16 10:34:31 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:34:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {calico-node Update v1 2023-01-16 10:34:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-16 10:34:51 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:34:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:34:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-16 10:45:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/control-plane-us-east1-b-nc4v,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8332767232 0} {<nil>} 8137468Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8227909632 0} {<nil>} 8035068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:34:56 +0000 UTC,LastTransitionTime:2023-01-16 10:34:56 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 10:45:15 +0000 UTC,LastTransitionTime:2023-01-16 10:33:51 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 10:45:15 +0000 UTC,LastTransitionTime:2023-01-16 10:33:51 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 10:45:15 +0000 UTC,LastTransitionTime:2023-01-16 10:33:51 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 10:45:15 +0000 UTC,LastTransitionTime:2023-01-16 10:34:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.4,},NodeAddress{Type:ExternalIP,Address:35.243.145.107,},NodeAddress{Type:Hostname,Address:control-plane-us-east1-b-nc4v,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e5ac4d7bf983c1b4a0fb9c7211b86ad9,SystemUUID:e5ac4d7b-f983-c1b4-a0fb-9c7211b86ad9,BootID:66119c47-44e2-4c4c-ac93-902592bb3d86,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.0],SizeBytes:135162323,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.0],SizeBytes:124991801,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.0],SizeBytes:57657656,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43637878,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42802014,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:2b6acd7f677f76ffe12ecf3ea7df92eb9b1bdb07336d1ac2a54c7631fb753f7e docker.io/calico/kube-controllers:v3.24.5],SizeBytes:31137169,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2 registry.k8s.io/sig-storage/csi-provisioner:v2.1.0],SizeBytes:21205045,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:50c3cfd458fc8e0bf3c8c521eac39172009382fc66dc5044a330d137c6ed0b09 registry.k8s.io/sig-storage/csi-attacher:v3.1.0],SizeBytes:20103959,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a registry.k8s.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:9af9bf28430b00a0cedeb2ec29acadce45e6afcecd8bdf31c793c624cfa75fa7 registry.k8s.io/sig-storage/csi-snapshotter:v3.0.3],SizeBytes:19500777,},ContainerImage{Names:[docker.io/k8scloudprovidergcp/cloud-controller-manager@sha256:881fd1095937638040723973ade90e6700f1c831a78fb585a3227c4d021b0df9 docker.io/k8scloudprovidergcp/cloud-controller-manager:latest],SizeBytes:18702875,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4967322,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 16 10:46:51.462: INFO: 
Logging kubelet events for node control-plane-us-east1-b-nc4v
Jan 16 10:46:51.504: INFO: 
Logging pods the kubelet thinks is on node control-plane-us-east1-b-nc4v
Jan 16 10:46:51.581: INFO: kops-controller-smdjr started at 2023-01-16 10:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:46:51.581: INFO: 	Container kops-controller ready: true, restart count 0
Jan 16 10:46:51.581: INFO: kube-scheduler-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:46:51.581: INFO: 	Container kube-scheduler ready: true, restart count 0
Jan 16 10:46:51.581: INFO: etcd-manager-events-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:46:51.581: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 16 10:46:51.581: INFO: etcd-manager-main-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:46:51.582: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 16 10:46:51.582: INFO: kube-apiserver-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+2 container statuses recorded)
Jan 16 10:46:51.582: INFO: 	Container healthcheck ready: true, restart count 0
Jan 16 10:46:51.582: INFO: 	Container kube-apiserver ready: true, restart count 1
Jan 16 10:46:51.582: INFO: csi-gce-pd-node-kz9xf started at 2023-01-16 10:34:14 +0000 UTC (0+2 container statuses recorded)
Jan 16 10:46:51.582: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 10:46:51.582: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 10:46:51.582: INFO: dns-controller-6d5f4bf5d6-kqf4d started at 2023-01-16 10:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:46:51.582: INFO: 	Container dns-controller ready: true, restart count 0
Jan 16 10:46:51.582: INFO: csi-gce-pd-controller-78fc966fff-m86hh started at 2023-01-16 10:34:31 +0000 UTC (0+5 container statuses recorded)
Jan 16 10:46:51.582: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 16 10:46:51.582: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 16 10:46:51.582: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 16 10:46:51.582: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 16 10:46:51.582: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 10:46:51.582: INFO: kube-controller-manager-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:46:51.582: INFO: 	Container kube-controller-manager ready: true, restart count 2
Jan 16 10:46:51.582: INFO: kube-proxy-control-plane-us-east1-b-nc4v started at 2023-01-16 10:33:04 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:46:51.582: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 10:46:51.582: INFO: calico-node-5jgkc started at 2023-01-16 10:34:24 +0000 UTC (3+1 container statuses recorded)
Jan 16 10:46:51.582: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 10:46:51.582: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 10:46:51.582: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 10:46:51.582: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 10:46:51.582: INFO: cloud-controller-manager-b5qds started at 2023-01-16 10:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:46:51.582: INFO: 	Container cloud-controller-manager ready: true, restart count 0
Jan 16 10:46:51.582: INFO: calico-kube-controllers-55f488656-hcbkw started at 2023-01-16 10:34:50 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:46:51.582: INFO: 	Container calico-kube-controllers ready: true, restart count 0
Jan 16 10:46:51.863: INFO: 
Latency metrics for node control-plane-us-east1-b-nc4v
Jan 16 10:46:51.863: INFO: 
Logging node info for node nodes-us-east1-b-2xs4
Jan 16 10:46:51.898: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east1-b-2xs4    5523b1af-a125-4437-baf4-a87ff6e2a424 21012 0 2023-01-16 10:35:00 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east1-b-2xs4 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east1-b topology.hostpath.csi/node:nodes-us-east1-b-2xs4 topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-8972":"nodes-us-east1-b-2xs4","pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/nodes-us-east1-b-2xs4"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.6/32 projectcalico.org/IPv4IPIPTunnelAddr:100.123.6.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2023-01-16 10:35:00 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2023-01-16 10:35:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-16 10:35:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {calico-node Update v1 2023-01-16 10:35:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:46:04 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-16 10:46:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/nodes-us-east1-b-2xs4,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:35:32 +0000 UTC,LastTransitionTime:2023-01-16 10:35:32 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 10:46:04 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 10:46:04 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 10:46:04 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 10:46:04 +0000 UTC,LastTransitionTime:2023-01-16 10:35:20 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.6,},NodeAddress{Type:ExternalIP,Address:35.196.42.74,},NodeAddress{Type:Hostname,Address:nodes-us-east1-b-2xs4,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:39f2b9ba1d525f08f837cadb4248f14d,SystemUUID:39f2b9ba-1d52-5f08-f837-cadb4248f14d,BootID:7acec4fd-f02a-4704-a113-25a81be183ce,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-8972^e739c0ea-958a-11ed-86f2-d6c20fbceb40],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-8972^e739c0ea-958a-11ed-86f2-d6c20fbceb40,DevicePath:,},},Config:nil,},}
Jan 16 10:46:51.898: INFO: 
Logging kubelet events for node nodes-us-east1-b-2xs4
Jan 16 10:46:51.936: INFO: 
Logging pods the kubelet thinks is on node nodes-us-east1-b-2xs4
Jan 16 10:46:51.979: INFO: csi-mockplugin-0 started at 2023-01-16 10:45:23 +0000 UTC (0+3 container statuses recorded)
Jan 16 10:46:51.979: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 16 10:46:51.979: INFO: 	Container driver-registrar ready: true, restart count 0
Jan 16 10:46:51.979: INFO: 	Container mock ready: true, restart count 0
Jan 16 10:46:51.979: INFO: csi-mockplugin-resizer-0 started at 2023-01-16 10:45:23 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:46:51.979: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 16 10:46:51.979: INFO: kube-proxy-nodes-us-east1-b-2xs4 started at 2023-01-16 10:34:50 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:46:51.979: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 10:46:51.979: INFO: csi-gce-pd-node-jc8jn started at 2023-01-16 10:35:10 +0000 UTC (0+2 container statuses recorded)
Jan 16 10:46:51.979: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 10:46:51.979: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 10:46:51.979: INFO: httpd started at 2023-01-16 10:46:43 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:46:51.979: INFO: 	Container httpd ready: false, restart count 0
Jan 16 10:46:51.979: INFO: calico-node-qlnmx started at 2023-01-16 10:35:10 +0000 UTC (3+1 container statuses recorded)
Jan 16 10:46:51.979: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 10:46:51.979: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 10:46:51.979: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 10:46:51.979: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 10:46:51.979: INFO: dns-test-8c1e8ec3-aa3c-4020-b249-74a0527133e1 started at 2023-01-16 10:43:45 +0000 UTC (0+3 container statuses recorded)
Jan 16 10:46:51.979: INFO: 	Container jessie-querier ready: true, restart count 0
Jan 16 10:46:51.979: INFO: 	Container querier ready: true, restart count 0
Jan 16 10:46:51.979: INFO: 	Container webserver ready: true, restart count 0
Jan 16 10:46:51.979: INFO: hostexec-nodes-us-east1-b-2xs4-zvjtp started at 2023-01-16 10:46:46 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:46:51.979: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 16 10:46:51.979: INFO: netserver-0 started at 2023-01-16 10:46:39 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:46:51.979: INFO: 	Container webserver ready: false, restart count 0
Jan 16 10:46:51.979: INFO: pod-ephm-test-secret-tlt9 started at 2023-01-16 10:44:57 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:46:51.979: INFO: 	Container test-container-subpath-secret-tlt9 ready: false, restart count 0
Jan 16 10:46:51.979: INFO: pvc-volume-tester-6s58z started at 2023-01-16 10:45:35 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:46:51.979: INFO: 	Container volume-tester ready: true, restart count 0
Jan 16 10:46:51.979: INFO: agnhost started at 2023-01-16 10:46:16 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:46:51.979: INFO: 	Container agnhost ready: true, restart count 0
Jan 16 10:46:51.979: INFO: externalname-service-hxpqq started at 2023-01-16 10:46:40 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:46:51.979: INFO: 	Container externalname-service ready: true, restart count 0
Jan 16 10:46:51.979: INFO: test-webserver-2ca4ac0f-2f90-4bbc-8582-2c200c8d20af started at 2023-01-16 10:45:31 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:46:51.979: INFO: 	Container test-webserver ready: true, restart count 0
Jan 16 10:46:51.979: INFO: nodeport-update-service-rd2mn started at 2023-01-16 10:46:16 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:46:51.979: INFO: 	Container nodeport-update-service ready: true, restart count 0
Jan 16 10:46:51.979: INFO: csi-mockplugin-attacher-0 started at 2023-01-16 10:45:23 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:46:51.979: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 16 10:46:51.979: INFO: dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf started at 2023-01-16 10:41:08 +0000 UTC (0+3 container statuses recorded)
Jan 16 10:46:51.979: INFO: 	Container jessie-querier ready: true, restart count 0
Jan 16 10:46:51.979: INFO: 	Container querier ready: true, restart count 0
Jan 16 10:46:51.979: INFO: 	Container webserver ready: true, restart count 0
Jan 16 10:46:51.979: INFO: startup-f8ef4fb2-eec3-40c0-9112-4ee5ee5bd601 started at 2023-01-16 10:46:02 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:46:51.979: INFO: 	Container busybox ready: false, restart count 0
Jan 16 10:46:52.323: INFO: 
Latency metrics for node nodes-us-east1-b-2xs4
Jan 16 10:46:52.323: INFO: 
Logging node info for node nodes-us-east1-b-9h4h
Jan 16 10:46:52.405: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east1-b-9h4h    672ac3b7-ea1d-4e3e-bd88-42fa1b6384a8 22616 0 2023-01-16 10:34:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east1-b-9h4h kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east1-b topology.hostpath.csi/node:nodes-us-east1-b-9h4h topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-2549":"nodes-us-east1-b-9h4h","pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/nodes-us-east1-b-9h4h"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.5/32 projectcalico.org/IPv4IPIPTunnelAddr:100.103.14.192 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-16 10:34:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:34:59 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-16 10:34:59 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:35:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {calico-node Update v1 2023-01-16 10:35:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:46:43 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-16 10:46:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/nodes-us-east1-b-9h4h,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:35:24 +0000 UTC,LastTransitionTime:2023-01-16 10:35:24 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 10:46:43 +0000 UTC,LastTransitionTime:2023-01-16 10:34:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 10:46:43 +0000 UTC,LastTransitionTime:2023-01-16 10:34:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 10:46:43 +0000 UTC,LastTransitionTime:2023-01-16 10:34:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 10:46:43 +0000 UTC,LastTransitionTime:2023-01-16 10:35:13 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.5,},NodeAddress{Type:ExternalIP,Address:35.196.180.243,},NodeAddress{Type:Hostname,Address:nodes-us-east1-b-9h4h,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:828dcdb67e74b8a327b01dc0797be5e1,SystemUUID:828dcdb6-7e74-b8a3-27b0-1dc0797be5e1,BootID:dd05deb0-ef00-47e1-83af-c902277fe4b7,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-2549^f6a2f91e-958a-11ed-a007-f6bdbbae537e kubernetes.io/csi/csi-hostpath-ephemeral-2549^fb8ea75f-958a-11ed-a007-f6bdbbae537e],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-2549^f6a2f91e-958a-11ed-a007-f6bdbbae537e,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-2549^fb8ea75f-958a-11ed-a007-f6bdbbae537e,DevicePath:,},},Config:nil,},}
Jan 16 10:46:52.406: INFO: 
Logging kubelet events for node nodes-us-east1-b-9h4h
Jan 16 10:46:52.494: INFO: 
Logging pods the kubelet thinks is on node nodes-us-east1-b-9h4h
Jan 16 10:46:52.548: INFO: kube-proxy-nodes-us-east1-b-9h4h started at 2023-01-16 10:34:55 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:46:52.548: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 10:46:52.548: INFO: up-down-1-6mbkf started at 2023-01-16 10:46:51 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:46:52.548: INFO: 	Container up-down-1 ready: false, restart count 0
Jan 16 10:46:52.548: INFO: csi-hostpathplugin-0 started at 2023-01-16 10:45:55 +0000 UTC (0+7 container statuses recorded)
Jan 16 10:46:52.548: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 16 10:46:52.548: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 16 10:46:52.548: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 16 10:46:52.548: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 16 10:46:52.548: INFO: 	Container hostpath ready: true, restart count 0
Jan 16 10:46:52.548: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 16 10:46:52.548: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 16 10:46:52.548: INFO: netserver-1 started at 2023-01-16 10:46:39 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:46:52.548: INFO: 	Container webserver ready: false, restart count 0
Jan 16 10:46:52.548: INFO: csi-gce-pd-node-ncgj4 started at 2023-01-16 10:35:01 +0000 UTC (0+2 container statuses recorded)
Jan 16 10:46:52.548: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 10:46:52.548: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 10:46:52.548: INFO: calico-node-gmwsc started at 2023-01-16 10:35:01 +0000 UTC (3+1 container statuses recorded)
Jan 16 10:46:52.548: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 10:46:52.548: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 10:46:52.548: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 10:46:52.548: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 10:46:52.548: INFO: coredns-autoscaler-7cb5c5b969-mpv8x started at 2023-01-16 10:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:46:52.548: INFO: 	Container autoscaler ready: true, restart count 0
Jan 16 10:46:52.548: INFO: update-demo-nautilus-llkgr started at 2023-01-16 10:45:19 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:46:52.548: INFO: 	Container update-demo ready: true, restart count 0
Jan 16 10:46:52.548: INFO: coredns-7bc44848df-zs55k started at 2023-01-16 10:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:46:52.548: INFO: 	Container coredns ready: true, restart count 0
Jan 16 10:46:52.548: INFO: agnhost-primary-srbvw started at 2023-01-16 10:45:30 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:46:52.548: INFO: 	Container agnhost-primary ready: false, restart count 0
Jan 16 10:46:52.548: INFO: inline-volume-tester-sp5d5 started at 2023-01-16 10:45:59 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:46:52.548: INFO: 	Container csi-volume-tester ready: true, restart count 0
Jan 16 10:46:52.548: INFO: hostexec-nodes-us-east1-b-9h4h-r92tp started at 2023-01-16 10:46:32 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:46:52.548: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 16 10:46:53.062: INFO: 
Latency metrics for node nodes-us-east1-b-9h4h
Jan 16 10:46:53.063: INFO: 
Logging node info for node nodes-us-east1-b-rn9p
Jan 16 10:46:53.099: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east1-b-rn9p    59f4f25d-24bf-4d96-a4bf-2cf266b5c083 22748 0 2023-01-16 10:34:59 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east1-b-rn9p kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east1-b topology.hostpath.csi/node:nodes-us-east1-b-rn9p topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-5568":"nodes-us-east1-b-rn9p","csi-hostpath-volume-expand-2082":"nodes-us-east1-b-rn9p","pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/nodes-us-east1-b-rn9p"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.3/32 projectcalico.org/IPv4IPIPTunnelAddr:100.98.60.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-16 10:34:59 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:00 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-16 10:35:01 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {calico-node Update v1 2023-01-16 10:35:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-16 10:46:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {kube-controller-manager Update v1 2023-01-16 10:46:46 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/nodes-us-east1-b-rn9p,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:35:26 +0000 UTC,LastTransitionTime:2023-01-16 10:35:26 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 10:46:43 +0000 UTC,LastTransitionTime:2023-01-16 10:34:59 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 10:46:43 +0000 UTC,LastTransitionTime:2023-01-16 10:34:59 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 10:46:43 +0000 UTC,LastTransitionTime:2023-01-16 10:34:59 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 10:46:43 +0000 UTC,LastTransitionTime:2023-01-16 10:35:14 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.3,},NodeAddress{Type:ExternalIP,Address:34.75.49.181,},NodeAddress{Type:Hostname,Address:nodes-us-east1-b-rn9p,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:9f39c983773df4ca6a15315227d6fd51,SystemUUID:9f39c983-773d-f4ca-6a15-315227d6fd51,BootID:7e9ad329-1a6b-4405-ba71-ca92e45658b3,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-volume-expand-2082^11d2f26c-958b-11ed-88f0-9601f92dc06e,DevicePath:,},},Config:nil,},}
Jan 16 10:46:53.100: INFO: 
Logging kubelet events for node nodes-us-east1-b-rn9p
Jan 16 10:46:53.139: INFO: 
Logging pods the kubelet thinks is on node nodes-us-east1-b-rn9p
Jan 16 10:46:53.210: INFO: kube-proxy-nodes-us-east1-b-rn9p started at 2023-01-16 10:34:56 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:46:53.210: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 10:46:53.210: INFO: rs-gtcp2 started at 2023-01-16 10:46:16 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:46:53.210: INFO: 	Container donothing ready: false, restart count 0
Jan 16 10:46:53.210: INFO: nodeport-update-service-fs9zh started at 2023-01-16 10:46:16 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:46:53.210: INFO: 	Container nodeport-update-service ready: true, restart count 0
Jan 16 10:46:53.210: INFO: pfpod started at 2023-01-16 10:46:36 +0000 UTC (0+2 container statuses recorded)
Jan 16 10:46:53.211: INFO: 	Container portforwardtester ready: false, restart count 0
Jan 16 10:46:53.211: INFO: 	Container readiness ready: false, restart count 0
Jan 16 10:46:53.211: INFO: up-down-1-2x9v4 started at 2023-01-16 10:46:51 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:46:53.211: INFO: 	Container up-down-1 ready: false, restart count 0
Jan 16 10:46:53.211: INFO: execpodsdb86 started at 2023-01-16 10:46:22 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:46:53.211: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 16 10:46:53.211: INFO: agnhost-primary-wkh7n started at 2023-01-16 10:45:31 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:46:53.211: INFO: 	Container agnhost-primary ready: false, restart count 0
Jan 16 10:46:53.211: INFO: csi-hostpathplugin-0 started at 2023-01-16 10:46:21 +0000 UTC (0+7 container statuses recorded)
Jan 16 10:46:53.211: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 16 10:46:53.211: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 16 10:46:53.211: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 16 10:46:53.211: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 16 10:46:53.211: INFO: 	Container hostpath ready: true, restart count 0
Jan 16 10:46:53.211: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 16 10:46:53.211: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 16 10:46:53.211: INFO: netserver-2 started at 2023-01-16 10:46:39 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:46:53.211: INFO: 	Container webserver ready: false, restart count 0
Jan 16 10:46:53.211: INFO: hostexec-nodes-us-east1-b-rn9p-wcqbx started at 2023-01-16 10:46:26 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:46:53.211: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 16 10:46:53.211: INFO: pod-52845073-7e8e-4f15-a8ff-357d1de42f4f started at 2023-01-16 10:46:46 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:46:53.211: INFO: 	Container write-pod ready: false, restart count 0
Jan 16 10:46:53.211: INFO: externalname-service-nr6qh started at 2023-01-16 10:46:40 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:46:53.211: INFO: 	Container externalname-service ready: true, restart count 0
Jan 16 10:46:53.211: INFO: calico-node-ntgj5 started at 2023-01-16 10:35:03 +0000 UTC (3+1 container statuses recorded)
Jan 16 10:46:53.211: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 10:46:53.211: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 10:46:53.211: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 10:46:53.211: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 10:46:53.211: INFO: pod-subpath-test-preprovisionedpv-lvpv started at 2023-01-16 10:46:45 +0000 UTC (0+2 container statuses recorded)
Jan 16 10:46:53.211: INFO: 	Container test-container-subpath-preprovisionedpv-lvpv ready: false, restart count 0
Jan 16 10:46:53.211: INFO: 	Container test-container-volume-preprovisionedpv-lvpv ready: true, restart count 0
Jan 16 10:46:53.211: INFO: liveness-2ce67673-7444-4b0e-b400-66a77233e5c3 started at 2023-01-16 10:42:55 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:46:53.211: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 16 10:46:53.211: INFO: csi-mockplugin-0 started at 2023-01-16 10:45:37 +0000 UTC (0+4 container statuses recorded)
Jan 16 10:46:53.211: INFO: 	Container busybox ready: true, restart count 0
Jan 16 10:46:53.211: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 16 10:46:53.211: INFO: 	Container driver-registrar ready: true, restart count 0
Jan 16 10:46:53.211: INFO: 	Container mock ready: true, restart count 0
Jan 16 10:46:53.211: INFO: csi-gce-pd-node-88f4v started at 2023-01-16 10:35:03 +0000 UTC (0+2 container statuses recorded)
Jan 16 10:46:53.211: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 10:46:53.211: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 10:46:53.211: INFO: csi-hostpathplugin-0 started at 2023-01-16 10:46:37 +0000 UTC (0+7 container statuses recorded)
Jan 16 10:46:53.211: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 16 10:46:53.211: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 16 10:46:53.211: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 16 10:46:53.211: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 16 10:46:53.211: INFO: 	Container hostpath ready: true, restart count 0
Jan 16 10:46:53.211: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 16 10:46:53.211: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 16 10:46:53.558: INFO: 
Latency metrics for node nodes-us-east1-b-rn9p
Jan 16 10:46:53.558: INFO: 
Logging node info for node nodes-us-east1-b-wcrf
Jan 16 10:46:53.594: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east1-b-wcrf    509e8852-b60d-4ccc-864a-4efd7f571608 22702 0 2023-01-16 10:35:00 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east1-b-wcrf kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east1-b topology.hostpath.csi/node:nodes-us-east1-b-wcrf topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-9560":"nodes-us-east1-b-wcrf","pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/nodes-us-east1-b-wcrf"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.2/32 projectcalico.org/IPv4IPIPTunnelAddr:100.110.242.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-16 10:35:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:01 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-16 10:35:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:35:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {calico-node Update v1 2023-01-16 10:35:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kube-controller-manager Update v1 2023-01-16 10:46:45 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-16 10:46:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-protobuf/us-east1-b/nodes-us-east1-b-wcrf,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-16 10:35:27 +0000 UTC,LastTransitionTime:2023-01-16 10:35:27 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-16 10:46:45 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-16 10:46:45 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-16 10:46:45 +0000 UTC,LastTransitionTime:2023-01-16 10:35:00 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-16 10:46:45 +0000 UTC,LastTransitionTime:2023-01-16 10:35:15 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.2,},NodeAddress{Type:ExternalIP,Address:35.237.110.203,},NodeAddress{Type:Hostname,Address:nodes-us-east1-b-wcrf,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:90256d4292845f855978b781ab31ded0,SystemUUID:90256d42-9284-5f85-5978-b781ab31ded0,BootID:b6764560-f26d-4d17-83ba-c17bdd70bced,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-9560^fb1eb42b-958a-11ed-b68b-fea4026f49a5],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-9560^fb1eb42b-958a-11ed-b68b-fea4026f49a5,DevicePath:,},},Config:nil,},}
Jan 16 10:46:53.595: INFO: 
Logging kubelet events for node nodes-us-east1-b-wcrf
Jan 16 10:46:53.636: INFO: 
Logging pods the kubelet thinks is on node nodes-us-east1-b-wcrf
Jan 16 10:46:53.685: INFO: sample-webhook-deployment-865554f4d9-54qzw started at 2023-01-16 10:46:52 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:46:53.685: INFO: 	Container sample-webhook ready: false, restart count 0
Jan 16 10:46:53.685: INFO: pod-terminate-status-2-0 started at 2023-01-16 10:46:53 +0000 UTC (1+1 container statuses recorded)
Jan 16 10:46:53.685: INFO: 	Init container fail ready: false, restart count 0
Jan 16 10:46:53.685: INFO: 	Container blocked ready: false, restart count 0
Jan 16 10:46:53.685: INFO: pod-terminate-status-0-0 started at 2023-01-16 10:46:53 +0000 UTC (1+1 container statuses recorded)
Jan 16 10:46:53.685: INFO: 	Init container fail ready: false, restart count 0
Jan 16 10:46:53.685: INFO: 	Container blocked ready: false, restart count 0
Jan 16 10:46:53.685: INFO: calico-node-tvbl7 started at 2023-01-16 10:35:01 +0000 UTC (3+1 container statuses recorded)
Jan 16 10:46:53.685: INFO: 	Init container upgrade-ipam ready: true, restart count 0
Jan 16 10:46:53.685: INFO: 	Init container install-cni ready: true, restart count 0
Jan 16 10:46:53.685: INFO: 	Init container mount-bpffs ready: true, restart count 0
Jan 16 10:46:53.685: INFO: 	Container calico-node ready: true, restart count 0
Jan 16 10:46:53.685: INFO: netserver-3 started at 2023-01-16 10:46:39 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:46:53.685: INFO: 	Container webserver ready: false, restart count 0
Jan 16 10:46:53.685: INFO: kube-proxy-nodes-us-east1-b-wcrf started at 2023-01-16 10:34:57 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:46:53.685: INFO: 	Container kube-proxy ready: true, restart count 0
Jan 16 10:46:53.685: INFO: coredns-7bc44848df-rn2pc started at 2023-01-16 10:35:31 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:46:53.685: INFO: 	Container coredns ready: true, restart count 0
Jan 16 10:46:53.685: INFO: update-demo-nautilus-6g9m5 started at 2023-01-16 10:45:19 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:46:53.685: INFO: 	Container update-demo ready: true, restart count 0
Jan 16 10:46:53.685: INFO: execpodfnzsm started at 2023-01-16 10:46:46 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:46:53.685: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 16 10:46:53.685: INFO: csi-gce-pd-node-v2gwp started at 2023-01-16 10:35:01 +0000 UTC (0+2 container statuses recorded)
Jan 16 10:46:53.685: INFO: 	Container csi-driver-registrar ready: true, restart count 0
Jan 16 10:46:53.685: INFO: 	Container gce-pd-driver ready: true, restart count 0
Jan 16 10:46:53.685: INFO: up-down-1-g5nrq started at 2023-01-16 10:46:51 +0000 UTC (0+1 container statuses recorded)
Jan 16 10:46:53.685: INFO: 	Container up-down-1 ready: false, restart count 0
Jan 16 10:46:53.685: INFO: csi-hostpathplugin-0 started at 2023-01-16 10:46:00 +0000 UTC (0+7 container statuses recorded)
Jan 16 10:46:53.685: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 16 10:46:53.685: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 16 10:46:53.685: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 16 10:46:53.685: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 16 10:46:53.685: INFO: 	Container hostpath ready: true, restart count 0
Jan 16 10:46:53.685: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 16 10:46:53.685: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 16 10:46:54.628: INFO: 
Latency metrics for node nodes-us-east1-b-wcrf
[DeferCleanup (Each)] [sig-network] DNS
  tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "dns-3438" for this suite. �[38;5;243m01/16/23 10:46:54.628�[0m

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-network] DNS should provide DNS for the cluster [Conformance] 14m39s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-network\]\sDNS\sshould\sprovide\sDNS\sfor\sthe\scluster\s\s\[Conformance\]$'

test/e2e/network/dns_common.go:455
k8s.io/kubernetes/test/e2e/network.assertFilesContain({0xc00120c480?, 0x4?, 0x4?}, {0x75bfff4?, 0x7?}, 0xc001da8900?, {0x801e128?, 0xc001e22000?}, 0x0?, {0x0, ...})
	test/e2e/network/dns_common.go:455 +0x1dc
k8s.io/kubernetes/test/e2e/network.assertFilesExist(...)
	test/e2e/network/dns_common.go:449
k8s.io/kubernetes/test/e2e/network.validateDNSResults(0xc000de6e10, 0xc001da8900, {0xc00120c480, 0x4, 0x4})
	test/e2e/network/dns_common.go:512 +0x452
k8s.io/kubernetes/test/e2e/network.glob..func2.1()
	test/e2e/network/dns.go:66 +0x43e
				[BeforeEach] [sig-network] DNS
  set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/16/23 10:41:08.03�[0m
Jan 16 10:41:08.031: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename dns �[38;5;243m01/16/23 10:41:08.031�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/16/23 10:41:08.136�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/16/23 10:41:08.21�[0m
[BeforeEach] [sig-network] DNS
  test/e2e/framework/metrics/init/init.go:31
[It] should provide DNS for the cluster  [Conformance]
  test/e2e/network/dns.go:50
�[1mSTEP:�[0m Running these commands on wheezy: for i in `seq 1 600`; do check="$$(dig +notcp +noall +answer +search kubernetes.default.svc.cluster.local A)" && test -n "$$check" && echo OK > /results/wheezy_udp@kubernetes.default.svc.cluster.local;check="$$(dig +tcp +noall +answer +search kubernetes.default.svc.cluster.local A)" && test -n "$$check" && echo OK > /results/wheezy_tcp@kubernetes.default.svc.cluster.local;sleep 1; done
 �[38;5;243m01/16/23 10:41:08.276�[0m
�[1mSTEP:�[0m Running these commands on jessie: for i in `seq 1 600`; do check="$$(dig +notcp +noall +answer +search kubernetes.default.svc.cluster.local A)" && test -n "$$check" && echo OK > /results/jessie_udp@kubernetes.default.svc.cluster.local;check="$$(dig +tcp +noall +answer +search kubernetes.default.svc.cluster.local A)" && test -n "$$check" && echo OK > /results/jessie_tcp@kubernetes.default.svc.cluster.local;sleep 1; done
 �[38;5;243m01/16/23 10:41:08.276�[0m
�[1mSTEP:�[0m creating a pod to probe DNS �[38;5;243m01/16/23 10:41:08.276�[0m
�[1mSTEP:�[0m submitting the pod to kubernetes �[38;5;243m01/16/23 10:41:08.276�[0m
Jan 16 10:41:08.320: INFO: Waiting up to 15m0s for pod "dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf" in namespace "dns-6388" to be "running"
Jan 16 10:41:08.354: INFO: Pod "dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf": Phase="Pending", Reason="", readiness=false. Elapsed: 33.978192ms
Jan 16 10:41:10.393: INFO: Pod "dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf": Phase="Pending", Reason="", readiness=false. Elapsed: 2.07302282s
Jan 16 10:41:12.391: INFO: Pod "dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf": Phase="Pending", Reason="", readiness=false. Elapsed: 4.070909366s
Jan 16 10:41:14.405: INFO: Pod "dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf": Phase="Pending", Reason="", readiness=false. Elapsed: 6.08446091s
Jan 16 10:41:16.401: INFO: Pod "dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf": Phase="Running", Reason="", readiness=true. Elapsed: 8.081113468s
Jan 16 10:41:16.401: INFO: Pod "dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf" satisfied condition "running"
�[1mSTEP:�[0m retrieving the pod �[38;5;243m01/16/23 10:41:16.401�[0m
�[1mSTEP:�[0m looking for the results for each expected name from probers �[38;5;243m01/16/23 10:41:16.44�[0m
Jan 16 10:41:46.492: INFO: Unable to read wheezy_udp@kubernetes.default.svc.cluster.local from pod dns-6388/dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf: the server is currently unable to handle the request (get pods dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf)
Jan 16 10:42:16.549: INFO: Unable to read wheezy_tcp@kubernetes.default.svc.cluster.local from pod dns-6388/dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf: the server is currently unable to handle the request (get pods dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf)
Jan 16 10:42:46.584: INFO: Unable to read jessie_udp@kubernetes.default.svc.cluster.local from pod dns-6388/dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf: the server is currently unable to handle the request (get pods dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf)
Jan 16 10:43:16.620: INFO: Unable to read jessie_tcp@kubernetes.default.svc.cluster.local from pod dns-6388/dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf: the server is currently unable to handle the request (get pods dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf)
Jan 16 10:43:16.620: INFO: Lookups using dns-6388/dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf failed for: [wheezy_udp@kubernetes.default.svc.cluster.local wheezy_tcp@kubernetes.default.svc.cluster.local jessie_udp@kubernetes.default.svc.cluster.local jessie_tcp@kubernetes.default.svc.cluster.local]

Jan 16 10:43:51.660: INFO: Unable to read wheezy_udp@kubernetes.default.svc.cluster.local from pod dns-6388/dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf: the server is currently unable to handle the request (get pods dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf)
Jan 16 10:44:21.697: INFO: Unable to read wheezy_tcp@kubernetes.default.svc.cluster.local from pod dns-6388/dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf: the server is currently unable to handle the request (get pods dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf)
Jan 16 10:44:51.731: INFO: Unable to read jessie_udp@kubernetes.default.svc.cluster.local from pod dns-6388/dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf: the server is currently unable to handle the request (get pods dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf)
Jan 16 10:45:21.769: INFO: Unable to read jessie_tcp@kubernetes.default.svc.cluster.local from pod dns-6388/dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf: the server is currently unable to handle the request (get pods dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf)
Jan 16 10:45:21.769: INFO: Lookups using dns-6388/dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf failed for: [wheezy_udp@kubernetes.default.svc.cluster.local wheezy_tcp@kubernetes.default.svc.cluster.local jessie_udp@kubernetes.default.svc.cluster.local jessie_tcp@kubernetes.default.svc.cluster.local]

Jan 16 10:45:56.661: INFO: Unable to read wheezy_udp@kubernetes.default.svc.cluster.local from pod dns-6388/dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf: the server is currently unable to handle the request (get pods dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf)
Jan 16 10:46:26.696: INFO: Unable to read wheezy_tcp@kubernetes.default.svc.cluster.local from pod dns-6388/dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf: the server is currently unable to handle the request (get pods dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf)
Jan 16 10:46:56.739: INFO: Unable to read jessie_udp@kubernetes.default.svc.cluster.local from pod dns-6388/dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf: the server is currently unable to handle the request (get pods dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf)
Jan 16 10:47:26.777: INFO: Unable to read jessie_tcp@kubernetes.default.svc.cluster.local from pod dns-6388/dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf: the server is currently unable to handle the request (get pods dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf)
Jan 16 10:47:26.777: INFO: Lookups using dns-6388/dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf failed for: [wheezy_udp@kubernetes.default.svc.cluster.local wheezy_tcp@kubernetes.default.svc.cluster.local jessie_udp@kubernetes.default.svc.cluster.local jessie_tcp@kubernetes.default.svc.cluster.local]

Jan 16 10:48:01.676: INFO: Unable to read wheezy_udp@kubernetes.default.svc.cluster.local from pod dns-6388/dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf: the server is currently unable to handle the request (get pods dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf)
Jan 16 10:48:31.715: INFO: Unable to read wheezy_tcp@kubernetes.default.svc.cluster.local from pod dns-6388/dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf: the server is currently unable to handle the request (get pods dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf)
Jan 16 10:49:01.755: INFO: Unable to read jessie_udp@kubernetes.default.svc.cluster.local from pod dns-6388/dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf: the server is currently unable to handle the request (get pods dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf)
Jan 16 10:49:31.790: INFO: Unable to read jessie_tcp@kubernetes.default.svc.cluster.local from pod dns-6388/dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf: the server is currently unable to handle the request (get pods dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf)
Jan 16 10:49:31.790: INFO: Lookups using dns-6388/dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf failed for: [wheezy_udp@kubernetes.default.svc.cluster.local wheezy_tcp@kubernetes.default.svc.cluster.local jessie_udp@kubernetes.default.svc.cluster.local jessie_tcp@kubernetes.default.svc.cluster.local]

Jan 16 10:50:06.675: INFO: Unable to read wheezy_udp@kubernetes.default.svc.cluster.local from pod dns-6388/dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf: the server is currently unable to handle the request (get pods dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf)
Jan 16 10:50:36.714: INFO: Unable to read wheezy_tcp@kubernetes.default.svc.cluster.local from pod dns-6388/dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf: the server is currently unable to handle the request (get pods dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf)
Jan 16 10:51:06.750: INFO: Unable to read jessie_udp@kubernetes.default.svc.cluster.local from pod dns-6388/dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf: the server is currently unable to handle the request (get pods dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf)
Jan 16 10:51:36.789: INFO: Unable to read jessie_tcp@kubernetes.default.svc.cluster.local from pod dns-6388/dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf: the server is currently unable to handle the request (get pods dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf)
Jan 16 10:51:36.789: INFO: Lookups using dns-6388/dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf failed for: [wheezy_udp@kubernetes.default.svc.cluster.local wheezy_tcp@kubernetes.default.svc.cluster.local jessie_udp@kubernetes.default.svc.cluster.local jessie_tcp@kubernetes.default.svc.cluster.local]

Jan 16 10:52:11.655: INFO: Unable to read wheezy_udp@kubernetes.default.svc.cluster.local from pod dns-6388/dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf: the server is currently unable to handle the request (get pods dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf)
Jan 16 10:52:41.710: INFO: Unable to read wheezy_tcp@kubernetes.default.svc.cluster.local from pod dns-6388/dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf: the server is currently unable to handle the request (get pods dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf)
Jan 16 10:53:11.747: INFO: Unable to read jessie_udp@kubernetes.default.svc.cluster.local from pod dns-6388/dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf: the server is currently unable to handle the request (get pods dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf)
Jan 16 10:53:41.789: INFO: Unable to read jessie_tcp@kubernetes.default.svc.cluster.local from pod dns-6388/dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf: the server is currently unable to handle the request (get pods dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf)
Jan 16 10:53:41.789: INFO: Lookups using dns-6388/dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf failed for: [wheezy_udp@kubernetes.default.svc.cluster.local wheezy_tcp@kubernetes.default.svc.cluster.local jessie_udp@kubernetes.default.svc.cluster.local jessie_tcp@kubernetes.default.svc.cluster.local]

Jan 16 10:54:11.839: INFO: Unable to read wheezy_udp@kubernetes.default.svc.cluster.local from pod dns-6388/dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf: the server is currently unable to handle the request (get pods dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf)
Jan 16 10:54:41.889: INFO: Unable to read wheezy_tcp@kubernetes.default.svc.cluster.local from pod dns-6388/dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf: the server is currently unable to handle the request (get pods dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf)
Jan 16 10:55:11.925: INFO: Unable to read jessie_udp@kubernetes.default.svc.cluster.local from pod dns-6388/dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf: the server is currently unable to handle the request (get pods dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf)
Jan 16 10:55:41.967: INFO: Unable to read jessie_tcp@kubernetes.default.svc.cluster.local from pod dns-6388/dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf: the server is currently unable to handle the request (get pods dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf)
Jan 16 10:55:41.967: INFO: Lookups using dns-6388/dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf failed for: [wheezy_udp@kubernetes.default.svc.cluster.local wheezy_tcp@kubernetes.default.svc.cluster.local jessie_udp@kubernetes.default.svc.cluster.local jessie_tcp@kubernetes.default.svc.cluster.local]

Jan 16 10:55:41.967: INFO: Unexpected error: 
    <*errors.errorString | 0xc000215d70>: {
        s: "timed out waiting for the condition",
    }
Jan 16 10:55:41.967: FAIL: timed out waiting for the condition

Full Stack Trace
k8s.io/kubernetes/test/e2e/network.assertFilesContain({0xc00120c480?, 0x4?, 0x4?}, {0x75bfff4?, 0x7?}, 0xc001da8900?, {0x801e128?, 0xc001e22000?}, 0x0?, {0x0, ...})
	test/e2e/network/dns_common.go:455 +0x1dc
k8s.io/kubernetes/test/e2e/network.assertFilesExist(...)
	test/e2e/network/dns_common.go:449
k8s.io/kubernetes/test/e2e/network.validateDNSResults(0xc000de6e10, 0xc001da8900, {0xc00120c480, 0x4, 0x4})
	test/e2e/network/dns_common.go:512 +0x452
k8s.io/kubernetes/test/e2e/network.glob..func2.1()
	test/e2e/network/dns.go:66 +0x43e
�[1mSTEP:�[0m deleting the pod �[38;5;243m01/16/23 10:55:41.967�[0m
[AfterEach] [sig-network] DNS
  test/e2e/framework/node/init/init.go:32
Jan 16 10:55:42.016: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-network] DNS
  test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-network] DNS
  dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/16/23 10:55:42.062�[0m
�[1mSTEP:�[0m Collecting events from namespace "dns-6388". �[38;5;243m01/16/23 10:55:42.062�[0m
�[1mSTEP:�[0m Found 10 events. �[38;5;243m01/16/23 10:55:42.1�[0m
Jan 16 10:55:42.100: INFO: At 2023-01-16 10:41:08 +0000 UTC - event for dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf: {default-scheduler } Scheduled: Successfully assigned dns-6388/dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf to nodes-us-east1-b-2xs4
Jan 16 10:55:42.100: INFO: At 2023-01-16 10:41:12 +0000 UTC - event for dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf: {kubelet nodes-us-east1-b-2xs4} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine
Jan 16 10:55:42.100: INFO: At 2023-01-16 10:41:12 +0000 UTC - event for dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf: {kubelet nodes-us-east1-b-2xs4} Created: Created container webserver
Jan 16 10:55:42.100: INFO: At 2023-01-16 10:41:13 +0000 UTC - event for dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf: {kubelet nodes-us-east1-b-2xs4} Started: Started container webserver
Jan 16 10:55:42.100: INFO: At 2023-01-16 10:41:13 +0000 UTC - event for dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf: {kubelet nodes-us-east1-b-2xs4} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine
Jan 16 10:55:42.100: INFO: At 2023-01-16 10:41:13 +0000 UTC - event for dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf: {kubelet nodes-us-east1-b-2xs4} Created: Created container querier
Jan 16 10:55:42.100: INFO: At 2023-01-16 10:41:13 +0000 UTC - event for dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf: {kubelet nodes-us-east1-b-2xs4} Started: Started container querier
Jan 16 10:55:42.100: INFO: At 2023-01-16 10:41:13 +0000 UTC - event for dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf: {kubelet nodes-us-east1-b-2xs4} Pulled: Container image "registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7" already present on machine
Jan 16 10:55:42.100: INFO: At 2023-01-16 10:41:13 +0000 UTC - event for dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf: {kubelet nodes-us-east1-b-2xs4} Created: Created container jessie-querier
Jan 16 10:55:42.100: INFO: At 2023-01-16 10:41:14 +0000 UTC - event for dns-test-abe4cf79-7525-4e22-b3e2-6919165a0daf: {kubelet nodes-us-east1-b-2xs4} Started: Started container jessie-querier
Jan 16 10:55:42.134: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Jan 16 10:55:42.134: INFO: 
Jan 16 10:55:42.173: INFO: 
Logging node info for node control-plane-us-east1-b-nc4v
Jan 16 10:55:42.210: INFO: Node Info: &Node{ObjectMeta:{control-plane-us-east1-b-nc4v    3e043433-4a0a-4797-aed2-d532c70362c4 44644 0 2023-01-16 10:33:51 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-standard-2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east1 failure-domain.beta.kubernetes.io/zone:us-east1-b kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:control-plane-us-east1-b-nc4v kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node-role.kubernetes.io/node: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:e2-standard-2 topology.gke.io/zone:us-east1-b topology.kubernetes.io/region:us-east1 topology.kubernetes.io/zone:us-east1-b] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-jkns-gci-gce-protobuf/zones/us-east1-b/instances/control-plane-us-east1-b-nc4v"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.4/32 projectcalico.org/IPv4IPIPTunnelAddr:100.126.126.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-16 10:33:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-16 10:34:31 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:34:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {calico-node Update v1 2023-01-16 10:34:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-16 10:34:51 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-16 10:34:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"

Result	FAILURE
Tests	16 failed / 840 succeeded
Started	2023-01-16 10:28
Elapsed	51m45s
Revision	master