Result | FAILURE |
Tests | 9 failed / 832 succeeded |
Started | |
Elapsed | 52m57s |
Revision | master |
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\sshould\sbe\sable\sto\sdeny\spod\sand\sconfigmap\screation\s\[Conformance\]$'
test/e2e/apimachinery/webhook.go:889 k8s.io/kubernetes/test/e2e/apimachinery.registerWebhook(0xc000d8b340, {0xc002e69a80, 0xc}, 0x0?, 0x29f0e40?) test/e2e/apimachinery/webhook.go:889 +0x611 k8s.io/kubernetes/test/e2e/apimachinery.glob..func27.4() test/e2e/apimachinery/webhook.go:197 +0x45from junit_01.xml
{"msg":"FAILED [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should be able to deny pod and configmap creation [Conformance]","completed":13,"skipped":105,"failed":2,"failures":["[sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should mutate custom resource [Conformance]","[sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should be able to deny pod and configmap creation [Conformance]"]} [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/framework/framework.go:186 �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m12/07/22 17:01:10.895�[0m Dec 7 17:01:10.895: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP:�[0m Building a namespace api object, basename webhook �[38;5;243m12/07/22 17:01:10.896�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m12/07/22 17:01:11.224�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m12/07/22 17:01:11.337�[0m [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/apimachinery/webhook.go:89 �[1mSTEP:�[0m Setting up server cert �[38;5;243m12/07/22 17:01:11.549�[0m �[1mSTEP:�[0m Create role binding to let webhook read extension-apiserver-authentication �[38;5;243m12/07/22 17:01:12.062�[0m �[1mSTEP:�[0m Deploying the webhook pod �[38;5;243m12/07/22 17:01:12.209�[0m �[1mSTEP:�[0m Wait for the deployment to be ready �[38;5;243m12/07/22 17:01:12.34�[0m Dec 7 17:01:12.512: INFO: deployment "sample-webhook-deployment" doesn't have the required revision set Dec 7 17:01:14.649: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 7, 17, 1, 12, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 7, 17, 1, 12, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 7, 17, 1, 12, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 7, 17, 1, 12, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-5d85dd8cdb\" is progressing."}}, CollisionCount:(*int32)(nil)} �[1mSTEP:�[0m Deploying the webhook service �[38;5;243m12/07/22 17:01:16.678�[0m �[1mSTEP:�[0m Verifying the service has paired with the endpoint �[38;5;243m12/07/22 17:01:16.725�[0m Dec 7 17:01:17.726: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1 [It] should be able to deny pod and configmap creation [Conformance] test/e2e/apimachinery/webhook.go:196 �[1mSTEP:�[0m Registering the webhook via the AdmissionRegistration API �[38;5;243m12/07/22 17:01:17.761�[0m Dec 7 17:01:27.885: INFO: Waiting for webhook configuration to be ready... Dec 7 17:01:38.054: INFO: Waiting for webhook configuration to be ready... Dec 7 17:01:48.161: INFO: Waiting for webhook configuration to be ready... Dec 7 17:01:58.256: INFO: Waiting for webhook configuration to be ready... Dec 7 17:02:08.329: INFO: Waiting for webhook configuration to be ready... Dec 7 17:02:08.329: INFO: Unexpected error: waiting for webhook configuration to be ready: <*errors.errorString | 0xc000205b50>: { s: "timed out waiting for the condition", } Dec 7 17:02:08.329: FAIL: waiting for webhook configuration to be ready: timed out waiting for the condition Full Stack Trace k8s.io/kubernetes/test/e2e/apimachinery.registerWebhook(0xc000d8b340, {0xc002e69a80, 0xc}, 0x0?, 0x29f0e40?) test/e2e/apimachinery/webhook.go:889 +0x611 k8s.io/kubernetes/test/e2e/apimachinery.glob..func27.4() test/e2e/apimachinery/webhook.go:197 +0x45 [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/framework/framework.go:187 �[1mSTEP:�[0m Collecting events from namespace "webhook-7535". �[38;5;243m12/07/22 17:02:08.329�[0m �[1mSTEP:�[0m Found 6 events. �[38;5;243m12/07/22 17:02:08.356�[0m Dec 7 17:02:08.356: INFO: At 2022-12-07 17:01:12 +0000 UTC - event for sample-webhook-deployment: {deployment-controller } ScalingReplicaSet: Scaled up replica set sample-webhook-deployment-5d85dd8cdb to 1 Dec 7 17:02:08.356: INFO: At 2022-12-07 17:01:12 +0000 UTC - event for sample-webhook-deployment-5d85dd8cdb: {replicaset-controller } SuccessfulCreate: Created pod: sample-webhook-deployment-5d85dd8cdb-8hrmp Dec 7 17:02:08.356: INFO: At 2022-12-07 17:01:12 +0000 UTC - event for sample-webhook-deployment-5d85dd8cdb-8hrmp: {default-scheduler } Scheduled: Successfully assigned webhook-7535/sample-webhook-deployment-5d85dd8cdb-8hrmp to nodes-us-east4-a-nfxp Dec 7 17:02:08.356: INFO: At 2022-12-07 17:01:14 +0000 UTC - event for sample-webhook-deployment-5d85dd8cdb-8hrmp: {kubelet nodes-us-east4-a-nfxp} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.40" already present on machine Dec 7 17:02:08.356: INFO: At 2022-12-07 17:01:14 +0000 UTC - event for sample-webhook-deployment-5d85dd8cdb-8hrmp: {kubelet nodes-us-east4-a-nfxp} Created: Created container sample-webhook Dec 7 17:02:08.356: INFO: At 2022-12-07 17:01:14 +0000 UTC - event for sample-webhook-deployment-5d85dd8cdb-8hrmp: {kubelet nodes-us-east4-a-nfxp} Started: Started container sample-webhook Dec 7 17:02:08.384: INFO: POD NODE PHASE GRACE CONDITIONS Dec 7 17:02:08.384: INFO: sample-webhook-deployment-5d85dd8cdb-8hrmp nodes-us-east4-a-nfxp Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-07 17:01:12 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-12-07 17:01:15 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-07 17:01:15 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-07 17:01:12 +0000 UTC }] Dec 7 17:02:08.384: INFO: Dec 7 17:02:08.448: INFO: Logging node info for node control-plane-us-east4-a-vd91 Dec 7 17:02:08.474: INFO: Node Info: &Node{ObjectMeta:{control-plane-us-east4-a-vd91 74d54d8e-e0bc-4c7d-bf3c-5b66ce025930 22281 0 2022-12-07 16:47:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-standard-2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east4 failure-domain.beta.kubernetes.io/zone:us-east4-a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:control-plane-us-east4-a-vd91 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node-role.kubernetes.io/node: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:e2-standard-2 topology.gke.io/zone:us-east4-a topology.kubernetes.io/region:us-east4 topology.kubernetes.io/zone:us-east4-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/instances/control-plane-us-east4-a-vd91"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.5/32 projectcalico.org/IPv4IPIPTunnelAddr:100.101.18.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-12-07 16:47:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2022-12-07 16:48:18 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {calico-node Update v1 2022-12-07 16:48:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}}}}} status} {cloud-controller-manager Update v1 2022-12-07 16:48:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2022-12-07 16:48:34 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:48:39 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:48:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-12-07 16:59:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:gce://gce-gci-upg-lat-1-3-ctl-skew/us-east4-a/control-plane-us-east4-a-vd91,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8332767232 0} {<nil>} 8137468Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8227909632 0} {<nil>} 8035068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-07 16:48:39 +0000 UTC,LastTransitionTime:2022-12-07 16:48:39 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-07 16:59:10 +0000 UTC,LastTransitionTime:2022-12-07 16:47:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-07 16:59:10 +0000 UTC,LastTransitionTime:2022-12-07 16:47:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-07 16:59:10 +0000 UTC,LastTransitionTime:2022-12-07 16:47:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-07 16:59:10 +0000 UTC,LastTransitionTime:2022-12-07 16:48:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.5,},NodeAddress{Type:ExternalIP,Address:35.245.23.229,},NodeAddress{Type:Hostname,Address:control-plane-us-east4-a-vd91,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e32750d839dd77bbe79d8a1be267141a,SystemUUID:e32750d8-39dd-77bb-e79d-8a1be267141a,BootID:572b6367-72b8-4ea4-b559-5c84c54662ce,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gcr.io/k8s-staging-etcdadm/etcd-manager@sha256:f3a63853502cb3956fa708fea524be3b333036ebc1cd1dadd81abd9f1fe61043 gcr.io/k8s-staging-etcdadm/etcd-manager:v3.0.20220831-21-g12041b4c],SizeBytes:231516108,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.25.4],SizeBytes:129085904,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.25.4],SizeBytes:118436153,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.4],SizeBytes:63279305,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.25.4],SizeBytes:51921208,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-alpha.2],SizeBytes:42203406,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-alpha.2],SizeBytes:41463710,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:2b6acd7f677f76ffe12ecf3ea7df92eb9b1bdb07336d1ac2a54c7631fb753f7e docker.io/calico/kube-controllers:v3.24.5],SizeBytes:31137169,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2 registry.k8s.io/sig-storage/csi-provisioner:v2.1.0],SizeBytes:21205045,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:50c3cfd458fc8e0bf3c8c521eac39172009382fc66dc5044a330d137c6ed0b09 registry.k8s.io/sig-storage/csi-attacher:v3.1.0],SizeBytes:20103959,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a registry.k8s.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:9af9bf28430b00a0cedeb2ec29acadce45e6afcecd8bdf31c793c624cfa75fa7 registry.k8s.io/sig-storage/csi-snapshotter:v3.0.3],SizeBytes:19500777,},ContainerImage{Names:[docker.io/k8scloudprovidergcp/cloud-controller-manager@sha256:881fd1095937638040723973ade90e6700f1c831a78fb585a3227c4d021b0df9 docker.io/k8scloudprovidergcp/cloud-controller-manager:latest],SizeBytes:18702875,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-alpha.2],SizeBytes:4954573,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 7 17:02:08.475: INFO: Logging kubelet events for node control-plane-us-east4-a-vd91 Dec 7 17:02:08.503: INFO: Logging pods the kubelet thinks is on node control-plane-us-east4-a-vd91 Dec 7 17:02:08.540: INFO: dns-controller-8946976bb-6t8hj started at 2022-12-07 16:48:19 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:08.540: INFO: Container dns-controller ready: true, restart count 0 Dec 7 17:02:08.540: INFO: etcd-manager-events-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:08.540: INFO: Container etcd-manager ready: true, restart count 0 Dec 7 17:02:08.540: INFO: kube-controller-manager-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:08.540: INFO: Container kube-controller-manager ready: true, restart count 2 Dec 7 17:02:08.540: INFO: kops-controller-mnn6f started at 2022-12-07 16:48:18 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:08.540: INFO: Container kops-controller ready: true, restart count 0 Dec 7 17:02:08.540: INFO: cloud-controller-manager-xd6xh started at 2022-12-07 16:48:18 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:08.540: INFO: Container cloud-controller-manager ready: true, restart count 0 Dec 7 17:02:08.540: INFO: kube-proxy-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:08.540: INFO: Container kube-proxy ready: true, restart count 0 Dec 7 17:02:08.540: INFO: csi-gce-pd-node-z9fsn started at 2022-12-07 16:48:06 +0000 UTC (0+2 container statuses recorded) Dec 7 17:02:08.540: INFO: Container csi-driver-registrar ready: true, restart count 0 Dec 7 17:02:08.540: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 17:02:08.540: INFO: calico-node-zgvgx started at 2022-12-07 16:48:06 +0000 UTC (3+1 container statuses recorded) Dec 7 17:02:08.540: INFO: Init container upgrade-ipam ready: true, restart count 0 Dec 7 17:02:08.540: INFO: Init container install-cni ready: true, restart count 0 Dec 7 17:02:08.540: INFO: Init container mount-bpffs ready: true, restart count 0 Dec 7 17:02:08.540: INFO: Container calico-node ready: true, restart count 0 Dec 7 17:02:08.540: INFO: calico-kube-controllers-7bc879d8d6-t4vrx started at 2022-12-07 16:48:39 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:08.540: INFO: Container calico-kube-controllers ready: true, restart count 0 Dec 7 17:02:08.540: INFO: kube-apiserver-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+2 container statuses recorded) Dec 7 17:02:08.540: INFO: Container healthcheck ready: true, restart count 0 Dec 7 17:02:08.540: INFO: Container kube-apiserver ready: true, restart count 1 Dec 7 17:02:08.540: INFO: csi-gce-pd-controller-689c9f4444-b5qql started at 2022-12-07 16:48:18 +0000 UTC (0+5 container statuses recorded) Dec 7 17:02:08.540: INFO: Container csi-attacher ready: true, restart count 0 Dec 7 17:02:08.540: INFO: Container csi-provisioner ready: true, restart count 0 Dec 7 17:02:08.540: INFO: Container csi-resizer ready: true, restart count 0 Dec 7 17:02:08.540: INFO: Container csi-snapshotter ready: true, restart count 0 Dec 7 17:02:08.540: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 17:02:08.540: INFO: kube-scheduler-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:08.540: INFO: Container kube-scheduler ready: true, restart count 0 Dec 7 17:02:08.540: INFO: etcd-manager-main-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:08.540: INFO: Container etcd-manager ready: true, restart count 0 Dec 7 17:02:08.744: INFO: Latency metrics for node control-plane-us-east4-a-vd91 Dec 7 17:02:08.744: INFO: Logging node info for node nodes-us-east4-a-5680 Dec 7 17:02:08.772: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east4-a-5680 b9473b45-598f-43c3-aafc-dc872ade1274 30502 0 2022-12-07 16:49:31 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east4 failure-domain.beta.kubernetes.io/zone:us-east4-a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east4-a-5680 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east4-a topology.hostpath.csi/node:nodes-us-east4-a-5680 topology.kubernetes.io/region:us-east4 topology.kubernetes.io/zone:us-east4-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/instances/nodes-us-east4-a-5680"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.3/32 projectcalico.org/IPv4IPIPTunnelAddr:100.119.115.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2022-12-07 16:49:31 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2022-12-07 16:49:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2022-12-07 16:49:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:49:41 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:49:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {calico-node Update v1 2022-12-07 16:49:59 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {e2e.test Update v1 2022-12-07 17:01:20 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2022-12-07 17:01:52 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2022-12-07 17:02:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:gce://gce-gci-upg-lat-1-3-ctl-skew/us-east4-a/nodes-us-east4-a-5680,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-07 16:49:58 +0000 UTC,LastTransitionTime:2022-12-07 16:49:58 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-07 17:02:08 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-07 17:02:08 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-07 17:02:08 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-07 17:02:08 +0000 UTC,LastTransitionTime:2022-12-07 16:49:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.3,},NodeAddress{Type:ExternalIP,Address:34.86.83.231,},NodeAddress{Type:Hostname,Address:nodes-us-east4-a-5680,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:5676434e0327952eef9a8130969e32db,SystemUUID:5676434e-0327-952e-ef9a-8130969e32db,BootID:f4cd280b-a7ea-43c2-b78f-d43fab064010,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.4],SizeBytes:63279305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:51155161,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 registry.k8s.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/disks/pvc-4cf95d93-a6b9-4e59-aef4-61e17fa29359 kubernetes.io/csi/pd.csi.storage.gke.io^projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/disks/pvc-80019b4d-1982-4a98-b8b1-d28c5c76124e],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/disks/pvc-80019b4d-1982-4a98-b8b1-d28c5c76124e,DevicePath:,},},Config:nil,},} Dec 7 17:02:08.773: INFO: Logging kubelet events for node nodes-us-east4-a-5680 Dec 7 17:02:08.803: INFO: Logging pods the kubelet thinks is on node nodes-us-east4-a-5680 Dec 7 17:02:08.837: INFO: test-ss-0 started at 2022-12-07 17:01:22 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:08.837: INFO: Container webserver ready: true, restart count 0 Dec 7 17:02:08.837: INFO: httpd started at 2022-12-07 17:01:44 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:08.837: INFO: Container httpd ready: true, restart count 0 Dec 7 17:02:08.837: INFO: up-down-1-x5d9s started at 2022-12-07 17:01:16 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:08.837: INFO: Container up-down-1 ready: true, restart count 0 Dec 7 17:02:08.837: INFO: calico-node-wvpd9 started at 2022-12-07 16:49:34 +0000 UTC (3+1 container statuses recorded) Dec 7 17:02:08.837: INFO: Init container upgrade-ipam ready: true, restart count 0 Dec 7 17:02:08.837: INFO: Init container install-cni ready: true, restart count 0 Dec 7 17:02:08.837: INFO: Init container mount-bpffs ready: true, restart count 0 Dec 7 17:02:08.837: INFO: Container calico-node ready: true, restart count 0 Dec 7 17:02:08.837: INFO: liveness-9f4d8f96-21dd-42da-b6d4-3e7e375b21f5 started at 2022-12-07 16:59:45 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:08.838: INFO: Container agnhost-container ready: true, restart count 0 Dec 7 17:02:08.838: INFO: up-down-2-nrlv5 started at 2022-12-07 17:01:22 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:08.838: INFO: Container up-down-2 ready: true, restart count 0 Dec 7 17:02:08.838: INFO: pvc-tester-gb94s started at 2022-12-07 17:02:01 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:08.838: INFO: Container write-pod ready: false, restart count 0 Dec 7 17:02:08.838: INFO: kube-proxy-nodes-us-east4-a-5680 started at 2022-12-07 16:49:34 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:08.838: INFO: Container kube-proxy ready: true, restart count 0 Dec 7 17:02:08.838: INFO: ss-2 started at 2022-12-07 17:01:39 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:08.838: INFO: Container webserver ready: true, restart count 0 Dec 7 17:02:08.838: INFO: ss2-0 started at 2022-12-07 17:01:45 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:08.838: INFO: Container webserver ready: true, restart count 0 Dec 7 17:02:08.838: INFO: ss2-2 started at 2022-12-07 17:02:06 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:08.838: INFO: Container webserver ready: false, restart count 0 Dec 7 17:02:08.838: INFO: startup-1e72e948-4395-48f0-84f7-7999ee94c8b1 started at 2022-12-07 17:01:30 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:08.838: INFO: Container busybox ready: true, restart count 0 Dec 7 17:02:08.838: INFO: deployment-97c6466db-lqzxc started at 2022-12-07 17:01:08 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:08.838: INFO: Container nginx ready: false, restart count 0 Dec 7 17:02:08.838: INFO: pod-ephm-test-projected-c4n4 started at 2022-12-07 17:01:22 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:08.838: INFO: Container test-container-subpath-projected-c4n4 ready: false, restart count 0 Dec 7 17:02:08.838: INFO: csi-gce-pd-node-9n22s started at 2022-12-07 16:49:34 +0000 UTC (0+2 container statuses recorded) Dec 7 17:02:08.838: INFO: Container csi-driver-registrar ready: true, restart count 0 Dec 7 17:02:08.838: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 17:02:09.082: INFO: Latency metrics for node nodes-us-east4-a-5680 Dec 7 17:02:09.082: INFO: Logging node info for node nodes-us-east4-a-nfxp Dec 7 17:02:09.108: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east4-a-nfxp 958029bf-d66a-424c-a80d-b1d485df133b 30406 0 2022-12-07 16:49:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east4 failure-domain.beta.kubernetes.io/zone:us-east4-a io.kubernetes.storage.mock/node:some-mock-node kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east4-a-nfxp kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east4-a topology.hostpath.csi/node:nodes-us-east4-a-nfxp topology.kubernetes.io/region:us-east4 topology.kubernetes.io/zone:us-east4-a] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-5151":"nodes-us-east4-a-nfxp","csi-mock-csi-mock-volumes-2697":"nodes-us-east4-a-nfxp","pd.csi.storage.gke.io":"projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/instances/nodes-us-east4-a-nfxp"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.6/32 projectcalico.org/IPv4IPIPTunnelAddr:100.113.109.192 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2022-12-07 16:49:28 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2022-12-07 16:49:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2022-12-07 16:49:29 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:49:41 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:49:48 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {calico-node Update v1 2022-12-07 16:49:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {e2e.test Update v1 2022-12-07 17:01:20 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2022-12-07 17:01:39 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2022-12-07 17:02:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:gce://gce-gci-upg-lat-1-3-ctl-skew/us-east4-a/nodes-us-east4-a-nfxp,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-07 16:49:53 +0000 UTC,LastTransitionTime:2022-12-07 16:49:53 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-07 17:02:05 +0000 UTC,LastTransitionTime:2022-12-07 16:49:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-07 17:02:05 +0000 UTC,LastTransitionTime:2022-12-07 16:49:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-07 17:02:05 +0000 UTC,LastTransitionTime:2022-12-07 16:49:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-07 17:02:05 +0000 UTC,LastTransitionTime:2022-12-07 16:49:48 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.6,},NodeAddress{Type:ExternalIP,Address:34.145.242.1,},NodeAddress{Type:Hostname,Address:nodes-us-east4-a-nfxp,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:796e3b73d867da488abd70a5df2fe10f,SystemUUID:796e3b73-d867-da48-8abd-70a5df2fe10f,BootID:2b784aad-5897-4bb4-bb49-6bae545d9488,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:b83c1d70989e1fe87583607bf5aee1ee34e52773d4755b95f5cf5a451962f3a4 registry.k8s.io/etcd:3.5.5-0],SizeBytes:102417044,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.4],SizeBytes:63279305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:51155161,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:f9c93b92b6ff750b41a93c4e4fe0bfe384597aeb841e2539d5444815c55b2d8f registry.k8s.io/e2e-test-images/sample-apiserver:1.17.5],SizeBytes:24316368,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:aa60f453d64dfb3c3fd9e7306f988c36c6352c4f2d956aa90467f2808091effa registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.5],SizeBytes:15209420,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:7000509,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-5151^d03dd29b-7650-11ed-86a4-3a032d592738],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/disks/pvc-584849ee-9bda-401f-b082-2917e251db99,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-5151^d03dd29b-7650-11ed-86a4-3a032d592738,DevicePath:,},},Config:nil,},} Dec 7 17:02:09.108: INFO: Logging kubelet events for node nodes-us-east4-a-nfxp Dec 7 17:02:09.137: INFO: Logging pods the kubelet thinks is on node nodes-us-east4-a-nfxp Dec 7 17:02:09.187: INFO: sample-webhook-deployment-5d85dd8cdb-8hrmp started at 2022-12-07 17:01:12 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:09.187: INFO: Container sample-webhook ready: true, restart count 0 Dec 7 17:02:09.187: INFO: inline-volume-tester-hvkbf started at 2022-12-07 17:01:38 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:09.187: INFO: Container csi-volume-tester ready: true, restart count 0 Dec 7 17:02:09.187: INFO: coredns-677fff9cfb-rv6b9 started at 2022-12-07 16:49:48 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:09.187: INFO: Container coredns ready: true, restart count 0 Dec 7 17:02:09.187: INFO: hostexec-nodes-us-east4-a-nfxp-nsrb6 started at 2022-12-07 17:02:04 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:09.187: INFO: Container agnhost-container ready: true, restart count 0 Dec 7 17:02:09.187: INFO: coredns-autoscaler-db7b97744-2cf6q started at 2022-12-07 16:49:48 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:09.187: INFO: Container autoscaler ready: true, restart count 0 Dec 7 17:02:09.187: INFO: csi-mockplugin-0 started at 2022-12-07 17:01:57 +0000 UTC (0+3 container statuses recorded) Dec 7 17:02:09.187: INFO: Container csi-provisioner ready: true, restart count 0 Dec 7 17:02:09.187: INFO: Container driver-registrar ready: true, restart count 0 Dec 7 17:02:09.187: INFO: Container mock ready: true, restart count 0 Dec 7 17:02:09.187: INFO: csi-hostpathplugin-0 started at 2022-12-07 17:01:35 +0000 UTC (0+7 container statuses recorded) Dec 7 17:02:09.187: INFO: Container csi-attacher ready: true, restart count 0 Dec 7 17:02:09.187: INFO: Container csi-provisioner ready: true, restart count 0 Dec 7 17:02:09.187: INFO: Container csi-resizer ready: true, restart count 0 Dec 7 17:02:09.187: INFO: Container csi-snapshotter ready: true, restart count 0 Dec 7 17:02:09.187: INFO: Container hostpath ready: true, restart count 0 Dec 7 17:02:09.187: INFO: Container liveness-probe ready: true, restart count 0 Dec 7 17:02:09.187: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 7 17:02:09.187: INFO: kube-proxy-nodes-us-east4-a-nfxp started at 2022-12-07 16:49:29 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:09.187: INFO: Container kube-proxy ready: true, restart count 0 Dec 7 17:02:09.187: INFO: up-down-1-z878m started at 2022-12-07 17:01:16 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:09.187: INFO: Container up-down-1 ready: true, restart count 0 Dec 7 17:02:09.187: INFO: csi-gce-pd-node-vcz5x started at 2022-12-07 16:49:29 +0000 UTC (0+2 container statuses recorded) Dec 7 17:02:09.187: INFO: Container csi-driver-registrar ready: true, restart count 0 Dec 7 17:02:09.187: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 17:02:09.187: INFO: csi-mockplugin-attacher-0 started at 2022-12-07 17:01:57 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:09.187: INFO: Container csi-attacher ready: true, restart count 0 Dec 7 17:02:09.187: INFO: ss-1 started at 2022-12-07 17:02:05 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:09.187: INFO: Container webserver ready: false, restart count 0 Dec 7 17:02:09.187: INFO: pod-dc9c5cd6-d4fd-447c-8497-d5419bf0c552 started at 2022-12-07 17:02:08 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:09.187: INFO: Container write-pod ready: false, restart count 0 Dec 7 17:02:09.187: INFO: calico-node-f2cxs started at 2022-12-07 16:49:29 +0000 UTC (3+1 container statuses recorded) Dec 7 17:02:09.187: INFO: Init container upgrade-ipam ready: true, restart count 0 Dec 7 17:02:09.187: INFO: Init container install-cni ready: true, restart count 0 Dec 7 17:02:09.187: INFO: Init container mount-bpffs ready: true, restart count 0 Dec 7 17:02:09.187: INFO: Container calico-node ready: true, restart count 0 Dec 7 17:02:09.187: INFO: dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4 started at 2022-12-07 16:53:00 +0000 UTC (0+3 container statuses recorded) Dec 7 17:02:09.187: INFO: Container jessie-querier ready: true, restart count 0 Dec 7 17:02:09.187: INFO: Container querier ready: true, restart count 0 Dec 7 17:02:09.187: INFO: Container webserver ready: true, restart count 0 Dec 7 17:02:09.187: INFO: up-down-2-jr9lf started at 2022-12-07 17:01:22 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:09.187: INFO: Container up-down-2 ready: true, restart count 0 Dec 7 17:02:09.187: INFO: ss2-1 started at 2022-12-07 17:00:56 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:09.187: INFO: Container webserver ready: true, restart count 0 Dec 7 17:02:09.426: INFO: Latency metrics for node nodes-us-east4-a-nfxp Dec 7 17:02:09.426: INFO: Logging node info for node nodes-us-east4-a-v6tj Dec 7 17:02:09.463: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east4-a-v6tj 7ccb4554-dd50-4efe-9be3-d3667475ec25 29771 0 2022-12-07 16:49:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east4 failure-domain.beta.kubernetes.io/zone:us-east4-a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east4-a-v6tj kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east4-a topology.hostpath.csi/node:nodes-us-east4-a-v6tj topology.kubernetes.io/region:us-east4 topology.kubernetes.io/zone:us-east4-a] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-3434":"nodes-us-east4-a-v6tj","csi-mock-csi-mock-volumes-3109":"nodes-us-east4-a-v6tj","pd.csi.storage.gke.io":"projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/instances/nodes-us-east4-a-v6tj"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.2/32 projectcalico.org/IPv4IPIPTunnelAddr:100.123.60.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2022-12-07 16:49:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2022-12-07 16:49:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2022-12-07 16:49:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:49:49 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:49:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {calico-node Update v1 2022-12-07 16:50:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {e2e.test Update v1 2022-12-07 17:01:21 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2022-12-07 17:01:39 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2022-12-07 17:01:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:gce://gce-gci-upg-lat-1-3-ctl-skew/us-east4-a/nodes-us-east4-a-v6tj,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111196160 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006338560 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-07 16:49:59 +0000 UTC,LastTransitionTime:2022-12-07 16:49:59 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-07 17:01:31 +0000 UTC,LastTransitionTime:2022-12-07 16:49:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-07 17:01:31 +0000 UTC,LastTransitionTime:2022-12-07 16:49:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-07 17:01:31 +0000 UTC,LastTransitionTime:2022-12-07 16:49:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-07 17:01:31 +0000 UTC,LastTransitionTime:2022-12-07 16:49:55 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.2,},NodeAddress{Type:ExternalIP,Address:35.245.137.186,},NodeAddress{Type:Hostname,Address:nodes-us-east4-a-v6tj,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a77ca3c48fb1245cde75a6429c818c0a,SystemUUID:a77ca3c4-8fb1-245c-de75-a6429c818c0a,BootID:65d4f8a4-acd4-4bf8-8839-6a047fad3abd,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.4],SizeBytes:63279305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:51155161,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 registry.k8s.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:7000509,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-3434^c5afaae6-7650-11ed-be9b-8624d218853b],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-3434^c5afaae6-7650-11ed-be9b-8624d218853b,DevicePath:,},},Config:nil,},} Dec 7 17:02:09.463: INFO: Logging kubelet events for node nodes-us-east4-a-v6tj Dec 7 17:02:09.495: INFO: Logging pods the kubelet thinks is on node nodes-us-east4-a-v6tj Dec 7 17:02:09.531: INFO: ss2-0 started at 2022-12-07 17:01:49 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:09.532: INFO: Container webserver ready: true, restart count 0 Dec 7 17:02:09.532: INFO: up-down-2-wfzp7 started at 2022-12-07 17:01:22 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:09.532: INFO: Container up-down-2 ready: true, restart count 0 Dec 7 17:02:09.532: INFO: kube-proxy-nodes-us-east4-a-v6tj started at 2022-12-07 16:49:37 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:09.532: INFO: Container kube-proxy ready: true, restart count 0 Dec 7 17:02:09.532: INFO: csi-mockplugin-0 started at 2022-12-07 17:01:46 +0000 UTC (0+3 container statuses recorded) Dec 7 17:02:09.532: INFO: Container csi-provisioner ready: true, restart count 0 Dec 7 17:02:09.532: INFO: Container driver-registrar ready: true, restart count 0 Dec 7 17:02:09.532: INFO: Container mock ready: true, restart count 0 Dec 7 17:02:09.532: INFO: pod-subpath-test-inlinevolume-f8gl started at 2022-12-07 17:01:52 +0000 UTC (2+1 container statuses recorded) Dec 7 17:02:09.532: INFO: Init container init-volume-inlinevolume-f8gl ready: true, restart count 0 Dec 7 17:02:09.532: INFO: Init container test-init-volume-inlinevolume-f8gl ready: true, restart count 0 Dec 7 17:02:09.532: INFO: Container test-container-subpath-inlinevolume-f8gl ready: false, restart count 0 Dec 7 17:02:09.532: INFO: calico-node-j442m started at 2022-12-07 16:49:37 +0000 UTC (3+1 container statuses recorded) Dec 7 17:02:09.532: INFO: Init container upgrade-ipam ready: true, restart count 0 Dec 7 17:02:09.532: INFO: Init container install-cni ready: true, restart count 0 Dec 7 17:02:09.532: INFO: Init container mount-bpffs ready: true, restart count 0 Dec 7 17:02:09.532: INFO: Container calico-node ready: true, restart count 0 Dec 7 17:02:09.532: INFO: ss2-2 started at 2022-12-07 17:01:50 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:09.532: INFO: Container webserver ready: true, restart count 0 Dec 7 17:02:09.532: INFO: downward-api-c36714c6-f5a4-4003-8d7a-d82927ff5825 started at 2022-12-07 17:01:54 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:09.532: INFO: Container dapi-container ready: false, restart count 0 Dec 7 17:02:09.532: INFO: up-down-1-hxq6j started at 2022-12-07 17:01:16 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:09.532: INFO: Container up-down-1 ready: true, restart count 0 Dec 7 17:02:09.532: INFO: inline-volume-tester-x4m4w started at 2022-12-07 17:01:20 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:09.532: INFO: Container csi-volume-tester ready: true, restart count 0 Dec 7 17:02:09.532: INFO: cleanup40-3bfa47d0-8c27-4b33-a673-fd1ef4701b9f-jm97r started at 2022-12-07 17:01:21 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:09.532: INFO: Container cleanup40-3bfa47d0-8c27-4b33-a673-fd1ef4701b9f ready: true, restart count 0 Dec 7 17:02:09.532: INFO: csi-hostpathplugin-0 started at 2022-12-07 17:01:17 +0000 UTC (0+7 container statuses recorded) Dec 7 17:02:09.532: INFO: Container csi-attacher ready: true, restart count 0 Dec 7 17:02:09.532: INFO: Container csi-provisioner ready: true, restart count 0 Dec 7 17:02:09.532: INFO: Container csi-resizer ready: true, restart count 0 Dec 7 17:02:09.532: INFO: Container csi-snapshotter ready: true, restart count 0 Dec 7 17:02:09.532: INFO: Container hostpath ready: true, restart count 0 Dec 7 17:02:09.532: INFO: Container liveness-probe ready: true, restart count 0 Dec 7 17:02:09.532: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 7 17:02:09.532: INFO: pvc-volume-tester-p492p started at <nil> (0+0 container statuses recorded) Dec 7 17:02:09.532: INFO: csi-gce-pd-node-n8bdx started at 2022-12-07 16:49:37 +0000 UTC (0+2 container statuses recorded) Dec 7 17:02:09.532: INFO: Container csi-driver-registrar ready: true, restart count 0 Dec 7 17:02:09.532: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 17:02:09.532: INFO: test-webserver-a36ffc4e-c902-4377-a67d-79ee0a457752 started at 2022-12-07 16:58:12 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:09.532: INFO: Container test-webserver ready: true, restart count 0 Dec 7 17:02:09.532: INFO: pod-projected-configmaps-08757862-addc-40af-a32b-842bf7b5e853 started at 2022-12-07 17:01:53 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:09.532: INFO: Container agnhost-container ready: false, restart count 0 Dec 7 17:02:09.532: INFO: hostexec-nodes-us-east4-a-v6tj-n4p6r started at <nil> (0+0 container statuses recorded) Dec 7 17:02:09.754: INFO: Latency metrics for node nodes-us-east4-a-v6tj Dec 7 17:02:09.754: INFO: Logging node info for node nodes-us-east4-a-zc10 Dec 7 17:02:09.782: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east4-a-zc10 c6cc41ef-a044-4188-9cdf-9af619e808de 30529 0 2022-12-07 16:49:31 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east4 failure-domain.beta.kubernetes.io/zone:us-east4-a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east4-a-zc10 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east4-a topology.hostpath.csi/node:nodes-us-east4-a-zc10 topology.kubernetes.io/region:us-east4 topology.kubernetes.io/zone:us-east4-a] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-3279":"nodes-us-east4-a-zc10","pd.csi.storage.gke.io":"projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/instances/nodes-us-east4-a-zc10"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.4/32 projectcalico.org/IPv4IPIPTunnelAddr:100.113.50.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-12-07 16:49:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:49:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2022-12-07 16:49:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:49:41 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:49:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {calico-node Update v1 2022-12-07 16:49:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {e2e.test Update v1 2022-12-07 17:01:20 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2022-12-07 17:02:09 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2022-12-07 17:02:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:gce://gce-gci-upg-lat-1-3-ctl-skew/us-east4-a/nodes-us-east4-a-zc10,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111196160 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006338560 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-07 16:49:56 +0000 UTC,LastTransitionTime:2022-12-07 16:49:56 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-07 17:02:09 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-07 17:02:09 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-07 17:02:09 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-07 17:02:09 +0000 UTC,LastTransitionTime:2022-12-07 16:49:52 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.4,},NodeAddress{Type:ExternalIP,Address:35.188.253.28,},NodeAddress{Type:Hostname,Address:nodes-us-east4-a-zc10,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f5ea7883cc54b5706859a5f8fc4d24dd,SystemUUID:f5ea7883-cc54-b570-6859-a5f8fc4d24dd,BootID:6c425a3b-23de-41f0-9815-f6a0465861ce,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.4],SizeBytes:63279305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:51155161,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:7000509,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/disks/pvc-a5cc56b8-d8e5-4487-b9b8-e2af120cc039],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/disks/pvc-a5cc56b8-d8e5-4487-b9b8-e2af120cc039,DevicePath:,},},Config:nil,},} Dec 7 17:02:09.783: INFO: Logging kubelet events for node nodes-us-east4-a-zc10 Dec 7 17:02:09.815: INFO: Logging pods the kubelet thinks is on node nodes-us-east4-a-zc10 Dec 7 17:02:09.848: INFO: calico-node-g8zkr started at 2022-12-07 16:49:35 +0000 UTC (3+1 container statuses recorded) Dec 7 17:02:09.849: INFO: Init container upgrade-ipam ready: true, restart count 0 Dec 7 17:02:09.849: INFO: Init container install-cni ready: true, restart count 0 Dec 7 17:02:09.849: INFO: Init container mount-bpffs ready: true, restart count 0 Dec 7 17:02:09.849: INFO: Container calico-node ready: true, restart count 0 Dec 7 17:02:09.849: INFO: kube-proxy-nodes-us-east4-a-zc10 started at 2022-12-07 16:49:35 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:09.849: INFO: Container kube-proxy ready: true, restart count 0 Dec 7 17:02:09.849: INFO: coredns-677fff9cfb-4b88c started at 2022-12-07 16:50:04 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:09.849: INFO: Container coredns ready: true, restart count 0 Dec 7 17:02:09.849: INFO: csi-gce-pd-node-vtqz7 started at 2022-12-07 16:49:35 +0000 UTC (0+2 container statuses recorded) Dec 7 17:02:09.849: INFO: Container csi-driver-registrar ready: true, restart count 0 Dec 7 17:02:09.849: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 17:02:09.849: INFO: ss2-1 started at 2022-12-07 17:02:04 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:09.849: INFO: Container webserver ready: true, restart count 0 Dec 7 17:02:09.849: INFO: ss-0 started at 2022-12-07 17:00:21 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:09.849: INFO: Container webserver ready: true, restart count 0 Dec 7 17:02:09.849: INFO: csi-hostpathplugin-0 started at 2022-12-07 17:01:04 +0000 UTC (0+7 container statuses recorded) Dec 7 17:02:09.849: INFO: Container csi-attacher ready: true, restart count 0 Dec 7 17:02:09.849: INFO: Container csi-provisioner ready: true, restart count 0 Dec 7 17:02:09.849: INFO: Container csi-resizer ready: true, restart count 0 Dec 7 17:02:09.849: INFO: Container csi-snapshotter ready: true, restart count 0 Dec 7 17:02:09.849: INFO: Container hostpath ready: true, restart count 0 Dec 7 17:02:09.849: INFO: Container liveness-probe ready: true, restart count 0 Dec 7 17:02:09.849: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 7 17:02:10.030: INFO: Latency metrics for node nodes-us-east4-a-zc10 �[1mSTEP:�[0m Collecting events from namespace "webhook-7535-markers". �[38;5;243m12/07/22 17:02:10.03�[0m �[1mSTEP:�[0m Found 0 events. �[38;5;243m12/07/22 17:02:10.058�[0m Dec 7 17:02:10.087: INFO: POD NODE PHASE GRACE CONDITIONS Dec 7 17:02:10.087: INFO: Dec 7 17:02:10.114: INFO: Logging node info for node control-plane-us-east4-a-vd91 Dec 7 17:02:10.152: INFO: Node Info: &Node{ObjectMeta:{control-plane-us-east4-a-vd91 74d54d8e-e0bc-4c7d-bf3c-5b66ce025930 22281 0 2022-12-07 16:47:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-standard-2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east4 failure-domain.beta.kubernetes.io/zone:us-east4-a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:control-plane-us-east4-a-vd91 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node-role.kubernetes.io/node: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:e2-standard-2 topology.gke.io/zone:us-east4-a topology.kubernetes.io/region:us-east4 topology.kubernetes.io/zone:us-east4-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/instances/control-plane-us-east4-a-vd91"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.5/32 projectcalico.org/IPv4IPIPTunnelAddr:100.101.18.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-12-07 16:47:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2022-12-07 16:48:18 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {calico-node Update v1 2022-12-07 16:48:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}}}}} status} {cloud-controller-manager Update v1 2022-12-07 16:48:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2022-12-07 16:48:34 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:48:39 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:48:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-12-07 16:59:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:gce://gce-gci-upg-lat-1-3-ctl-skew/us-east4-a/control-plane-us-east4-a-vd91,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8332767232 0} {<nil>} 8137468Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8227909632 0} {<nil>} 8035068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-07 16:48:39 +0000 UTC,LastTransitionTime:2022-12-07 16:48:39 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-07 16:59:10 +0000 UTC,LastTransitionTime:2022-12-07 16:47:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-07 16:59:10 +0000 UTC,LastTransitionTime:2022-12-07 16:47:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-07 16:59:10 +0000 UTC,LastTransitionTime:2022-12-07 16:47:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-07 16:59:10 +0000 UTC,LastTransitionTime:2022-12-07 16:48:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.5,},NodeAddress{Type:ExternalIP,Address:35.245.23.229,},NodeAddress{Type:Hostname,Address:control-plane-us-east4-a-vd91,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e32750d839dd77bbe79d8a1be267141a,SystemUUID:e32750d8-39dd-77bb-e79d-8a1be267141a,BootID:572b6367-72b8-4ea4-b559-5c84c54662ce,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gcr.io/k8s-staging-etcdadm/etcd-manager@sha256:f3a63853502cb3956fa708fea524be3b333036ebc1cd1dadd81abd9f1fe61043 gcr.io/k8s-staging-etcdadm/etcd-manager:v3.0.20220831-21-g12041b4c],SizeBytes:231516108,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.25.4],SizeBytes:129085904,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.25.4],SizeBytes:118436153,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.4],SizeBytes:63279305,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.25.4],SizeBytes:51921208,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-alpha.2],SizeBytes:42203406,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-alpha.2],SizeBytes:41463710,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:2b6acd7f677f76ffe12ecf3ea7df92eb9b1bdb07336d1ac2a54c7631fb753f7e docker.io/calico/kube-controllers:v3.24.5],SizeBytes:31137169,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2 registry.k8s.io/sig-storage/csi-provisioner:v2.1.0],SizeBytes:21205045,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:50c3cfd458fc8e0bf3c8c521eac39172009382fc66dc5044a330d137c6ed0b09 registry.k8s.io/sig-storage/csi-attacher:v3.1.0],SizeBytes:20103959,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a registry.k8s.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:9af9bf28430b00a0cedeb2ec29acadce45e6afcecd8bdf31c793c624cfa75fa7 registry.k8s.io/sig-storage/csi-snapshotter:v3.0.3],SizeBytes:19500777,},ContainerImage{Names:[docker.io/k8scloudprovidergcp/cloud-controller-manager@sha256:881fd1095937638040723973ade90e6700f1c831a78fb585a3227c4d021b0df9 docker.io/k8scloudprovidergcp/cloud-controller-manager:latest],SizeBytes:18702875,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-alpha.2],SizeBytes:4954573,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 7 17:02:10.152: INFO: Logging kubelet events for node control-plane-us-east4-a-vd91 Dec 7 17:02:10.183: INFO: Logging pods the kubelet thinks is on node control-plane-us-east4-a-vd91 Dec 7 17:02:10.225: INFO: etcd-manager-events-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:10.225: INFO: Container etcd-manager ready: true, restart count 0 Dec 7 17:02:10.225: INFO: kube-controller-manager-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:10.225: INFO: Container kube-controller-manager ready: true, restart count 2 Dec 7 17:02:10.225: INFO: dns-controller-8946976bb-6t8hj started at 2022-12-07 16:48:19 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:10.225: INFO: Container dns-controller ready: true, restart count 0 Dec 7 17:02:10.225: INFO: kube-proxy-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:10.225: INFO: Container kube-proxy ready: true, restart count 0 Dec 7 17:02:10.225: INFO: csi-gce-pd-node-z9fsn started at 2022-12-07 16:48:06 +0000 UTC (0+2 container statuses recorded) Dec 7 17:02:10.225: INFO: Container csi-driver-registrar ready: true, restart count 0 Dec 7 17:02:10.225: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 17:02:10.225: INFO: kops-controller-mnn6f started at 2022-12-07 16:48:18 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:10.225: INFO: Container kops-controller ready: true, restart count 0 Dec 7 17:02:10.225: INFO: cloud-controller-manager-xd6xh started at 2022-12-07 16:48:18 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:10.225: INFO: Container cloud-controller-manager ready: true, restart count 0 Dec 7 17:02:10.225: INFO: calico-node-zgvgx started at 2022-12-07 16:48:06 +0000 UTC (3+1 container statuses recorded) Dec 7 17:02:10.225: INFO: Init container upgrade-ipam ready: true, restart count 0 Dec 7 17:02:10.225: INFO: Init container install-cni ready: true, restart count 0 Dec 7 17:02:10.225: INFO: Init container mount-bpffs ready: true, restart count 0 Dec 7 17:02:10.225: INFO: Container calico-node ready: true, restart count 0 Dec 7 17:02:10.225: INFO: calico-kube-controllers-7bc879d8d6-t4vrx started at 2022-12-07 16:48:39 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:10.225: INFO: Container calico-kube-controllers ready: true, restart count 0 Dec 7 17:02:10.225: INFO: kube-scheduler-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:10.225: INFO: Container kube-scheduler ready: true, restart count 0 Dec 7 17:02:10.225: INFO: etcd-manager-main-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:10.225: INFO: Container etcd-manager ready: true, restart count 0 Dec 7 17:02:10.225: INFO: kube-apiserver-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+2 container statuses recorded) Dec 7 17:02:10.225: INFO: Container healthcheck ready: true, restart count 0 Dec 7 17:02:10.225: INFO: Container kube-apiserver ready: true, restart count 1 Dec 7 17:02:10.225: INFO: csi-gce-pd-controller-689c9f4444-b5qql started at 2022-12-07 16:48:18 +0000 UTC (0+5 container statuses recorded) Dec 7 17:02:10.225: INFO: Container csi-attacher ready: true, restart count 0 Dec 7 17:02:10.225: INFO: Container csi-provisioner ready: true, restart count 0 Dec 7 17:02:10.225: INFO: Container csi-resizer ready: true, restart count 0 Dec 7 17:02:10.225: INFO: Container csi-snapshotter ready: true, restart count 0 Dec 7 17:02:10.225: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 17:02:10.435: INFO: Latency metrics for node control-plane-us-east4-a-vd91 Dec 7 17:02:10.435: INFO: Logging node info for node nodes-us-east4-a-5680 Dec 7 17:02:10.474: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east4-a-5680 b9473b45-598f-43c3-aafc-dc872ade1274 30502 0 2022-12-07 16:49:31 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east4 failure-domain.beta.kubernetes.io/zone:us-east4-a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east4-a-5680 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east4-a topology.hostpath.csi/node:nodes-us-east4-a-5680 topology.kubernetes.io/region:us-east4 topology.kubernetes.io/zone:us-east4-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/instances/nodes-us-east4-a-5680"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.3/32 projectcalico.org/IPv4IPIPTunnelAddr:100.119.115.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2022-12-07 16:49:31 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2022-12-07 16:49:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2022-12-07 16:49:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:49:41 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:49:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {calico-node Update v1 2022-12-07 16:49:59 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {e2e.test Update v1 2022-12-07 17:01:20 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2022-12-07 17:01:52 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2022-12-07 17:02:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:gce://gce-gci-upg-lat-1-3-ctl-skew/us-east4-a/nodes-us-east4-a-5680,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-07 16:49:58 +0000 UTC,LastTransitionTime:2022-12-07 16:49:58 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-07 17:02:08 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-07 17:02:08 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-07 17:02:08 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-07 17:02:08 +0000 UTC,LastTransitionTime:2022-12-07 16:49:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.3,},NodeAddress{Type:ExternalIP,Address:34.86.83.231,},NodeAddress{Type:Hostname,Address:nodes-us-east4-a-5680,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:5676434e0327952eef9a8130969e32db,SystemUUID:5676434e-0327-952e-ef9a-8130969e32db,BootID:f4cd280b-a7ea-43c2-b78f-d43fab064010,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.4],SizeBytes:63279305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:51155161,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 registry.k8s.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/disks/pvc-4cf95d93-a6b9-4e59-aef4-61e17fa29359 kubernetes.io/csi/pd.csi.storage.gke.io^projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/disks/pvc-80019b4d-1982-4a98-b8b1-d28c5c76124e],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/disks/pvc-80019b4d-1982-4a98-b8b1-d28c5c76124e,DevicePath:,},},Config:nil,},} Dec 7 17:02:10.475: INFO: Logging kubelet events for node nodes-us-east4-a-5680 Dec 7 17:02:10.564: INFO: Logging pods the kubelet thinks is on node nodes-us-east4-a-5680 Dec 7 17:02:10.628: INFO: calico-node-wvpd9 started at 2022-12-07 16:49:34 +0000 UTC (3+1 container statuses recorded) Dec 7 17:02:10.628: INFO: Init container upgrade-ipam ready: true, restart count 0 Dec 7 17:02:10.628: INFO: Init container install-cni ready: true, restart count 0 Dec 7 17:02:10.628: INFO: Init container mount-bpffs ready: true, restart count 0 Dec 7 17:02:10.628: INFO: Container calico-node ready: true, restart count 0 Dec 7 17:02:10.628: INFO: liveness-9f4d8f96-21dd-42da-b6d4-3e7e375b21f5 started at 2022-12-07 16:59:45 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:10.628: INFO: Container agnhost-container ready: true, restart count 0 Dec 7 17:02:10.628: INFO: up-down-2-nrlv5 started at 2022-12-07 17:01:22 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:10.628: INFO: Container up-down-2 ready: true, restart count 0 Dec 7 17:02:10.628: INFO: pvc-tester-gb94s started at 2022-12-07 17:02:01 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:10.628: INFO: Container write-pod ready: false, restart count 0 Dec 7 17:02:10.628: INFO: kube-proxy-nodes-us-east4-a-5680 started at 2022-12-07 16:49:34 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:10.628: INFO: Container kube-proxy ready: true, restart count 0 Dec 7 17:02:10.628: INFO: ss-2 started at 2022-12-07 17:01:39 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:10.628: INFO: Container webserver ready: true, restart count 0 Dec 7 17:02:10.628: INFO: ss2-0 started at 2022-12-07 17:01:45 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:10.628: INFO: Container webserver ready: true, restart count 0 Dec 7 17:02:10.628: INFO: ss2-2 started at 2022-12-07 17:02:06 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:10.628: INFO: Container webserver ready: true, restart count 0 Dec 7 17:02:10.628: INFO: startup-1e72e948-4395-48f0-84f7-7999ee94c8b1 started at 2022-12-07 17:01:30 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:10.628: INFO: Container busybox ready: true, restart count 0 Dec 7 17:02:10.628: INFO: deployment-97c6466db-lqzxc started at 2022-12-07 17:01:08 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:10.628: INFO: Container nginx ready: false, restart count 0 Dec 7 17:02:10.628: INFO: pod-ephm-test-projected-c4n4 started at 2022-12-07 17:01:22 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:10.628: INFO: Container test-container-subpath-projected-c4n4 ready: false, restart count 0 Dec 7 17:02:10.628: INFO: csi-gce-pd-node-9n22s started at 2022-12-07 16:49:34 +0000 UTC (0+2 container statuses recorded) Dec 7 17:02:10.628: INFO: Container csi-driver-registrar ready: true, restart count 0 Dec 7 17:02:10.628: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 17:02:10.628: INFO: test-ss-0 started at 2022-12-07 17:01:22 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:10.628: INFO: Container webserver ready: true, restart count 0 Dec 7 17:02:10.628: INFO: httpd started at 2022-12-07 17:01:44 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:10.628: INFO: Container httpd ready: true, restart count 0 Dec 7 17:02:10.628: INFO: up-down-1-x5d9s started at 2022-12-07 17:01:16 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:10.628: INFO: Container up-down-1 ready: false, restart count 0 Dec 7 17:02:11.022: INFO: Latency metrics for node nodes-us-east4-a-5680 Dec 7 17:02:11.022: INFO: Logging node info for node nodes-us-east4-a-nfxp Dec 7 17:02:11.050: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east4-a-nfxp 958029bf-d66a-424c-a80d-b1d485df133b 30406 0 2022-12-07 16:49:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east4 failure-domain.beta.kubernetes.io/zone:us-east4-a io.kubernetes.storage.mock/node:some-mock-node kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east4-a-nfxp kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east4-a topology.hostpath.csi/node:nodes-us-east4-a-nfxp topology.kubernetes.io/region:us-east4 topology.kubernetes.io/zone:us-east4-a] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-5151":"nodes-us-east4-a-nfxp","csi-mock-csi-mock-volumes-2697":"nodes-us-east4-a-nfxp","pd.csi.storage.gke.io":"projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/instances/nodes-us-east4-a-nfxp"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.6/32 projectcalico.org/IPv4IPIPTunnelAddr:100.113.109.192 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2022-12-07 16:49:28 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2022-12-07 16:49:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2022-12-07 16:49:29 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:49:41 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:49:48 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {calico-node Update v1 2022-12-07 16:49:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {e2e.test Update v1 2022-12-07 17:01:20 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2022-12-07 17:01:39 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2022-12-07 17:02:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:gce://gce-gci-upg-lat-1-3-ctl-skew/us-east4-a/nodes-us-east4-a-nfxp,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-07 16:49:53 +0000 UTC,LastTransitionTime:2022-12-07 16:49:53 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-07 17:02:05 +0000 UTC,LastTransitionTime:2022-12-07 16:49:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-07 17:02:05 +0000 UTC,LastTransitionTime:2022-12-07 16:49:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-07 17:02:05 +0000 UTC,LastTransitionTime:2022-12-07 16:49:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-07 17:02:05 +0000 UTC,LastTransitionTime:2022-12-07 16:49:48 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.6,},NodeAddress{Type:ExternalIP,Address:34.145.242.1,},NodeAddress{Type:Hostname,Address:nodes-us-east4-a-nfxp,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:796e3b73d867da488abd70a5df2fe10f,SystemUUID:796e3b73-d867-da48-8abd-70a5df2fe10f,BootID:2b784aad-5897-4bb4-bb49-6bae545d9488,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:b83c1d70989e1fe87583607bf5aee1ee34e52773d4755b95f5cf5a451962f3a4 registry.k8s.io/etcd:3.5.5-0],SizeBytes:102417044,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.4],SizeBytes:63279305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:51155161,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:f9c93b92b6ff750b41a93c4e4fe0bfe384597aeb841e2539d5444815c55b2d8f registry.k8s.io/e2e-test-images/sample-apiserver:1.17.5],SizeBytes:24316368,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:aa60f453d64dfb3c3fd9e7306f988c36c6352c4f2d956aa90467f2808091effa registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.5],SizeBytes:15209420,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:7000509,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-5151^d03dd29b-7650-11ed-86a4-3a032d592738],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/disks/pvc-584849ee-9bda-401f-b082-2917e251db99,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-5151^d03dd29b-7650-11ed-86a4-3a032d592738,DevicePath:,},},Config:nil,},} Dec 7 17:02:11.051: INFO: Logging kubelet events for node nodes-us-east4-a-nfxp Dec 7 17:02:11.081: INFO: Logging pods the kubelet thinks is on node nodes-us-east4-a-nfxp Dec 7 17:02:11.131: INFO: csi-hostpathplugin-0 started at 2022-12-07 17:01:35 +0000 UTC (0+7 container statuses recorded) Dec 7 17:02:11.131: INFO: Container csi-attacher ready: true, restart count 0 Dec 7 17:02:11.131: INFO: Container csi-provisioner ready: true, restart count 0 Dec 7 17:02:11.131: INFO: Container csi-resizer ready: true, restart count 0 Dec 7 17:02:11.131: INFO: Container csi-snapshotter ready: true, restart count 0 Dec 7 17:02:11.131: INFO: Container hostpath ready: true, restart count 0 Dec 7 17:02:11.131: INFO: Container liveness-probe ready: true, restart count 0 Dec 7 17:02:11.131: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 7 17:02:11.131: INFO: kube-proxy-nodes-us-east4-a-nfxp started at 2022-12-07 16:49:29 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:11.131: INFO: Container kube-proxy ready: true, restart count 0 Dec 7 17:02:11.131: INFO: csi-gce-pd-node-vcz5x started at 2022-12-07 16:49:29 +0000 UTC (0+2 container statuses recorded) Dec 7 17:02:11.131: INFO: Container csi-driver-registrar ready: true, restart count 0 Dec 7 17:02:11.131: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 17:02:11.131: INFO: csi-mockplugin-attacher-0 started at 2022-12-07 17:01:57 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:11.131: INFO: Container csi-attacher ready: true, restart count 0 Dec 7 17:02:11.131: INFO: calico-node-f2cxs started at 2022-12-07 16:49:29 +0000 UTC (3+1 container statuses recorded) Dec 7 17:02:11.131: INFO: Init container upgrade-ipam ready: true, restart count 0 Dec 7 17:02:11.131: INFO: Init container install-cni ready: true, restart count 0 Dec 7 17:02:11.131: INFO: Init container mount-bpffs ready: true, restart count 0 Dec 7 17:02:11.131: INFO: Container calico-node ready: true, restart count 0 Dec 7 17:02:11.131: INFO: dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4 started at 2022-12-07 16:53:00 +0000 UTC (0+3 container statuses recorded) Dec 7 17:02:11.131: INFO: Container jessie-querier ready: true, restart count 0 Dec 7 17:02:11.131: INFO: Container querier ready: true, restart count 0 Dec 7 17:02:11.131: INFO: Container webserver ready: true, restart count 0 Dec 7 17:02:11.131: INFO: ss-1 started at 2022-12-07 17:02:05 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:11.131: INFO: Container webserver ready: false, restart count 0 Dec 7 17:02:11.131: INFO: pod-dc9c5cd6-d4fd-447c-8497-d5419bf0c552 started at 2022-12-07 17:02:08 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:11.131: INFO: Container write-pod ready: true, restart count 0 Dec 7 17:02:11.131: INFO: ss2-1 started at 2022-12-07 17:00:56 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:11.131: INFO: Container webserver ready: true, restart count 0 Dec 7 17:02:11.131: INFO: up-down-2-jr9lf started at 2022-12-07 17:01:22 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:11.131: INFO: Container up-down-2 ready: true, restart count 0 Dec 7 17:02:11.131: INFO: coredns-677fff9cfb-rv6b9 started at 2022-12-07 16:49:48 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:11.131: INFO: Container coredns ready: true, restart count 0 Dec 7 17:02:11.131: INFO: sample-webhook-deployment-5d85dd8cdb-8hrmp started at 2022-12-07 17:01:12 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:11.131: INFO: Container sample-webhook ready: true, restart count 0 Dec 7 17:02:11.131: INFO: inline-volume-tester-hvkbf started at 2022-12-07 17:01:38 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:11.131: INFO: Container csi-volume-tester ready: true, restart count 0 Dec 7 17:02:11.131: INFO: coredns-autoscaler-db7b97744-2cf6q started at 2022-12-07 16:49:48 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:11.131: INFO: Container autoscaler ready: true, restart count 0 Dec 7 17:02:11.131: INFO: csi-mockplugin-0 started at 2022-12-07 17:01:57 +0000 UTC (0+3 container statuses recorded) Dec 7 17:02:11.131: INFO: Container csi-provisioner ready: true, restart count 0 Dec 7 17:02:11.131: INFO: Container driver-registrar ready: true, restart count 0 Dec 7 17:02:11.131: INFO: Container mock ready: true, restart count 0 Dec 7 17:02:11.131: INFO: hostexec-nodes-us-east4-a-nfxp-nsrb6 started at 2022-12-07 17:02:04 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:11.131: INFO: Container agnhost-container ready: true, restart count 0 Dec 7 17:02:11.350: INFO: Latency metrics for node nodes-us-east4-a-nfxp Dec 7 17:02:11.350: INFO: Logging node info for node nodes-us-east4-a-v6tj Dec 7 17:02:11.380: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east4-a-v6tj 7ccb4554-dd50-4efe-9be3-d3667475ec25 29771 0 2022-12-07 16:49:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east4 failure-domain.beta.kubernetes.io/zone:us-east4-a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east4-a-v6tj kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east4-a topology.hostpath.csi/node:nodes-us-east4-a-v6tj topology.kubernetes.io/region:us-east4 topology.kubernetes.io/zone:us-east4-a] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-3434":"nodes-us-east4-a-v6tj","csi-mock-csi-mock-volumes-3109":"nodes-us-east4-a-v6tj","pd.csi.storage.gke.io":"projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/instances/nodes-us-east4-a-v6tj"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.2/32 projectcalico.org/IPv4IPIPTunnelAddr:100.123.60.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2022-12-07 16:49:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2022-12-07 16:49:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2022-12-07 16:49:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:49:49 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:49:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {calico-node Update v1 2022-12-07 16:50:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {e2e.test Update v1 2022-12-07 17:01:21 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2022-12-07 17:01:39 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2022-12-07 17:01:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:gce://gce-gci-upg-lat-1-3-ctl-skew/us-east4-a/nodes-us-east4-a-v6tj,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111196160 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006338560 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-07 16:49:59 +0000 UTC,LastTransitionTime:2022-12-07 16:49:59 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-07 17:01:31 +0000 UTC,LastTransitionTime:2022-12-07 16:49:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-07 17:01:31 +0000 UTC,LastTransitionTime:2022-12-07 16:49:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-07 17:01:31 +0000 UTC,LastTransitionTime:2022-12-07 16:49:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-07 17:01:31 +0000 UTC,LastTransitionTime:2022-12-07 16:49:55 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.2,},NodeAddress{Type:ExternalIP,Address:35.245.137.186,},NodeAddress{Type:Hostname,Address:nodes-us-east4-a-v6tj,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a77ca3c48fb1245cde75a6429c818c0a,SystemUUID:a77ca3c4-8fb1-245c-de75-a6429c818c0a,BootID:65d4f8a4-acd4-4bf8-8839-6a047fad3abd,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.4],SizeBytes:63279305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:51155161,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 registry.k8s.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:7000509,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-3434^c5afaae6-7650-11ed-be9b-8624d218853b],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-3434^c5afaae6-7650-11ed-be9b-8624d218853b,DevicePath:,},},Config:nil,},} Dec 7 17:02:11.380: INFO: Logging kubelet events for node nodes-us-east4-a-v6tj Dec 7 17:02:11.409: INFO: Logging pods the kubelet thinks is on node nodes-us-east4-a-v6tj Dec 7 17:02:11.454: INFO: inline-volume-tester-x4m4w started at 2022-12-07 17:01:20 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:11.454: INFO: Container csi-volume-tester ready: true, restart count 0 Dec 7 17:02:11.454: INFO: up-down-1-hxq6j started at 2022-12-07 17:01:16 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:11.454: INFO: Container up-down-1 ready: true, restart count 0 Dec 7 17:02:11.454: INFO: pvc-volume-tester-p492p started at 2022-12-07 17:01:58 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:11.454: INFO: Container volume-tester ready: true, restart count 0 Dec 7 17:02:11.454: INFO: csi-hostpathplugin-0 started at 2022-12-07 17:01:17 +0000 UTC (0+7 container statuses recorded) Dec 7 17:02:11.454: INFO: Container csi-attacher ready: true, restart count 0 Dec 7 17:02:11.454: INFO: Container csi-provisioner ready: true, restart count 0 Dec 7 17:02:11.454: INFO: Container csi-resizer ready: true, restart count 0 Dec 7 17:02:11.454: INFO: Container csi-snapshotter ready: true, restart count 0 Dec 7 17:02:11.454: INFO: Container hostpath ready: true, restart count 0 Dec 7 17:02:11.454: INFO: Container liveness-probe ready: true, restart count 0 Dec 7 17:02:11.454: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 7 17:02:11.454: INFO: test-webserver-a36ffc4e-c902-4377-a67d-79ee0a457752 started at 2022-12-07 16:58:12 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:11.454: INFO: Container test-webserver ready: true, restart count 0 Dec 7 17:02:11.454: INFO: csi-gce-pd-node-n8bdx started at 2022-12-07 16:49:37 +0000 UTC (0+2 container statuses recorded) Dec 7 17:02:11.454: INFO: Container csi-driver-registrar ready: true, restart count 0 Dec 7 17:02:11.454: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 17:02:11.454: INFO: pod-projected-configmaps-08757862-addc-40af-a32b-842bf7b5e853 started at 2022-12-07 17:01:53 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:11.454: INFO: Container agnhost-container ready: false, restart count 0 Dec 7 17:02:11.454: INFO: hostexec-nodes-us-east4-a-v6tj-n4p6r started at 2022-12-07 17:01:58 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:11.454: INFO: Container agnhost-container ready: true, restart count 0 Dec 7 17:02:11.454: INFO: ss2-0 started at 2022-12-07 17:01:49 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:11.454: INFO: Container webserver ready: true, restart count 0 Dec 7 17:02:11.454: INFO: csi-mockplugin-0 started at 2022-12-07 17:01:46 +0000 UTC (0+3 container statuses recorded) Dec 7 17:02:11.454: INFO: Container csi-provisioner ready: true, restart count 0 Dec 7 17:02:11.454: INFO: Container driver-registrar ready: true, restart count 0 Dec 7 17:02:11.454: INFO: Container mock ready: true, restart count 0 Dec 7 17:02:11.454: INFO: up-down-2-wfzp7 started at 2022-12-07 17:01:22 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:11.454: INFO: Container up-down-2 ready: true, restart count 0 Dec 7 17:02:11.454: INFO: kube-proxy-nodes-us-east4-a-v6tj started at 2022-12-07 16:49:37 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:11.454: INFO: Container kube-proxy ready: true, restart count 0 Dec 7 17:02:11.454: INFO: ss2-2 started at 2022-12-07 17:01:50 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:11.454: INFO: Container webserver ready: true, restart count 0 Dec 7 17:02:11.454: INFO: downward-api-c36714c6-f5a4-4003-8d7a-d82927ff5825 started at 2022-12-07 17:01:54 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:11.454: INFO: Container dapi-container ready: false, restart count 0 Dec 7 17:02:11.454: INFO: calico-node-j442m started at 2022-12-07 16:49:37 +0000 UTC (3+1 container statuses recorded) Dec 7 17:02:11.454: INFO: Init container upgrade-ipam ready: true, restart count 0 Dec 7 17:02:11.454: INFO: Init container install-cni ready: true, restart count 0 Dec 7 17:02:11.454: INFO: Init container mount-bpffs ready: true, restart count 0 Dec 7 17:02:11.454: INFO: Container calico-node ready: true, restart count 0 Dec 7 17:02:11.643: INFO: Latency metrics for node nodes-us-east4-a-v6tj Dec 7 17:02:11.643: INFO: Logging node info for node nodes-us-east4-a-zc10 Dec 7 17:02:11.671: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east4-a-zc10 c6cc41ef-a044-4188-9cdf-9af619e808de 30529 0 2022-12-07 16:49:31 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east4 failure-domain.beta.kubernetes.io/zone:us-east4-a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east4-a-zc10 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east4-a topology.hostpath.csi/node:nodes-us-east4-a-zc10 topology.kubernetes.io/region:us-east4 topology.kubernetes.io/zone:us-east4-a] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-3279":"nodes-us-east4-a-zc10","pd.csi.storage.gke.io":"projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/instances/nodes-us-east4-a-zc10"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.4/32 projectcalico.org/IPv4IPIPTunnelAddr:100.113.50.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-12-07 16:49:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:49:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2022-12-07 16:49:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:49:41 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:49:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {calico-node Update v1 2022-12-07 16:49:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {e2e.test Update v1 2022-12-07 17:01:20 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2022-12-07 17:02:09 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2022-12-07 17:02:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:gce://gce-gci-upg-lat-1-3-ctl-skew/us-east4-a/nodes-us-east4-a-zc10,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111196160 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006338560 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-07 16:49:56 +0000 UTC,LastTransitionTime:2022-12-07 16:49:56 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-07 17:02:09 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-07 17:02:09 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-07 17:02:09 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-07 17:02:09 +0000 UTC,LastTransitionTime:2022-12-07 16:49:52 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.4,},NodeAddress{Type:ExternalIP,Address:35.188.253.28,},NodeAddress{Type:Hostname,Address:nodes-us-east4-a-zc10,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f5ea7883cc54b5706859a5f8fc4d24dd,SystemUUID:f5ea7883-cc54-b570-6859-a5f8fc4d24dd,BootID:6c425a3b-23de-41f0-9815-f6a0465861ce,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.4],SizeBytes:63279305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:51155161,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:7000509,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/disks/pvc-a5cc56b8-d8e5-4487-b9b8-e2af120cc039],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/disks/pvc-a5cc56b8-d8e5-4487-b9b8-e2af120cc039,DevicePath:,},},Config:nil,},} Dec 7 17:02:11.672: INFO: Logging kubelet events for node nodes-us-east4-a-zc10 Dec 7 17:02:11.709: INFO: Logging pods the kubelet thinks is on node nodes-us-east4-a-zc10 Dec 7 17:02:11.744: INFO: csi-hostpathplugin-0 started at 2022-12-07 17:01:04 +0000 UTC (0+7 container statuses recorded) Dec 7 17:02:11.744: INFO: Container csi-attacher ready: true, restart count 0 Dec 7 17:02:11.744: INFO: Container csi-provisioner ready: true, restart count 0 Dec 7 17:02:11.744: INFO: Container csi-resizer ready: true, restart count 0 Dec 7 17:02:11.744: INFO: Container csi-snapshotter ready: true, restart count 0 Dec 7 17:02:11.744: INFO: Container hostpath ready: true, restart count 0 Dec 7 17:02:11.744: INFO: Container liveness-probe ready: true, restart count 0 Dec 7 17:02:11.744: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 7 17:02:11.744: INFO: kube-proxy-nodes-us-east4-a-zc10 started at 2022-12-07 16:49:35 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:11.744: INFO: Container kube-proxy ready: true, restart count 0 Dec 7 17:02:11.744: INFO: calico-node-g8zkr started at 2022-12-07 16:49:35 +0000 UTC (3+1 container statuses recorded) Dec 7 17:02:11.744: INFO: Init container upgrade-ipam ready: true, restart count 0 Dec 7 17:02:11.744: INFO: Init container install-cni ready: true, restart count 0 Dec 7 17:02:11.744: INFO: Init container mount-bpffs ready: true, restart count 0 Dec 7 17:02:11.744: INFO: Container calico-node ready: true, restart count 0 Dec 7 17:02:11.744: INFO: csi-gce-pd-node-vtqz7 started at 2022-12-07 16:49:35 +0000 UTC (0+2 container statuses recorded) Dec 7 17:02:11.744: INFO: Container csi-driver-registrar ready: true, restart count 0 Dec 7 17:02:11.744: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 17:02:11.744: INFO: coredns-677fff9cfb-4b88c started at 2022-12-07 16:50:04 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:11.744: INFO: Container coredns ready: true, restart count 0 Dec 7 17:02:11.744: INFO: ss-0 started at 2022-12-07 17:00:21 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:11.744: INFO: Container webserver ready: true, restart count 0 Dec 7 17:02:11.744: INFO: ss2-1 started at 2022-12-07 17:02:04 +0000 UTC (0+1 container statuses recorded) Dec 7 17:02:11.744: INFO: Container webserver ready: true, restart count 0 Dec 7 17:02:11.916: INFO: Latency metrics for node nodes-us-east4-a-zc10 Dec 7 17:02:11.916: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP:�[0m Destroying namespace "webhook-7535" for this suite. �[38;5;243m12/07/22 17:02:11.95�[0m �[1mSTEP:�[0m Destroying namespace "webhook-7535-markers" for this suite. �[38;5;243m12/07/22 17:02:11.984�[0m [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/apimachinery/webhook.go:104
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\sshould\smutate\scustom\sresource\s\[Conformance\]$'
test/e2e/apimachinery/webhook.go:1808 k8s.io/kubernetes/test/e2e/apimachinery.registerMutatingWebhookForCustomResource(0xc000d8b340, {0xc001066630, 0xc}, 0xc0025bfd10, 0xc002e7eea0, 0x0?) test/e2e/apimachinery/webhook.go:1808 +0xd51 k8s.io/kubernetes/test/e2e/apimachinery.glob..func27.11() test/e2e/apimachinery/webhook.go:296 +0xadfrom junit_01.xml
{"msg":"FAILED [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should mutate custom resource [Conformance]","completed":7,"skipped":27,"failed":1,"failures":["[sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should mutate custom resource [Conformance]"]} [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/framework/framework.go:186 �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m12/07/22 16:57:51.699�[0m Dec 7 16:57:51.699: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP:�[0m Building a namespace api object, basename webhook �[38;5;243m12/07/22 16:57:51.7�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m12/07/22 16:57:51.971�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m12/07/22 16:57:52.033�[0m [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/apimachinery/webhook.go:89 �[1mSTEP:�[0m Setting up server cert �[38;5;243m12/07/22 16:57:52.231�[0m �[1mSTEP:�[0m Create role binding to let webhook read extension-apiserver-authentication �[38;5;243m12/07/22 16:57:52.465�[0m �[1mSTEP:�[0m Deploying the webhook pod �[38;5;243m12/07/22 16:57:52.607�[0m �[1mSTEP:�[0m Wait for the deployment to be ready �[38;5;243m12/07/22 16:57:52.74�[0m Dec 7 16:57:52.924: INFO: deployment "sample-webhook-deployment" doesn't have the required revision set Dec 7 16:57:55.042: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 7, 16, 57, 52, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 7, 16, 57, 52, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 7, 16, 57, 53, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 7, 16, 57, 52, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-5d85dd8cdb\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 7 16:57:57.072: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 7, 16, 57, 52, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 7, 16, 57, 52, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 7, 16, 57, 53, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 7, 16, 57, 52, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-5d85dd8cdb\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 7 16:57:59.071: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 7, 16, 57, 52, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 7, 16, 57, 52, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 7, 16, 57, 53, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 7, 16, 57, 52, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-5d85dd8cdb\" is progressing."}}, CollisionCount:(*int32)(nil)} �[1mSTEP:�[0m Deploying the webhook service �[38;5;243m12/07/22 16:58:01.076�[0m �[1mSTEP:�[0m Verifying the service has paired with the endpoint �[38;5;243m12/07/22 16:58:01.119�[0m Dec 7 16:58:02.120: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1 [It] should mutate custom resource [Conformance] test/e2e/apimachinery/webhook.go:290 Dec 7 16:58:02.154: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP:�[0m Registering the mutating webhook for custom resource e2e-test-webhook-2234-crds.webhook.example.com via the AdmissionRegistration API �[38;5;243m12/07/22 16:58:02.763�[0m Dec 7 16:58:12.869: INFO: Waiting for webhook configuration to be ready... Dec 7 16:58:23.056: INFO: Waiting for webhook configuration to be ready... Dec 7 16:58:33.224: INFO: Waiting for webhook configuration to be ready... Dec 7 16:58:43.518: INFO: Waiting for webhook configuration to be ready... Dec 7 16:58:53.656: INFO: Waiting for webhook configuration to be ready... Dec 7 16:58:53.656: INFO: Unexpected error: waiting for webhook configuration to be ready: <*errors.errorString | 0xc000205b50>: { s: "timed out waiting for the condition", } Dec 7 16:58:53.656: FAIL: waiting for webhook configuration to be ready: timed out waiting for the condition Full Stack Trace k8s.io/kubernetes/test/e2e/apimachinery.registerMutatingWebhookForCustomResource(0xc000d8b340, {0xc001066630, 0xc}, 0xc0025bfd10, 0xc002e7eea0, 0x0?) test/e2e/apimachinery/webhook.go:1808 +0xd51 k8s.io/kubernetes/test/e2e/apimachinery.glob..func27.11() test/e2e/apimachinery/webhook.go:296 +0xad [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/framework/framework.go:187 �[1mSTEP:�[0m Collecting events from namespace "webhook-8654". �[38;5;243m12/07/22 16:58:54.283�[0m �[1mSTEP:�[0m Found 6 events. �[38;5;243m12/07/22 16:58:54.333�[0m Dec 7 16:58:54.333: INFO: At 2022-12-07 16:57:52 +0000 UTC - event for sample-webhook-deployment: {deployment-controller } ScalingReplicaSet: Scaled up replica set sample-webhook-deployment-5d85dd8cdb to 1 Dec 7 16:58:54.333: INFO: At 2022-12-07 16:57:52 +0000 UTC - event for sample-webhook-deployment-5d85dd8cdb: {replicaset-controller } SuccessfulCreate: Created pod: sample-webhook-deployment-5d85dd8cdb-nndk7 Dec 7 16:58:54.333: INFO: At 2022-12-07 16:57:52 +0000 UTC - event for sample-webhook-deployment-5d85dd8cdb-nndk7: {default-scheduler } Scheduled: Successfully assigned webhook-8654/sample-webhook-deployment-5d85dd8cdb-nndk7 to nodes-us-east4-a-nfxp Dec 7 16:58:54.333: INFO: At 2022-12-07 16:57:54 +0000 UTC - event for sample-webhook-deployment-5d85dd8cdb-nndk7: {kubelet nodes-us-east4-a-nfxp} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.40" already present on machine Dec 7 16:58:54.333: INFO: At 2022-12-07 16:57:55 +0000 UTC - event for sample-webhook-deployment-5d85dd8cdb-nndk7: {kubelet nodes-us-east4-a-nfxp} Created: Created container sample-webhook Dec 7 16:58:54.333: INFO: At 2022-12-07 16:57:55 +0000 UTC - event for sample-webhook-deployment-5d85dd8cdb-nndk7: {kubelet nodes-us-east4-a-nfxp} Started: Started container sample-webhook Dec 7 16:58:54.361: INFO: POD NODE PHASE GRACE CONDITIONS Dec 7 16:58:54.361: INFO: sample-webhook-deployment-5d85dd8cdb-nndk7 nodes-us-east4-a-nfxp Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-07 16:57:52 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-12-07 16:57:56 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-07 16:57:56 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-07 16:57:52 +0000 UTC }] Dec 7 16:58:54.361: INFO: Dec 7 16:58:54.463: INFO: Logging node info for node control-plane-us-east4-a-vd91 Dec 7 16:58:54.502: INFO: Node Info: &Node{ObjectMeta:{control-plane-us-east4-a-vd91 74d54d8e-e0bc-4c7d-bf3c-5b66ce025930 6098 0 2022-12-07 16:47:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-standard-2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east4 failure-domain.beta.kubernetes.io/zone:us-east4-a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:control-plane-us-east4-a-vd91 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node-role.kubernetes.io/node: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:e2-standard-2 topology.gke.io/zone:us-east4-a topology.kubernetes.io/region:us-east4 topology.kubernetes.io/zone:us-east4-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/instances/control-plane-us-east4-a-vd91"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.5/32 projectcalico.org/IPv4IPIPTunnelAddr:100.101.18.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-12-07 16:47:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2022-12-07 16:48:18 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {calico-node Update v1 2022-12-07 16:48:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}}}}} status} {cloud-controller-manager Update v1 2022-12-07 16:48:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2022-12-07 16:48:34 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:48:39 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:48:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-12-07 16:54:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:gce://gce-gci-upg-lat-1-3-ctl-skew/us-east4-a/control-plane-us-east4-a-vd91,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8332767232 0} {<nil>} 8137468Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8227909632 0} {<nil>} 8035068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-07 16:48:39 +0000 UTC,LastTransitionTime:2022-12-07 16:48:39 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-07 16:54:04 +0000 UTC,LastTransitionTime:2022-12-07 16:47:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-07 16:54:04 +0000 UTC,LastTransitionTime:2022-12-07 16:47:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-07 16:54:04 +0000 UTC,LastTransitionTime:2022-12-07 16:47:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-07 16:54:04 +0000 UTC,LastTransitionTime:2022-12-07 16:48:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.5,},NodeAddress{Type:ExternalIP,Address:35.245.23.229,},NodeAddress{Type:Hostname,Address:control-plane-us-east4-a-vd91,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e32750d839dd77bbe79d8a1be267141a,SystemUUID:e32750d8-39dd-77bb-e79d-8a1be267141a,BootID:572b6367-72b8-4ea4-b559-5c84c54662ce,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gcr.io/k8s-staging-etcdadm/etcd-manager@sha256:f3a63853502cb3956fa708fea524be3b333036ebc1cd1dadd81abd9f1fe61043 gcr.io/k8s-staging-etcdadm/etcd-manager:v3.0.20220831-21-g12041b4c],SizeBytes:231516108,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.25.4],SizeBytes:129085904,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.25.4],SizeBytes:118436153,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.4],SizeBytes:63279305,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.25.4],SizeBytes:51921208,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-alpha.2],SizeBytes:42203406,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-alpha.2],SizeBytes:41463710,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:2b6acd7f677f76ffe12ecf3ea7df92eb9b1bdb07336d1ac2a54c7631fb753f7e docker.io/calico/kube-controllers:v3.24.5],SizeBytes:31137169,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2 registry.k8s.io/sig-storage/csi-provisioner:v2.1.0],SizeBytes:21205045,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:50c3cfd458fc8e0bf3c8c521eac39172009382fc66dc5044a330d137c6ed0b09 registry.k8s.io/sig-storage/csi-attacher:v3.1.0],SizeBytes:20103959,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a registry.k8s.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:9af9bf28430b00a0cedeb2ec29acadce45e6afcecd8bdf31c793c624cfa75fa7 registry.k8s.io/sig-storage/csi-snapshotter:v3.0.3],SizeBytes:19500777,},ContainerImage{Names:[docker.io/k8scloudprovidergcp/cloud-controller-manager@sha256:881fd1095937638040723973ade90e6700f1c831a78fb585a3227c4d021b0df9 docker.io/k8scloudprovidergcp/cloud-controller-manager:latest],SizeBytes:18702875,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-alpha.2],SizeBytes:4954573,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 7 16:58:54.502: INFO: Logging kubelet events for node control-plane-us-east4-a-vd91 Dec 7 16:58:54.544: INFO: Logging pods the kubelet thinks is on node control-plane-us-east4-a-vd91 Dec 7 16:58:54.635: INFO: calico-kube-controllers-7bc879d8d6-t4vrx started at 2022-12-07 16:48:39 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:54.635: INFO: Container calico-kube-controllers ready: true, restart count 0 Dec 7 16:58:54.635: INFO: etcd-manager-events-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:54.635: INFO: Container etcd-manager ready: true, restart count 0 Dec 7 16:58:54.635: INFO: kube-controller-manager-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:54.635: INFO: Container kube-controller-manager ready: true, restart count 2 Dec 7 16:58:54.635: INFO: calico-node-zgvgx started at 2022-12-07 16:48:06 +0000 UTC (3+1 container statuses recorded) Dec 7 16:58:54.635: INFO: Init container upgrade-ipam ready: true, restart count 0 Dec 7 16:58:54.635: INFO: Init container install-cni ready: true, restart count 0 Dec 7 16:58:54.635: INFO: Init container mount-bpffs ready: true, restart count 0 Dec 7 16:58:54.635: INFO: Container calico-node ready: true, restart count 0 Dec 7 16:58:54.635: INFO: dns-controller-8946976bb-6t8hj started at 2022-12-07 16:48:19 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:54.635: INFO: Container dns-controller ready: true, restart count 0 Dec 7 16:58:54.635: INFO: csi-gce-pd-node-z9fsn started at 2022-12-07 16:48:06 +0000 UTC (0+2 container statuses recorded) Dec 7 16:58:54.635: INFO: Container csi-driver-registrar ready: true, restart count 0 Dec 7 16:58:54.635: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 16:58:54.635: INFO: csi-gce-pd-controller-689c9f4444-b5qql started at 2022-12-07 16:48:18 +0000 UTC (0+5 container statuses recorded) Dec 7 16:58:54.635: INFO: Container csi-attacher ready: true, restart count 0 Dec 7 16:58:54.635: INFO: Container csi-provisioner ready: true, restart count 0 Dec 7 16:58:54.635: INFO: Container csi-resizer ready: true, restart count 0 Dec 7 16:58:54.635: INFO: Container csi-snapshotter ready: true, restart count 0 Dec 7 16:58:54.635: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 16:58:54.635: INFO: kops-controller-mnn6f started at 2022-12-07 16:48:18 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:54.635: INFO: Container kops-controller ready: true, restart count 0 Dec 7 16:58:54.635: INFO: cloud-controller-manager-xd6xh started at 2022-12-07 16:48:18 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:54.635: INFO: Container cloud-controller-manager ready: true, restart count 0 Dec 7 16:58:54.635: INFO: kube-scheduler-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:54.635: INFO: Container kube-scheduler ready: true, restart count 0 Dec 7 16:58:54.635: INFO: etcd-manager-main-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:54.635: INFO: Container etcd-manager ready: true, restart count 0 Dec 7 16:58:54.635: INFO: kube-apiserver-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+2 container statuses recorded) Dec 7 16:58:54.635: INFO: Container healthcheck ready: true, restart count 0 Dec 7 16:58:54.635: INFO: Container kube-apiserver ready: true, restart count 1 Dec 7 16:58:54.635: INFO: kube-proxy-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:54.635: INFO: Container kube-proxy ready: true, restart count 0 Dec 7 16:58:55.023: INFO: Latency metrics for node control-plane-us-east4-a-vd91 Dec 7 16:58:55.023: INFO: Logging node info for node nodes-us-east4-a-5680 Dec 7 16:58:55.113: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east4-a-5680 b9473b45-598f-43c3-aafc-dc872ade1274 20372 0 2022-12-07 16:49:31 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east4 failure-domain.beta.kubernetes.io/zone:us-east4-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east4-a-5680 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east4-a topology.hostpath.csi/node:nodes-us-east4-a-5680 topology.kubernetes.io/region:us-east4 topology.kubernetes.io/zone:us-east4-a] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-5522":"nodes-us-east4-a-5680","csi-hostpath-ephemeral-7154":"nodes-us-east4-a-5680","csi-hostpath-provisioning-3810":"nodes-us-east4-a-5680","csi-hostpath-volume-5950":"nodes-us-east4-a-5680","csi-hostpath-volume-expand-4661":"nodes-us-east4-a-5680","pd.csi.storage.gke.io":"projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/instances/nodes-us-east4-a-5680"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.3/32 projectcalico.org/IPv4IPIPTunnelAddr:100.119.115.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2022-12-07 16:49:31 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2022-12-07 16:49:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2022-12-07 16:49:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:49:41 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:49:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {calico-node Update v1 2022-12-07 16:49:59 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2022-12-07 16:58:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2022-12-07 16:58:33 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:gce://gce-gci-upg-lat-1-3-ctl-skew/us-east4-a/nodes-us-east4-a-5680,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-07 16:49:58 +0000 UTC,LastTransitionTime:2022-12-07 16:49:58 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-07 16:58:32 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-07 16:58:32 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-07 16:58:32 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-07 16:58:32 +0000 UTC,LastTransitionTime:2022-12-07 16:49:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.3,},NodeAddress{Type:ExternalIP,Address:34.86.83.231,},NodeAddress{Type:Hostname,Address:nodes-us-east4-a-5680,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:5676434e0327952eef9a8130969e32db,SystemUUID:5676434e-0327-952e-ef9a-8130969e32db,BootID:f4cd280b-a7ea-43c2-b78f-d43fab064010,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.4],SizeBytes:63279305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:51155161,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 registry.k8s.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-7154^1f441367-7650-11ed-b312-326c8fdc4a6c kubernetes.io/csi/csi-hostpath-volume-5950^5abc4d85-7650-11ed-91be-fa8e7f689512 kubernetes.io/csi/pd.csi.storage.gke.io^projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/disks/pvc-a5cc56b8-d8e5-4487-b9b8-e2af120cc039],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/disks/pvc-a5cc56b8-d8e5-4487-b9b8-e2af120cc039,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-7154^1f441367-7650-11ed-b312-326c8fdc4a6c,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-volume-5950^5abc4d85-7650-11ed-91be-fa8e7f689512,DevicePath:,},},Config:nil,},} Dec 7 16:58:55.113: INFO: Logging kubelet events for node nodes-us-east4-a-5680 Dec 7 16:58:55.167: INFO: Logging pods the kubelet thinks is on node nodes-us-east4-a-5680 Dec 7 16:58:55.212: INFO: inline-volume-tester-r7zzm started at 2022-12-07 16:56:41 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:55.212: INFO: Container csi-volume-tester ready: true, restart count 0 Dec 7 16:58:55.212: INFO: csi-hostpathplugin-0 started at 2022-12-07 16:58:15 +0000 UTC (0+7 container statuses recorded) Dec 7 16:58:55.212: INFO: Container csi-attacher ready: true, restart count 0 Dec 7 16:58:55.212: INFO: Container csi-provisioner ready: true, restart count 0 Dec 7 16:58:55.212: INFO: Container csi-resizer ready: true, restart count 0 Dec 7 16:58:55.212: INFO: Container csi-snapshotter ready: true, restart count 0 Dec 7 16:58:55.212: INFO: Container hostpath ready: true, restart count 0 Dec 7 16:58:55.212: INFO: Container liveness-probe ready: true, restart count 0 Dec 7 16:58:55.212: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 7 16:58:55.212: INFO: csi-hostpathplugin-0 started at 2022-12-07 16:58:17 +0000 UTC (0+7 container statuses recorded) Dec 7 16:58:55.212: INFO: Container csi-attacher ready: true, restart count 0 Dec 7 16:58:55.212: INFO: Container csi-provisioner ready: true, restart count 0 Dec 7 16:58:55.212: INFO: Container csi-resizer ready: true, restart count 0 Dec 7 16:58:55.212: INFO: Container csi-snapshotter ready: true, restart count 0 Dec 7 16:58:55.212: INFO: Container hostpath ready: true, restart count 0 Dec 7 16:58:55.212: INFO: Container liveness-probe ready: true, restart count 0 Dec 7 16:58:55.212: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 7 16:58:55.212: INFO: hostpath-client started at 2022-12-07 16:58:42 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:55.212: INFO: Container hostpath-client ready: true, restart count 0 Dec 7 16:58:55.212: INFO: csi-hostpathplugin-0 started at 2022-12-07 16:57:14 +0000 UTC (0+7 container statuses recorded) Dec 7 16:58:55.212: INFO: Container csi-attacher ready: true, restart count 0 Dec 7 16:58:55.212: INFO: Container csi-provisioner ready: true, restart count 0 Dec 7 16:58:55.212: INFO: Container csi-resizer ready: true, restart count 0 Dec 7 16:58:55.212: INFO: Container csi-snapshotter ready: true, restart count 0 Dec 7 16:58:55.212: INFO: Container hostpath ready: true, restart count 0 Dec 7 16:58:55.212: INFO: Container liveness-probe ready: true, restart count 0 Dec 7 16:58:55.212: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 7 16:58:55.212: INFO: csi-gce-pd-node-9n22s started at 2022-12-07 16:49:34 +0000 UTC (0+2 container statuses recorded) Dec 7 16:58:55.212: INFO: Container csi-driver-registrar ready: true, restart count 0 Dec 7 16:58:55.212: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 16:58:55.212: INFO: pod-terminate-status-2-0 started at <nil> (0+0 container statuses recorded) Dec 7 16:58:55.212: INFO: e2e-ktr7b-6cgtf started at <nil> (0+0 container statuses recorded) Dec 7 16:58:55.212: INFO: csi-hostpathplugin-0 started at 2022-12-07 16:56:35 +0000 UTC (0+7 container statuses recorded) Dec 7 16:58:55.212: INFO: Container csi-attacher ready: true, restart count 0 Dec 7 16:58:55.212: INFO: Container csi-provisioner ready: true, restart count 0 Dec 7 16:58:55.212: INFO: Container csi-resizer ready: true, restart count 0 Dec 7 16:58:55.212: INFO: Container csi-snapshotter ready: true, restart count 0 Dec 7 16:58:55.212: INFO: Container hostpath ready: true, restart count 0 Dec 7 16:58:55.212: INFO: Container liveness-probe ready: true, restart count 0 Dec 7 16:58:55.212: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 7 16:58:55.212: INFO: webserver-845c8977d9-qkbrw started at 2022-12-07 16:58:43 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:55.212: INFO: Container httpd ready: true, restart count 0 Dec 7 16:58:55.212: INFO: agnhost-primary-zssrh started at 2022-12-07 16:58:44 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:55.212: INFO: Container agnhost-primary ready: false, restart count 0 Dec 7 16:58:55.212: INFO: webserver-deployment-845c8977d9-lm79c started at 2022-12-07 16:58:49 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:55.212: INFO: Container httpd ready: false, restart count 0 Dec 7 16:58:55.212: INFO: webserver-845c8977d9-whvm6 started at 2022-12-07 16:58:19 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:55.212: INFO: Container httpd ready: true, restart count 0 Dec 7 16:58:55.212: INFO: calico-node-wvpd9 started at 2022-12-07 16:49:34 +0000 UTC (3+1 container statuses recorded) Dec 7 16:58:55.212: INFO: Init container upgrade-ipam ready: true, restart count 0 Dec 7 16:58:55.212: INFO: Init container install-cni ready: true, restart count 0 Dec 7 16:58:55.212: INFO: Init container mount-bpffs ready: true, restart count 0 Dec 7 16:58:55.212: INFO: Container calico-node ready: true, restart count 0 Dec 7 16:58:55.212: INFO: pod-terminate-status-1-0 started at <nil> (0+0 container statuses recorded) Dec 7 16:58:55.212: INFO: csi-hostpathplugin-0 started at 2022-12-07 16:57:21 +0000 UTC (0+7 container statuses recorded) Dec 7 16:58:55.212: INFO: Container csi-attacher ready: true, restart count 0 Dec 7 16:58:55.212: INFO: Container csi-provisioner ready: true, restart count 0 Dec 7 16:58:55.212: INFO: Container csi-resizer ready: true, restart count 0 Dec 7 16:58:55.212: INFO: Container csi-snapshotter ready: true, restart count 0 Dec 7 16:58:55.212: INFO: Container hostpath ready: true, restart count 0 Dec 7 16:58:55.212: INFO: Container liveness-probe ready: true, restart count 0 Dec 7 16:58:55.212: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 7 16:58:55.212: INFO: ss2-0 started at 2022-12-07 16:58:45 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:55.212: INFO: Container webserver ready: true, restart count 0 Dec 7 16:58:55.212: INFO: webserver-deployment-845c8977d9-nsv4p started at <nil> (0+0 container statuses recorded) Dec 7 16:58:55.212: INFO: webserver-deployment-845c8977d9-fqn7n started at <nil> (0+0 container statuses recorded) Dec 7 16:58:55.212: INFO: kube-proxy-nodes-us-east4-a-5680 started at 2022-12-07 16:49:34 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:55.212: INFO: Container kube-proxy ready: true, restart count 0 Dec 7 16:58:55.212: INFO: netserver-0 started at 2022-12-07 16:58:49 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:55.212: INFO: Container webserver ready: false, restart count 0 Dec 7 16:58:55.212: INFO: ss-0 started at 2022-12-07 16:57:29 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:55.212: INFO: Container webserver ready: true, restart count 0 Dec 7 16:58:55.945: INFO: Latency metrics for node nodes-us-east4-a-5680 Dec 7 16:58:55.945: INFO: Logging node info for node nodes-us-east4-a-nfxp Dec 7 16:58:55.997: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east4-a-nfxp 958029bf-d66a-424c-a80d-b1d485df133b 20224 0 2022-12-07 16:49:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east4 failure-domain.beta.kubernetes.io/zone:us-east4-a io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east4-a-nfxp kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east4-a topology.hostpath.csi/node:nodes-us-east4-a-nfxp topology.kubernetes.io/region:us-east4 topology.kubernetes.io/zone:us-east4-a] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-3139":"csi-mock-csi-mock-volumes-3139","pd.csi.storage.gke.io":"projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/instances/nodes-us-east4-a-nfxp"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.6/32 projectcalico.org/IPv4IPIPTunnelAddr:100.113.109.192 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2022-12-07 16:49:28 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2022-12-07 16:49:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2022-12-07 16:49:29 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:49:41 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:49:48 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {calico-node Update v1 2022-12-07 16:49:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:58:10 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2022-12-07 16:58:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:gce://gce-gci-upg-lat-1-3-ctl-skew/us-east4-a/nodes-us-east4-a-nfxp,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-07 16:49:53 +0000 UTC,LastTransitionTime:2022-12-07 16:49:53 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-07 16:58:29 +0000 UTC,LastTransitionTime:2022-12-07 16:49:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-07 16:58:29 +0000 UTC,LastTransitionTime:2022-12-07 16:49:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-07 16:58:29 +0000 UTC,LastTransitionTime:2022-12-07 16:49:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-07 16:58:29 +0000 UTC,LastTransitionTime:2022-12-07 16:49:48 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.6,},NodeAddress{Type:ExternalIP,Address:34.145.242.1,},NodeAddress{Type:Hostname,Address:nodes-us-east4-a-nfxp,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:796e3b73d867da488abd70a5df2fe10f,SystemUUID:796e3b73-d867-da48-8abd-70a5df2fe10f,BootID:2b784aad-5897-4bb4-bb49-6bae545d9488,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:b83c1d70989e1fe87583607bf5aee1ee34e52773d4755b95f5cf5a451962f3a4 registry.k8s.io/etcd:3.5.5-0],SizeBytes:102417044,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.4],SizeBytes:63279305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:51155161,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:f9c93b92b6ff750b41a93c4e4fe0bfe384597aeb841e2539d5444815c55b2d8f registry.k8s.io/e2e-test-images/sample-apiserver:1.17.5],SizeBytes:24316368,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:aa60f453d64dfb3c3fd9e7306f988c36c6352c4f2d956aa90467f2808091effa registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.5],SizeBytes:15209420,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:7000509,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/disks/pvc-584849ee-9bda-401f-b082-2917e251db99 kubernetes.io/csi/pd.csi.storage.gke.io^projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/disks/pvc-67bad871-3241-42d3-94d1-f625a20ee94b],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/disks/pvc-584849ee-9bda-401f-b082-2917e251db99,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/disks/pvc-67bad871-3241-42d3-94d1-f625a20ee94b,DevicePath:,},},Config:nil,},} Dec 7 16:58:55.997: INFO: Logging kubelet events for node nodes-us-east4-a-nfxp Dec 7 16:58:56.043: INFO: Logging pods the kubelet thinks is on node nodes-us-east4-a-nfxp Dec 7 16:58:56.185: INFO: webserver-deployment-845c8977d9-q7nhv started at 2022-12-07 16:58:49 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:56.185: INFO: Container httpd ready: true, restart count 0 Dec 7 16:58:56.185: INFO: webserver-845c8977d9-kb5xx started at 2022-12-07 16:58:55 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:56.185: INFO: Container httpd ready: false, restart count 0 Dec 7 16:58:56.185: INFO: pvc-volume-tester-ws2nz started at 2022-12-07 16:58:33 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:56.185: INFO: Container volume-tester ready: true, restart count 0 Dec 7 16:58:56.185: INFO: webserver-766c9598db-9x6mf started at <nil> (0+0 container statuses recorded) Dec 7 16:58:56.185: INFO: coredns-677fff9cfb-rv6b9 started at 2022-12-07 16:49:48 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:56.185: INFO: Container coredns ready: true, restart count 0 Dec 7 16:58:56.185: INFO: ss-1 started at 2022-12-07 16:57:57 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:56.185: INFO: Container webserver ready: false, restart count 0 Dec 7 16:58:56.185: INFO: webserver-845c8977d9-7vlb6 started at 2022-12-07 16:58:43 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:56.185: INFO: Container httpd ready: true, restart count 0 Dec 7 16:58:56.185: INFO: netserver-1 started at 2022-12-07 16:58:49 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:56.185: INFO: Container webserver ready: false, restart count 0 Dec 7 16:58:56.185: INFO: coredns-autoscaler-db7b97744-2cf6q started at 2022-12-07 16:49:48 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:56.185: INFO: Container autoscaler ready: true, restart count 0 Dec 7 16:58:56.185: INFO: sample-apiserver-deployment-b5b45d9d4-2fzcf started at 2022-12-07 16:57:55 +0000 UTC (0+2 container statuses recorded) Dec 7 16:58:56.185: INFO: Container etcd ready: true, restart count 0 Dec 7 16:58:56.185: INFO: Container sample-apiserver ready: true, restart count 0 Dec 7 16:58:56.185: INFO: ss-0 started at 2022-12-07 16:57:55 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:56.185: INFO: Container webserver ready: true, restart count 0 Dec 7 16:58:56.185: INFO: sample-webhook-deployment-5d85dd8cdb-nndk7 started at 2022-12-07 16:57:52 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:56.185: INFO: Container sample-webhook ready: true, restart count 0 Dec 7 16:58:56.185: INFO: kube-proxy-nodes-us-east4-a-nfxp started at 2022-12-07 16:49:29 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:56.185: INFO: Container kube-proxy ready: true, restart count 0 Dec 7 16:58:56.185: INFO: csi-mockplugin-0 started at 2022-12-07 16:58:26 +0000 UTC (0+4 container statuses recorded) Dec 7 16:58:56.185: INFO: Container busybox ready: true, restart count 0 Dec 7 16:58:56.185: INFO: Container csi-provisioner ready: true, restart count 0 Dec 7 16:58:56.185: INFO: Container driver-registrar ready: true, restart count 0 Dec 7 16:58:56.185: INFO: Container mock ready: true, restart count 0 Dec 7 16:58:56.185: INFO: csi-gce-pd-node-vcz5x started at 2022-12-07 16:49:29 +0000 UTC (0+2 container statuses recorded) Dec 7 16:58:56.185: INFO: Container csi-driver-registrar ready: true, restart count 0 Dec 7 16:58:56.185: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 16:58:56.185: INFO: webserver-deployment-845c8977d9-5swbh started at 2022-12-07 16:58:49 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:56.185: INFO: Container httpd ready: true, restart count 0 Dec 7 16:58:56.185: INFO: calico-node-f2cxs started at 2022-12-07 16:49:29 +0000 UTC (3+1 container statuses recorded) Dec 7 16:58:56.185: INFO: Init container upgrade-ipam ready: true, restart count 0 Dec 7 16:58:56.185: INFO: Init container install-cni ready: true, restart count 0 Dec 7 16:58:56.185: INFO: Init container mount-bpffs ready: true, restart count 0 Dec 7 16:58:56.185: INFO: Container calico-node ready: true, restart count 0 Dec 7 16:58:56.185: INFO: dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4 started at 2022-12-07 16:53:00 +0000 UTC (0+3 container statuses recorded) Dec 7 16:58:56.185: INFO: Container jessie-querier ready: true, restart count 0 Dec 7 16:58:56.185: INFO: Container querier ready: true, restart count 0 Dec 7 16:58:56.185: INFO: Container webserver ready: true, restart count 0 Dec 7 16:58:56.542: INFO: Latency metrics for node nodes-us-east4-a-nfxp Dec 7 16:58:56.542: INFO: Logging node info for node nodes-us-east4-a-v6tj Dec 7 16:58:56.580: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east4-a-v6tj 7ccb4554-dd50-4efe-9be3-d3667475ec25 21076 0 2022-12-07 16:49:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east4 failure-domain.beta.kubernetes.io/zone:us-east4-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east4-a-v6tj kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east4-a topology.hostpath.csi/node:nodes-us-east4-a-v6tj topology.kubernetes.io/region:us-east4 topology.kubernetes.io/zone:us-east4-a] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-5906":"nodes-us-east4-a-v6tj","pd.csi.storage.gke.io":"projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/instances/nodes-us-east4-a-v6tj"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.2/32 projectcalico.org/IPv4IPIPTunnelAddr:100.123.60.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2022-12-07 16:49:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2022-12-07 16:49:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2022-12-07 16:49:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:49:49 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:49:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {calico-node Update v1 2022-12-07 16:50:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:58:45 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2022-12-07 16:58:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:gce://gce-gci-upg-lat-1-3-ctl-skew/us-east4-a/nodes-us-east4-a-v6tj,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111196160 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006338560 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-07 16:49:59 +0000 UTC,LastTransitionTime:2022-12-07 16:49:59 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-07 16:58:47 +0000 UTC,LastTransitionTime:2022-12-07 16:49:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-07 16:58:47 +0000 UTC,LastTransitionTime:2022-12-07 16:49:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-07 16:58:47 +0000 UTC,LastTransitionTime:2022-12-07 16:49:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-07 16:58:47 +0000 UTC,LastTransitionTime:2022-12-07 16:49:55 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.2,},NodeAddress{Type:ExternalIP,Address:35.245.137.186,},NodeAddress{Type:Hostname,Address:nodes-us-east4-a-v6tj,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a77ca3c48fb1245cde75a6429c818c0a,SystemUUID:a77ca3c4-8fb1-245c-de75-a6429c818c0a,BootID:65d4f8a4-acd4-4bf8-8839-6a047fad3abd,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.4],SizeBytes:63279305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:51155161,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 registry.k8s.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:7000509,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-5906^67c5b7d2-7650-11ed-b3ce-5e3356f33299 kubernetes.io/csi/pd.csi.storage.gke.io^projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/disks/pvc-80019b4d-1982-4a98-b8b1-d28c5c76124e kubernetes.io/csi/pd.csi.storage.gke.io^projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/disks/pvc-fe3893ec-bc7c-4381-a17a-fc7d51b99e32],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-5906^67c5b7d2-7650-11ed-b3ce-5e3356f33299,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/disks/pvc-fe3893ec-bc7c-4381-a17a-fc7d51b99e32,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/disks/pvc-80019b4d-1982-4a98-b8b1-d28c5c76124e,DevicePath:,},},Config:nil,},} Dec 7 16:58:56.580: INFO: Logging kubelet events for node nodes-us-east4-a-v6tj Dec 7 16:58:56.651: INFO: Logging pods the kubelet thinks is on node nodes-us-east4-a-v6tj Dec 7 16:58:56.695: INFO: kube-proxy-nodes-us-east4-a-v6tj started at 2022-12-07 16:49:37 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:56.695: INFO: Container kube-proxy ready: true, restart count 0 Dec 7 16:58:56.695: INFO: webserver-845c8977d9-d72mw started at 2022-12-07 16:58:43 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:56.695: INFO: Container httpd ready: true, restart count 0 Dec 7 16:58:56.695: INFO: pod-subpath-test-dynamicpv-74qz started at 2022-12-07 16:58:45 +0000 UTC (0+2 container statuses recorded) Dec 7 16:58:56.695: INFO: Container test-container-subpath-dynamicpv-74qz ready: false, restart count 0 Dec 7 16:58:56.695: INFO: Container test-container-volume-dynamicpv-74qz ready: false, restart count 0 Dec 7 16:58:56.695: INFO: calico-node-j442m started at 2022-12-07 16:49:37 +0000 UTC (3+1 container statuses recorded) Dec 7 16:58:56.695: INFO: Init container upgrade-ipam ready: true, restart count 0 Dec 7 16:58:56.695: INFO: Init container install-cni ready: true, restart count 0 Dec 7 16:58:56.695: INFO: Init container mount-bpffs ready: true, restart count 0 Dec 7 16:58:56.695: INFO: Container calico-node ready: true, restart count 0 Dec 7 16:58:56.695: INFO: rs-5tlmg started at 2022-12-07 16:58:02 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:56.695: INFO: Container donothing ready: false, restart count 0 Dec 7 16:58:56.695: INFO: webserver-deployment-845c8977d9-s9sjw started at <nil> (0+0 container statuses recorded) Dec 7 16:58:56.695: INFO: webserver-845c8977d9-ck79b started at <nil> (0+0 container statuses recorded) Dec 7 16:58:56.695: INFO: netserver-2 started at <nil> (0+0 container statuses recorded) Dec 7 16:58:56.695: INFO: startup-2e8d2279-54e7-4fc7-9972-ae34c5441678 started at 2022-12-07 16:56:49 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:56.695: INFO: Container busybox ready: false, restart count 0 Dec 7 16:58:56.695: INFO: csi-gce-pd-node-n8bdx started at 2022-12-07 16:49:37 +0000 UTC (0+2 container statuses recorded) Dec 7 16:58:56.695: INFO: Container csi-driver-registrar ready: true, restart count 0 Dec 7 16:58:56.695: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 16:58:56.695: INFO: webserver-deployment-845c8977d9-vfs6t started at <nil> (0+0 container statuses recorded) Dec 7 16:58:56.695: INFO: test-webserver-a36ffc4e-c902-4377-a67d-79ee0a457752 started at 2022-12-07 16:58:12 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:56.695: INFO: Container test-webserver ready: true, restart count 0 Dec 7 16:58:56.695: INFO: httpd started at <nil> (0+0 container statuses recorded) Dec 7 16:58:56.695: INFO: ss-2 started at 2022-12-07 16:58:14 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:56.695: INFO: Container webserver ready: true, restart count 0 Dec 7 16:58:56.695: INFO: ss2-2 started at 2022-12-07 16:58:18 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:56.695: INFO: Container webserver ready: true, restart count 0 Dec 7 16:58:56.695: INFO: e2e-ktr7b-lwrzc started at 2022-12-07 16:58:44 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:56.695: INFO: Container c ready: false, restart count 0 Dec 7 16:58:56.695: INFO: csi-hostpathplugin-0 started at 2022-12-07 16:58:36 +0000 UTC (0+7 container statuses recorded) Dec 7 16:58:56.695: INFO: Container csi-attacher ready: true, restart count 0 Dec 7 16:58:56.695: INFO: Container csi-provisioner ready: true, restart count 0 Dec 7 16:58:56.695: INFO: Container csi-resizer ready: true, restart count 0 Dec 7 16:58:56.695: INFO: Container csi-snapshotter ready: true, restart count 0 Dec 7 16:58:56.695: INFO: Container hostpath ready: true, restart count 0 Dec 7 16:58:56.695: INFO: Container liveness-probe ready: true, restart count 0 Dec 7 16:58:56.695: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 7 16:58:56.695: INFO: e2e-ktr7b-tctdn started at 2022-12-07 16:58:44 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:56.695: INFO: Container c ready: false, restart count 0 Dec 7 16:58:56.695: INFO: webserver-deployment-845c8977d9-6hwst started at <nil> (0+0 container statuses recorded) Dec 7 16:58:56.695: INFO: pod-terminate-status-0-0 started at <nil> (0+0 container statuses recorded) Dec 7 16:58:56.695: INFO: busybox-22533820-ef53-4013-8f4e-de8a6fe84848 started at 2022-12-07 16:56:56 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:56.695: INFO: Container busybox ready: true, restart count 0 Dec 7 16:58:56.695: INFO: ss-1 started at 2022-12-07 16:58:12 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:56.695: INFO: Container webserver ready: true, restart count 0 Dec 7 16:58:56.695: INFO: webserver-766c9598db-qtmrr started at <nil> (0+0 container statuses recorded) Dec 7 16:58:56.695: INFO: webserver-766c9598db-r2tkk started at <nil> (0+0 container statuses recorded) Dec 7 16:58:57.609: INFO: Latency metrics for node nodes-us-east4-a-v6tj Dec 7 16:58:57.609: INFO: Logging node info for node nodes-us-east4-a-zc10 Dec 7 16:58:57.691: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east4-a-zc10 c6cc41ef-a044-4188-9cdf-9af619e808de 20941 0 2022-12-07 16:49:31 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east4 failure-domain.beta.kubernetes.io/zone:us-east4-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east4-a-zc10 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east4-a topology.hostpath.csi/node:nodes-us-east4-a-zc10 topology.kubernetes.io/region:us-east4 topology.kubernetes.io/zone:us-east4-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/instances/nodes-us-east4-a-zc10"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.4/32 projectcalico.org/IPv4IPIPTunnelAddr:100.113.50.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-12-07 16:49:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:49:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2022-12-07 16:49:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:49:41 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:49:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {calico-node Update v1 2022-12-07 16:49:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:58:44 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2022-12-07 16:58:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:gce://gce-gci-upg-lat-1-3-ctl-skew/us-east4-a/nodes-us-east4-a-zc10,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111196160 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006338560 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-07 16:49:56 +0000 UTC,LastTransitionTime:2022-12-07 16:49:56 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-07 16:58:44 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-07 16:58:44 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-07 16:58:44 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-07 16:58:44 +0000 UTC,LastTransitionTime:2022-12-07 16:49:52 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.4,},NodeAddress{Type:ExternalIP,Address:35.188.253.28,},NodeAddress{Type:Hostname,Address:nodes-us-east4-a-zc10,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f5ea7883cc54b5706859a5f8fc4d24dd,SystemUUID:f5ea7883-cc54-b570-6859-a5f8fc4d24dd,BootID:6c425a3b-23de-41f0-9815-f6a0465861ce,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.4],SizeBytes:63279305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:51155161,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:7000509,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/disks/pvc-b7ab664b-0ec4-4c41-b615-0795a2fb099a],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/disks/pvc-b7ab664b-0ec4-4c41-b615-0795a2fb099a,DevicePath:,},},Config:nil,},} Dec 7 16:58:57.692: INFO: Logging kubelet events for node nodes-us-east4-a-zc10 Dec 7 16:58:57.745: INFO: Logging pods the kubelet thinks is on node nodes-us-east4-a-zc10 Dec 7 16:58:57.793: INFO: pod-0e5b1035-e3d9-4d5a-900b-2a71361b9410 started at 2022-12-07 16:58:42 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:57.793: INFO: Container write-pod ready: true, restart count 0 Dec 7 16:58:57.793: INFO: hostexec-nodes-us-east4-a-zc10-5sqhx started at 2022-12-07 16:58:31 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:57.793: INFO: Container agnhost-container ready: true, restart count 0 Dec 7 16:58:57.793: INFO: ss-2 started at 2022-12-07 16:58:33 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:57.793: INFO: Container webserver ready: true, restart count 0 Dec 7 16:58:57.793: INFO: ss2-1 started at 2022-12-07 16:58:37 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:57.793: INFO: Container webserver ready: true, restart count 0 Dec 7 16:58:57.793: INFO: kube-proxy-nodes-us-east4-a-zc10 started at 2022-12-07 16:49:35 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:57.793: INFO: Container kube-proxy ready: true, restart count 0 Dec 7 16:58:57.793: INFO: calico-node-g8zkr started at 2022-12-07 16:49:35 +0000 UTC (3+1 container statuses recorded) Dec 7 16:58:57.793: INFO: Init container upgrade-ipam ready: true, restart count 0 Dec 7 16:58:57.793: INFO: Init container install-cni ready: true, restart count 0 Dec 7 16:58:57.793: INFO: Init container mount-bpffs ready: true, restart count 0 Dec 7 16:58:57.793: INFO: Container calico-node ready: true, restart count 0 Dec 7 16:58:57.793: INFO: webserver-deployment-845c8977d9-8d2xx started at 2022-12-07 16:58:49 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:57.793: INFO: Container httpd ready: false, restart count 0 Dec 7 16:58:57.793: INFO: webserver-766c9598db-4tjgp started at <nil> (0+0 container statuses recorded) Dec 7 16:58:57.793: INFO: privileged-pod started at 2022-12-07 16:58:33 +0000 UTC (0+2 container statuses recorded) Dec 7 16:58:57.793: INFO: Container not-privileged-container ready: true, restart count 0 Dec 7 16:58:57.793: INFO: Container privileged-container ready: true, restart count 0 Dec 7 16:58:57.793: INFO: webserver-845c8977d9-8l8rq started at 2022-12-07 16:58:43 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:57.793: INFO: Container httpd ready: true, restart count 0 Dec 7 16:58:57.793: INFO: pod-da006aed-2bac-40b1-8b7b-f8ebda881763 started at <nil> (0+0 container statuses recorded) Dec 7 16:58:57.793: INFO: csi-gce-pd-node-vtqz7 started at 2022-12-07 16:49:35 +0000 UTC (0+2 container statuses recorded) Dec 7 16:58:57.793: INFO: Container csi-driver-registrar ready: true, restart count 0 Dec 7 16:58:57.793: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 16:58:57.793: INFO: coredns-677fff9cfb-4b88c started at 2022-12-07 16:50:04 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:57.793: INFO: Container coredns ready: true, restart count 0 Dec 7 16:58:57.793: INFO: pod-service-account-76596466-d139-41e5-bc4f-4130fcf419e6 started at 2022-12-07 16:58:38 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:57.793: INFO: Container test ready: true, restart count 0 Dec 7 16:58:57.793: INFO: netserver-3 started at 2022-12-07 16:58:49 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:57.793: INFO: Container webserver ready: false, restart count 0 Dec 7 16:58:57.793: INFO: webserver-845c8977d9-8bq77 started at 2022-12-07 16:58:19 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:57.793: INFO: Container httpd ready: true, restart count 0 Dec 7 16:58:57.793: INFO: webserver-845c8977d9-4bzmt started at 2022-12-07 16:58:46 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:57.793: INFO: Container httpd ready: true, restart count 0 Dec 7 16:58:57.793: INFO: webserver-deployment-845c8977d9-jkstp started at 2022-12-07 16:58:49 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:57.793: INFO: Container httpd ready: true, restart count 0 Dec 7 16:58:58.519: INFO: Latency metrics for node nodes-us-east4-a-zc10 �[1mSTEP:�[0m Collecting events from namespace "webhook-8654-markers". �[38;5;243m12/07/22 16:58:58.519�[0m �[1mSTEP:�[0m Found 0 events. �[38;5;243m12/07/22 16:58:58.549�[0m Dec 7 16:58:58.580: INFO: POD NODE PHASE GRACE CONDITIONS Dec 7 16:58:58.580: INFO: Dec 7 16:58:58.618: INFO: Logging node info for node control-plane-us-east4-a-vd91 Dec 7 16:58:58.651: INFO: Node Info: &Node{ObjectMeta:{control-plane-us-east4-a-vd91 74d54d8e-e0bc-4c7d-bf3c-5b66ce025930 6098 0 2022-12-07 16:47:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-standard-2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east4 failure-domain.beta.kubernetes.io/zone:us-east4-a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:control-plane-us-east4-a-vd91 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node-role.kubernetes.io/node: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:e2-standard-2 topology.gke.io/zone:us-east4-a topology.kubernetes.io/region:us-east4 topology.kubernetes.io/zone:us-east4-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/instances/control-plane-us-east4-a-vd91"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.5/32 projectcalico.org/IPv4IPIPTunnelAddr:100.101.18.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-12-07 16:47:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2022-12-07 16:48:18 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {calico-node Update v1 2022-12-07 16:48:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}}}}} status} {cloud-controller-manager Update v1 2022-12-07 16:48:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2022-12-07 16:48:34 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:48:39 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:48:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-12-07 16:54:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:gce://gce-gci-upg-lat-1-3-ctl-skew/us-east4-a/control-plane-us-east4-a-vd91,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8332767232 0} {<nil>} 8137468Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8227909632 0} {<nil>} 8035068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-07 16:48:39 +0000 UTC,LastTransitionTime:2022-12-07 16:48:39 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-07 16:54:04 +0000 UTC,LastTransitionTime:2022-12-07 16:47:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-07 16:54:04 +0000 UTC,LastTransitionTime:2022-12-07 16:47:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-07 16:54:04 +0000 UTC,LastTransitionTime:2022-12-07 16:47:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-07 16:54:04 +0000 UTC,LastTransitionTime:2022-12-07 16:48:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.5,},NodeAddress{Type:ExternalIP,Address:35.245.23.229,},NodeAddress{Type:Hostname,Address:control-plane-us-east4-a-vd91,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e32750d839dd77bbe79d8a1be267141a,SystemUUID:e32750d8-39dd-77bb-e79d-8a1be267141a,BootID:572b6367-72b8-4ea4-b559-5c84c54662ce,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gcr.io/k8s-staging-etcdadm/etcd-manager@sha256:f3a63853502cb3956fa708fea524be3b333036ebc1cd1dadd81abd9f1fe61043 gcr.io/k8s-staging-etcdadm/etcd-manager:v3.0.20220831-21-g12041b4c],SizeBytes:231516108,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.25.4],SizeBytes:129085904,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.25.4],SizeBytes:118436153,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.4],SizeBytes:63279305,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.25.4],SizeBytes:51921208,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-alpha.2],SizeBytes:42203406,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-alpha.2],SizeBytes:41463710,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:2b6acd7f677f76ffe12ecf3ea7df92eb9b1bdb07336d1ac2a54c7631fb753f7e docker.io/calico/kube-controllers:v3.24.5],SizeBytes:31137169,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2 registry.k8s.io/sig-storage/csi-provisioner:v2.1.0],SizeBytes:21205045,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:50c3cfd458fc8e0bf3c8c521eac39172009382fc66dc5044a330d137c6ed0b09 registry.k8s.io/sig-storage/csi-attacher:v3.1.0],SizeBytes:20103959,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a registry.k8s.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:9af9bf28430b00a0cedeb2ec29acadce45e6afcecd8bdf31c793c624cfa75fa7 registry.k8s.io/sig-storage/csi-snapshotter:v3.0.3],SizeBytes:19500777,},ContainerImage{Names:[docker.io/k8scloudprovidergcp/cloud-controller-manager@sha256:881fd1095937638040723973ade90e6700f1c831a78fb585a3227c4d021b0df9 docker.io/k8scloudprovidergcp/cloud-controller-manager:latest],SizeBytes:18702875,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-alpha.2],SizeBytes:4954573,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 7 16:58:58.651: INFO: Logging kubelet events for node control-plane-us-east4-a-vd91 Dec 7 16:58:58.684: INFO: Logging pods the kubelet thinks is on node control-plane-us-east4-a-vd91 Dec 7 16:58:58.737: INFO: etcd-manager-events-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:58.737: INFO: Container etcd-manager ready: true, restart count 0 Dec 7 16:58:58.737: INFO: kube-controller-manager-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:58.737: INFO: Container kube-controller-manager ready: true, restart count 2 Dec 7 16:58:58.737: INFO: calico-node-zgvgx started at 2022-12-07 16:48:06 +0000 UTC (3+1 container statuses recorded) Dec 7 16:58:58.737: INFO: Init container upgrade-ipam ready: true, restart count 0 Dec 7 16:58:58.737: INFO: Init container install-cni ready: true, restart count 0 Dec 7 16:58:58.737: INFO: Init container mount-bpffs ready: true, restart count 0 Dec 7 16:58:58.737: INFO: Container calico-node ready: true, restart count 0 Dec 7 16:58:58.737: INFO: dns-controller-8946976bb-6t8hj started at 2022-12-07 16:48:19 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:58.737: INFO: Container dns-controller ready: true, restart count 0 Dec 7 16:58:58.737: INFO: calico-kube-controllers-7bc879d8d6-t4vrx started at 2022-12-07 16:48:39 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:58.737: INFO: Container calico-kube-controllers ready: true, restart count 0 Dec 7 16:58:58.737: INFO: kops-controller-mnn6f started at 2022-12-07 16:48:18 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:58.737: INFO: Container kops-controller ready: true, restart count 0 Dec 7 16:58:58.737: INFO: cloud-controller-manager-xd6xh started at 2022-12-07 16:48:18 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:58.737: INFO: Container cloud-controller-manager ready: true, restart count 0 Dec 7 16:58:58.737: INFO: kube-scheduler-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:58.737: INFO: Container kube-scheduler ready: true, restart count 0 Dec 7 16:58:58.737: INFO: etcd-manager-main-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:58.737: INFO: Container etcd-manager ready: true, restart count 0 Dec 7 16:58:58.737: INFO: kube-apiserver-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+2 container statuses recorded) Dec 7 16:58:58.737: INFO: Container healthcheck ready: true, restart count 0 Dec 7 16:58:58.737: INFO: Container kube-apiserver ready: true, restart count 1 Dec 7 16:58:58.737: INFO: kube-proxy-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:58.737: INFO: Container kube-proxy ready: true, restart count 0 Dec 7 16:58:58.737: INFO: csi-gce-pd-node-z9fsn started at 2022-12-07 16:48:06 +0000 UTC (0+2 container statuses recorded) Dec 7 16:58:58.737: INFO: Container csi-driver-registrar ready: true, restart count 0 Dec 7 16:58:58.737: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 16:58:58.737: INFO: csi-gce-pd-controller-689c9f4444-b5qql started at 2022-12-07 16:48:18 +0000 UTC (0+5 container statuses recorded) Dec 7 16:58:58.737: INFO: Container csi-attacher ready: true, restart count 0 Dec 7 16:58:58.737: INFO: Container csi-provisioner ready: true, restart count 0 Dec 7 16:58:58.737: INFO: Container csi-resizer ready: true, restart count 0 Dec 7 16:58:58.737: INFO: Container csi-snapshotter ready: true, restart count 0 Dec 7 16:58:58.737: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 16:58:59.030: INFO: Latency metrics for node control-plane-us-east4-a-vd91 Dec 7 16:58:59.030: INFO: Logging node info for node nodes-us-east4-a-5680 Dec 7 16:58:59.066: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east4-a-5680 b9473b45-598f-43c3-aafc-dc872ade1274 20372 0 2022-12-07 16:49:31 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east4 failure-domain.beta.kubernetes.io/zone:us-east4-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east4-a-5680 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east4-a topology.hostpath.csi/node:nodes-us-east4-a-5680 topology.kubernetes.io/region:us-east4 topology.kubernetes.io/zone:us-east4-a] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-5522":"nodes-us-east4-a-5680","csi-hostpath-ephemeral-7154":"nodes-us-east4-a-5680","csi-hostpath-provisioning-3810":"nodes-us-east4-a-5680","csi-hostpath-volume-5950":"nodes-us-east4-a-5680","csi-hostpath-volume-expand-4661":"nodes-us-east4-a-5680","pd.csi.storage.gke.io":"projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/instances/nodes-us-east4-a-5680"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.3/32 projectcalico.org/IPv4IPIPTunnelAddr:100.119.115.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2022-12-07 16:49:31 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2022-12-07 16:49:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2022-12-07 16:49:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:49:41 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:49:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {calico-node Update v1 2022-12-07 16:49:59 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2022-12-07 16:58:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2022-12-07 16:58:33 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:gce://gce-gci-upg-lat-1-3-ctl-skew/us-east4-a/nodes-us-east4-a-5680,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-07 16:49:58 +0000 UTC,LastTransitionTime:2022-12-07 16:49:58 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-07 16:58:32 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-07 16:58:32 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-07 16:58:32 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-07 16:58:32 +0000 UTC,LastTransitionTime:2022-12-07 16:49:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.3,},NodeAddress{Type:ExternalIP,Address:34.86.83.231,},NodeAddress{Type:Hostname,Address:nodes-us-east4-a-5680,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:5676434e0327952eef9a8130969e32db,SystemUUID:5676434e-0327-952e-ef9a-8130969e32db,BootID:f4cd280b-a7ea-43c2-b78f-d43fab064010,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.4],SizeBytes:63279305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:51155161,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 registry.k8s.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-7154^1f441367-7650-11ed-b312-326c8fdc4a6c kubernetes.io/csi/csi-hostpath-volume-5950^5abc4d85-7650-11ed-91be-fa8e7f689512 kubernetes.io/csi/pd.csi.storage.gke.io^projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/disks/pvc-a5cc56b8-d8e5-4487-b9b8-e2af120cc039],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/disks/pvc-a5cc56b8-d8e5-4487-b9b8-e2af120cc039,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-7154^1f441367-7650-11ed-b312-326c8fdc4a6c,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-volume-5950^5abc4d85-7650-11ed-91be-fa8e7f689512,DevicePath:,},},Config:nil,},} Dec 7 16:58:59.067: INFO: Logging kubelet events for node nodes-us-east4-a-5680 Dec 7 16:58:59.104: INFO: Logging pods the kubelet thinks is on node nodes-us-east4-a-5680 Dec 7 16:58:59.177: INFO: webserver-845c8977d9-whvm6 started at 2022-12-07 16:58:19 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:59.177: INFO: Container httpd ready: true, restart count 0 Dec 7 16:58:59.177: INFO: csi-hostpathplugin-0 started at 2022-12-07 16:57:21 +0000 UTC (0+7 container statuses recorded) Dec 7 16:58:59.177: INFO: Container csi-attacher ready: true, restart count 0 Dec 7 16:58:59.177: INFO: Container csi-provisioner ready: true, restart count 0 Dec 7 16:58:59.177: INFO: Container csi-resizer ready: true, restart count 0 Dec 7 16:58:59.177: INFO: Container csi-snapshotter ready: true, restart count 0 Dec 7 16:58:59.177: INFO: Container hostpath ready: true, restart count 0 Dec 7 16:58:59.177: INFO: Container liveness-probe ready: true, restart count 0 Dec 7 16:58:59.177: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 7 16:58:59.177: INFO: calico-node-wvpd9 started at 2022-12-07 16:49:34 +0000 UTC (3+1 container statuses recorded) Dec 7 16:58:59.177: INFO: Init container upgrade-ipam ready: true, restart count 0 Dec 7 16:58:59.177: INFO: Init container install-cni ready: true, restart count 0 Dec 7 16:58:59.177: INFO: Init container mount-bpffs ready: true, restart count 0 Dec 7 16:58:59.177: INFO: Container calico-node ready: true, restart count 0 Dec 7 16:58:59.177: INFO: ss2-0 started at 2022-12-07 16:58:45 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:59.177: INFO: Container webserver ready: true, restart count 0 Dec 7 16:58:59.177: INFO: webserver-deployment-845c8977d9-nsv4p started at 2022-12-07 16:58:49 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:59.177: INFO: Container httpd ready: true, restart count 0 Dec 7 16:58:59.177: INFO: webserver-deployment-845c8977d9-fqn7n started at 2022-12-07 16:58:49 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:59.177: INFO: Container httpd ready: true, restart count 0 Dec 7 16:58:59.177: INFO: ss-0 started at 2022-12-07 16:57:29 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:59.177: INFO: Container webserver ready: true, restart count 0 Dec 7 16:58:59.177: INFO: kube-proxy-nodes-us-east4-a-5680 started at 2022-12-07 16:49:34 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:59.177: INFO: Container kube-proxy ready: true, restart count 0 Dec 7 16:58:59.177: INFO: netserver-0 started at 2022-12-07 16:58:49 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:59.177: INFO: Container webserver ready: false, restart count 0 Dec 7 16:58:59.177: INFO: csi-hostpathplugin-0 started at 2022-12-07 16:58:17 +0000 UTC (0+7 container statuses recorded) Dec 7 16:58:59.177: INFO: Container csi-attacher ready: true, restart count 0 Dec 7 16:58:59.177: INFO: Container csi-provisioner ready: true, restart count 0 Dec 7 16:58:59.177: INFO: Container csi-resizer ready: true, restart count 0 Dec 7 16:58:59.177: INFO: Container csi-snapshotter ready: true, restart count 0 Dec 7 16:58:59.177: INFO: Container hostpath ready: true, restart count 0 Dec 7 16:58:59.177: INFO: Container liveness-probe ready: true, restart count 0 Dec 7 16:58:59.177: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 7 16:58:59.177: INFO: inline-volume-tester-r7zzm started at 2022-12-07 16:56:41 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:59.177: INFO: Container csi-volume-tester ready: true, restart count 0 Dec 7 16:58:59.177: INFO: webserver-766c9598db-mfn5b started at <nil> (0+0 container statuses recorded) Dec 7 16:58:59.177: INFO: csi-hostpathplugin-0 started at 2022-12-07 16:58:15 +0000 UTC (0+7 container statuses recorded) Dec 7 16:58:59.177: INFO: Container csi-attacher ready: true, restart count 0 Dec 7 16:58:59.177: INFO: Container csi-provisioner ready: true, restart count 0 Dec 7 16:58:59.177: INFO: Container csi-resizer ready: true, restart count 0 Dec 7 16:58:59.177: INFO: Container csi-snapshotter ready: true, restart count 0 Dec 7 16:58:59.177: INFO: Container hostpath ready: true, restart count 0 Dec 7 16:58:59.177: INFO: Container liveness-probe ready: true, restart count 0 Dec 7 16:58:59.177: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 7 16:58:59.177: INFO: hostpath-client started at 2022-12-07 16:58:42 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:59.177: INFO: Container hostpath-client ready: true, restart count 0 Dec 7 16:58:59.177: INFO: csi-hostpathplugin-0 started at 2022-12-07 16:57:14 +0000 UTC (0+7 container statuses recorded) Dec 7 16:58:59.177: INFO: Container csi-attacher ready: true, restart count 0 Dec 7 16:58:59.177: INFO: Container csi-provisioner ready: true, restart count 0 Dec 7 16:58:59.177: INFO: Container csi-resizer ready: true, restart count 0 Dec 7 16:58:59.177: INFO: Container csi-snapshotter ready: true, restart count 0 Dec 7 16:58:59.177: INFO: Container hostpath ready: true, restart count 0 Dec 7 16:58:59.177: INFO: Container liveness-probe ready: true, restart count 0 Dec 7 16:58:59.177: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 7 16:58:59.177: INFO: csi-gce-pd-node-9n22s started at 2022-12-07 16:49:34 +0000 UTC (0+2 container statuses recorded) Dec 7 16:58:59.177: INFO: Container csi-driver-registrar ready: true, restart count 0 Dec 7 16:58:59.177: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 16:58:59.177: INFO: e2e-ktr7b-6cgtf started at <nil> (0+0 container statuses recorded) Dec 7 16:58:59.177: INFO: csi-hostpathplugin-0 started at 2022-12-07 16:56:35 +0000 UTC (0+7 container statuses recorded) Dec 7 16:58:59.177: INFO: Container csi-attacher ready: true, restart count 0 Dec 7 16:58:59.177: INFO: Container csi-provisioner ready: true, restart count 0 Dec 7 16:58:59.177: INFO: Container csi-resizer ready: true, restart count 0 Dec 7 16:58:59.177: INFO: Container csi-snapshotter ready: true, restart count 0 Dec 7 16:58:59.177: INFO: Container hostpath ready: true, restart count 0 Dec 7 16:58:59.177: INFO: Container liveness-probe ready: true, restart count 0 Dec 7 16:58:59.177: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 7 16:58:59.177: INFO: webserver-845c8977d9-qkbrw started at 2022-12-07 16:58:43 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:59.177: INFO: Container httpd ready: true, restart count 0 Dec 7 16:58:59.177: INFO: agnhost-primary-zssrh started at 2022-12-07 16:58:44 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:59.178: INFO: Container agnhost-primary ready: true, restart count 0 Dec 7 16:58:59.178: INFO: webserver-deployment-845c8977d9-lm79c started at 2022-12-07 16:58:49 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:59.178: INFO: Container httpd ready: false, restart count 0 Dec 7 16:58:59.654: INFO: Latency metrics for node nodes-us-east4-a-5680 Dec 7 16:58:59.654: INFO: Logging node info for node nodes-us-east4-a-nfxp Dec 7 16:58:59.693: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east4-a-nfxp 958029bf-d66a-424c-a80d-b1d485df133b 20224 0 2022-12-07 16:49:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east4 failure-domain.beta.kubernetes.io/zone:us-east4-a io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east4-a-nfxp kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east4-a topology.hostpath.csi/node:nodes-us-east4-a-nfxp topology.kubernetes.io/region:us-east4 topology.kubernetes.io/zone:us-east4-a] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-3139":"csi-mock-csi-mock-volumes-3139","pd.csi.storage.gke.io":"projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/instances/nodes-us-east4-a-nfxp"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.6/32 projectcalico.org/IPv4IPIPTunnelAddr:100.113.109.192 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2022-12-07 16:49:28 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2022-12-07 16:49:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2022-12-07 16:49:29 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:49:41 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:49:48 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {calico-node Update v1 2022-12-07 16:49:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:58:10 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2022-12-07 16:58:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:gce://gce-gci-upg-lat-1-3-ctl-skew/us-east4-a/nodes-us-east4-a-nfxp,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-07 16:49:53 +0000 UTC,LastTransitionTime:2022-12-07 16:49:53 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-07 16:58:29 +0000 UTC,LastTransitionTime:2022-12-07 16:49:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-07 16:58:29 +0000 UTC,LastTransitionTime:2022-12-07 16:49:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-07 16:58:29 +0000 UTC,LastTransitionTime:2022-12-07 16:49:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-07 16:58:29 +0000 UTC,LastTransitionTime:2022-12-07 16:49:48 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.6,},NodeAddress{Type:ExternalIP,Address:34.145.242.1,},NodeAddress{Type:Hostname,Address:nodes-us-east4-a-nfxp,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:796e3b73d867da488abd70a5df2fe10f,SystemUUID:796e3b73-d867-da48-8abd-70a5df2fe10f,BootID:2b784aad-5897-4bb4-bb49-6bae545d9488,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:b83c1d70989e1fe87583607bf5aee1ee34e52773d4755b95f5cf5a451962f3a4 registry.k8s.io/etcd:3.5.5-0],SizeBytes:102417044,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.4],SizeBytes:63279305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:51155161,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:f9c93b92b6ff750b41a93c4e4fe0bfe384597aeb841e2539d5444815c55b2d8f registry.k8s.io/e2e-test-images/sample-apiserver:1.17.5],SizeBytes:24316368,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:aa60f453d64dfb3c3fd9e7306f988c36c6352c4f2d956aa90467f2808091effa registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.5],SizeBytes:15209420,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:7000509,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/disks/pvc-584849ee-9bda-401f-b082-2917e251db99 kubernetes.io/csi/pd.csi.storage.gke.io^projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/disks/pvc-67bad871-3241-42d3-94d1-f625a20ee94b],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/disks/pvc-584849ee-9bda-401f-b082-2917e251db99,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/disks/pvc-67bad871-3241-42d3-94d1-f625a20ee94b,DevicePath:,},},Config:nil,},} Dec 7 16:58:59.694: INFO: Logging kubelet events for node nodes-us-east4-a-nfxp Dec 7 16:58:59.751: INFO: Logging pods the kubelet thinks is on node nodes-us-east4-a-nfxp Dec 7 16:58:59.805: INFO: kube-proxy-nodes-us-east4-a-nfxp started at 2022-12-07 16:49:29 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:59.805: INFO: Container kube-proxy ready: true, restart count 0 Dec 7 16:58:59.805: INFO: csi-mockplugin-0 started at 2022-12-07 16:58:26 +0000 UTC (0+4 container statuses recorded) Dec 7 16:58:59.805: INFO: Container busybox ready: true, restart count 0 Dec 7 16:58:59.805: INFO: Container csi-provisioner ready: true, restart count 0 Dec 7 16:58:59.805: INFO: Container driver-registrar ready: true, restart count 0 Dec 7 16:58:59.805: INFO: Container mock ready: true, restart count 0 Dec 7 16:58:59.805: INFO: csi-gce-pd-node-vcz5x started at 2022-12-07 16:49:29 +0000 UTC (0+2 container statuses recorded) Dec 7 16:58:59.805: INFO: Container csi-driver-registrar ready: true, restart count 0 Dec 7 16:58:59.805: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 16:58:59.805: INFO: webserver-deployment-845c8977d9-5swbh started at 2022-12-07 16:58:49 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:59.805: INFO: Container httpd ready: true, restart count 0 Dec 7 16:58:59.805: INFO: calico-node-f2cxs started at 2022-12-07 16:49:29 +0000 UTC (3+1 container statuses recorded) Dec 7 16:58:59.805: INFO: Init container upgrade-ipam ready: true, restart count 0 Dec 7 16:58:59.805: INFO: Init container install-cni ready: true, restart count 0 Dec 7 16:58:59.805: INFO: Init container mount-bpffs ready: true, restart count 0 Dec 7 16:58:59.805: INFO: Container calico-node ready: true, restart count 0 Dec 7 16:58:59.805: INFO: dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4 started at 2022-12-07 16:53:00 +0000 UTC (0+3 container statuses recorded) Dec 7 16:58:59.805: INFO: Container jessie-querier ready: true, restart count 0 Dec 7 16:58:59.805: INFO: Container querier ready: true, restart count 0 Dec 7 16:58:59.805: INFO: Container webserver ready: true, restart count 0 Dec 7 16:58:59.805: INFO: webserver-deployment-845c8977d9-q7nhv started at 2022-12-07 16:58:49 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:59.805: INFO: Container httpd ready: true, restart count 0 Dec 7 16:58:59.805: INFO: webserver-845c8977d9-kb5xx started at 2022-12-07 16:58:55 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:59.805: INFO: Container httpd ready: true, restart count 0 Dec 7 16:58:59.805: INFO: coredns-677fff9cfb-rv6b9 started at 2022-12-07 16:49:48 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:59.805: INFO: Container coredns ready: true, restart count 0 Dec 7 16:58:59.805: INFO: ss-1 started at 2022-12-07 16:57:57 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:59.805: INFO: Container webserver ready: true, restart count 0 Dec 7 16:58:59.805: INFO: webserver-845c8977d9-7vlb6 started at 2022-12-07 16:58:43 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:59.805: INFO: Container httpd ready: true, restart count 0 Dec 7 16:58:59.805: INFO: netserver-1 started at 2022-12-07 16:58:49 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:59.805: INFO: Container webserver ready: false, restart count 0 Dec 7 16:58:59.805: INFO: pvc-volume-tester-ws2nz started at 2022-12-07 16:58:33 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:59.805: INFO: Container volume-tester ready: true, restart count 0 Dec 7 16:58:59.805: INFO: webserver-766c9598db-9x6mf started at 2022-12-07 16:58:56 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:59.805: INFO: Container httpd ready: true, restart count 0 Dec 7 16:58:59.805: INFO: coredns-autoscaler-db7b97744-2cf6q started at 2022-12-07 16:49:48 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:59.805: INFO: Container autoscaler ready: true, restart count 0 Dec 7 16:58:59.805: INFO: sample-apiserver-deployment-b5b45d9d4-2fzcf started at 2022-12-07 16:57:55 +0000 UTC (0+2 container statuses recorded) Dec 7 16:58:59.805: INFO: Container etcd ready: true, restart count 0 Dec 7 16:58:59.805: INFO: Container sample-apiserver ready: true, restart count 0 Dec 7 16:58:59.805: INFO: ss-0 started at 2022-12-07 16:57:55 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:59.805: INFO: Container webserver ready: true, restart count 0 Dec 7 16:58:59.805: INFO: sample-webhook-deployment-5d85dd8cdb-nndk7 started at 2022-12-07 16:57:52 +0000 UTC (0+1 container statuses recorded) Dec 7 16:58:59.805: INFO: Container sample-webhook ready: true, restart count 0 Dec 7 16:59:00.050: INFO: Latency metrics for node nodes-us-east4-a-nfxp Dec 7 16:59:00.050: INFO: Logging node info for node nodes-us-east4-a-v6tj Dec 7 16:59:00.086: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east4-a-v6tj 7ccb4554-dd50-4efe-9be3-d3667475ec25 21076 0 2022-12-07 16:49:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east4 failure-domain.beta.kubernetes.io/zone:us-east4-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east4-a-v6tj kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east4-a topology.hostpath.csi/node:nodes-us-east4-a-v6tj topology.kubernetes.io/region:us-east4 topology.kubernetes.io/zone:us-east4-a] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-5906":"nodes-us-east4-a-v6tj","pd.csi.storage.gke.io":"projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/instances/nodes-us-east4-a-v6tj"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.2/32 projectcalico.org/IPv4IPIPTunnelAddr:100.123.60.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2022-12-07 16:49:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2022-12-07 16:49:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2022-12-07 16:49:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:49:49 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:49:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {calico-node Update v1 2022-12-07 16:50:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:58:45 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2022-12-07 16:58:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:gce://gce-gci-upg-lat-1-3-ctl-skew/us-east4-a/nodes-us-east4-a-v6tj,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111196160 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006338560 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-07 16:49:59 +0000 UTC,LastTransitionTime:2022-12-07 16:49:59 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-07 16:58:47 +0000 UTC,LastTransitionTime:2022-12-07 16:49:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-07 16:58:47 +0000 UTC,LastTransitionTime:2022-12-07 16:49:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-07 16:58:47 +0000 UTC,LastTransitionTime:2022-12-07 16:49:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-07 16:58:47 +0000 UTC,LastTransitionTime:2022-12-07 16:49:55 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.2,},NodeAddress{Type:ExternalIP,Address:35.245.137.186,},NodeAddress{Type:Hostname,Address:nodes-us-east4-a-v6tj,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a77ca3c48fb1245cde75a6429c818c0a,SystemUUID:a77ca3c4-8fb1-245c-de75-a6429c818c0a,BootID:65d4f8a4-acd4-4bf8-8839-6a047fad3abd,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.4],SizeBytes:63279305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:51155161,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 registry.k8s.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:7000509,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-5906^67c5b7d2-7650-11ed-b3ce-5e3356f33299 kubernetes.io/csi/pd.csi.storage.gke.io^projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/disks/pvc-80019b4d-1982-4a98-b8b1-d28c5c76124e kubernetes.io/csi/pd.csi.storage.gke.io^projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/disks/pvc-fe3893ec-bc7c-4381-a17a-fc7d51b99e32],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-5906^67c5b7d2-7650-11ed-b3ce-5e3356f33299,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/disks/pvc-fe3893ec-bc7c-4381-a17a-fc7d51b99e32,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/disks/pvc-80019b4d-1982-4a98-b8b1-d28c5c76124e,DevicePath:,},},Config:nil,},} Dec 7 16:59:00.086: INFO: Logging kubelet events for node nodes-us-east4-a-v6tj Dec 7 16:59:00.122: INFO: Logging pods the kubelet thinks is on node nodes-us-east4-a-v6tj Dec 7 16:59:00.177: INFO: calico-node-j442m started at 2022-12-07 16:49:37 +0000 UTC (3+1 container statuses recorded) Dec 7 16:59:00.177: INFO: Init container upgrade-ipam ready: true, restart count 0 Dec 7 16:59:00.177: INFO: Init container install-cni ready: true, restart count 0 Dec 7 16:59:00.177: INFO: Init container mount-bpffs ready: true, restart count 0 Dec 7 16:59:00.177: INFO: Container calico-node ready: true, restart count 0 Dec 7 16:59:00.177: INFO: rs-5tlmg started at 2022-12-07 16:58:02 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:00.177: INFO: Container donothing ready: false, restart count 0 Dec 7 16:59:00.177: INFO: webserver-deployment-845c8977d9-s9sjw started at <nil> (0+0 container statuses recorded) Dec 7 16:59:00.177: INFO: webserver-845c8977d9-ck79b started at 2022-12-07 16:58:56 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:00.177: INFO: Container httpd ready: false, restart count 0 Dec 7 16:59:00.177: INFO: netserver-2 started at <nil> (0+0 container statuses recorded) Dec 7 16:59:00.177: INFO: pod-terminate-status-0-1 started at <nil> (0+0 container statuses recorded) Dec 7 16:59:00.177: INFO: startup-2e8d2279-54e7-4fc7-9972-ae34c5441678 started at 2022-12-07 16:56:49 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:00.177: INFO: Container busybox ready: false, restart count 0 Dec 7 16:59:00.177: INFO: csi-gce-pd-node-n8bdx started at 2022-12-07 16:49:37 +0000 UTC (0+2 container statuses recorded) Dec 7 16:59:00.177: INFO: Container csi-driver-registrar ready: true, restart count 0 Dec 7 16:59:00.177: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 16:59:00.177: INFO: webserver-deployment-845c8977d9-vfs6t started at 2022-12-07 16:58:49 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:00.177: INFO: Container httpd ready: true, restart count 0 Dec 7 16:59:00.177: INFO: test-webserver-a36ffc4e-c902-4377-a67d-79ee0a457752 started at 2022-12-07 16:58:12 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:00.177: INFO: Container test-webserver ready: true, restart count 0 Dec 7 16:59:00.177: INFO: httpd started at 2022-12-07 16:58:53 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:00.177: INFO: Container httpd ready: false, restart count 0 Dec 7 16:59:00.177: INFO: ss-2 started at 2022-12-07 16:58:14 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:00.177: INFO: Container webserver ready: true, restart count 0 Dec 7 16:59:00.177: INFO: ss2-2 started at 2022-12-07 16:58:18 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:00.177: INFO: Container webserver ready: true, restart count 0 Dec 7 16:59:00.177: INFO: e2e-ktr7b-lwrzc started at 2022-12-07 16:58:44 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:00.177: INFO: Container c ready: false, restart count 0 Dec 7 16:59:00.177: INFO: csi-hostpathplugin-0 started at 2022-12-07 16:58:36 +0000 UTC (0+7 container statuses recorded) Dec 7 16:59:00.177: INFO: Container csi-attacher ready: true, restart count 0 Dec 7 16:59:00.177: INFO: Container csi-provisioner ready: true, restart count 0 Dec 7 16:59:00.177: INFO: Container csi-resizer ready: true, restart count 0 Dec 7 16:59:00.177: INFO: Container csi-snapshotter ready: true, restart count 0 Dec 7 16:59:00.177: INFO: Container hostpath ready: true, restart count 0 Dec 7 16:59:00.177: INFO: Container liveness-probe ready: true, restart count 0 Dec 7 16:59:00.177: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 7 16:59:00.177: INFO: e2e-ktr7b-tctdn started at 2022-12-07 16:58:44 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:00.177: INFO: Container c ready: false, restart count 0 Dec 7 16:59:00.177: INFO: webserver-deployment-845c8977d9-6hwst started at <nil> (0+0 container statuses recorded) Dec 7 16:59:00.177: INFO: busybox-22533820-ef53-4013-8f4e-de8a6fe84848 started at 2022-12-07 16:56:56 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:00.177: INFO: Container busybox ready: true, restart count 0 Dec 7 16:59:00.177: INFO: ss-1 started at 2022-12-07 16:58:12 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:00.177: INFO: Container webserver ready: true, restart count 0 Dec 7 16:59:00.177: INFO: webserver-766c9598db-qtmrr started at <nil> (0+0 container statuses recorded) Dec 7 16:59:00.177: INFO: webserver-766c9598db-r2tkk started at 2022-12-07 16:58:56 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:00.177: INFO: Container httpd ready: false, restart count 0 Dec 7 16:59:00.177: INFO: pod-terminate-status-2-1 started at <nil> (0+0 container statuses recorded) Dec 7 16:59:00.177: INFO: pod-terminate-status-1-1 started at <nil> (0+0 container statuses recorded) Dec 7 16:59:00.177: INFO: kube-proxy-nodes-us-east4-a-v6tj started at 2022-12-07 16:49:37 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:00.177: INFO: Container kube-proxy ready: true, restart count 0 Dec 7 16:59:00.177: INFO: webserver-845c8977d9-d72mw started at 2022-12-07 16:58:43 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:00.177: INFO: Container httpd ready: true, restart count 0 Dec 7 16:59:00.177: INFO: pod-subpath-test-dynamicpv-74qz started at 2022-12-07 16:58:45 +0000 UTC (0+2 container statuses recorded) Dec 7 16:59:00.177: INFO: Container test-container-subpath-dynamicpv-74qz ready: false, restart count 0 Dec 7 16:59:00.177: INFO: Container test-container-volume-dynamicpv-74qz ready: false, restart count 0 Dec 7 16:59:00.479: INFO: Latency metrics for node nodes-us-east4-a-v6tj Dec 7 16:59:00.479: INFO: Logging node info for node nodes-us-east4-a-zc10 Dec 7 16:59:00.518: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east4-a-zc10 c6cc41ef-a044-4188-9cdf-9af619e808de 20941 0 2022-12-07 16:49:31 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east4 failure-domain.beta.kubernetes.io/zone:us-east4-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east4-a-zc10 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east4-a topology.hostpath.csi/node:nodes-us-east4-a-zc10 topology.kubernetes.io/region:us-east4 topology.kubernetes.io/zone:us-east4-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/instances/nodes-us-east4-a-zc10"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.4/32 projectcalico.org/IPv4IPIPTunnelAddr:100.113.50.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-12-07 16:49:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:49:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2022-12-07 16:49:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:49:41 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:49:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {calico-node Update v1 2022-12-07 16:49:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:58:44 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2022-12-07 16:58:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:gce://gce-gci-upg-lat-1-3-ctl-skew/us-east4-a/nodes-us-east4-a-zc10,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111196160 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006338560 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-07 16:49:56 +0000 UTC,LastTransitionTime:2022-12-07 16:49:56 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-07 16:58:44 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-07 16:58:44 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-07 16:58:44 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-07 16:58:44 +0000 UTC,LastTransitionTime:2022-12-07 16:49:52 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.4,},NodeAddress{Type:ExternalIP,Address:35.188.253.28,},NodeAddress{Type:Hostname,Address:nodes-us-east4-a-zc10,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f5ea7883cc54b5706859a5f8fc4d24dd,SystemUUID:f5ea7883-cc54-b570-6859-a5f8fc4d24dd,BootID:6c425a3b-23de-41f0-9815-f6a0465861ce,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.4],SizeBytes:63279305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:51155161,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:7000509,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/disks/pvc-b7ab664b-0ec4-4c41-b615-0795a2fb099a],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/disks/pvc-b7ab664b-0ec4-4c41-b615-0795a2fb099a,DevicePath:,},},Config:nil,},} Dec 7 16:59:00.518: INFO: Logging kubelet events for node nodes-us-east4-a-zc10 Dec 7 16:59:00.567: INFO: Logging pods the kubelet thinks is on node nodes-us-east4-a-zc10 Dec 7 16:59:00.607: INFO: pod-0e5b1035-e3d9-4d5a-900b-2a71361b9410 started at 2022-12-07 16:58:42 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:00.607: INFO: Container write-pod ready: true, restart count 0 Dec 7 16:59:00.607: INFO: hostexec-nodes-us-east4-a-zc10-5sqhx started at 2022-12-07 16:58:31 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:00.607: INFO: Container agnhost-container ready: true, restart count 0 Dec 7 16:59:00.607: INFO: ss-2 started at 2022-12-07 16:58:33 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:00.607: INFO: Container webserver ready: true, restart count 0 Dec 7 16:59:00.607: INFO: ss2-1 started at 2022-12-07 16:58:37 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:00.607: INFO: Container webserver ready: true, restart count 0 Dec 7 16:59:00.607: INFO: kube-proxy-nodes-us-east4-a-zc10 started at 2022-12-07 16:49:35 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:00.607: INFO: Container kube-proxy ready: true, restart count 0 Dec 7 16:59:00.607: INFO: calico-node-g8zkr started at 2022-12-07 16:49:35 +0000 UTC (3+1 container statuses recorded) Dec 7 16:59:00.607: INFO: Init container upgrade-ipam ready: true, restart count 0 Dec 7 16:59:00.607: INFO: Init container install-cni ready: true, restart count 0 Dec 7 16:59:00.607: INFO: Init container mount-bpffs ready: true, restart count 0 Dec 7 16:59:00.607: INFO: Container calico-node ready: true, restart count 0 Dec 7 16:59:00.607: INFO: webserver-deployment-845c8977d9-8d2xx started at 2022-12-07 16:58:49 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:00.607: INFO: Container httpd ready: true, restart count 0 Dec 7 16:59:00.607: INFO: privileged-pod started at 2022-12-07 16:58:33 +0000 UTC (0+2 container statuses recorded) Dec 7 16:59:00.607: INFO: Container not-privileged-container ready: true, restart count 0 Dec 7 16:59:00.607: INFO: Container privileged-container ready: true, restart count 0 Dec 7 16:59:00.607: INFO: webserver-845c8977d9-8l8rq started at 2022-12-07 16:58:43 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:00.607: INFO: Container httpd ready: true, restart count 0 Dec 7 16:59:00.607: INFO: pod-da006aed-2bac-40b1-8b7b-f8ebda881763 started at 2022-12-07 16:58:54 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:00.607: INFO: Container write-pod ready: false, restart count 0 Dec 7 16:59:00.607: INFO: webserver-766c9598db-4tjgp started at <nil> (0+0 container statuses recorded) Dec 7 16:59:00.607: INFO: csi-gce-pd-node-vtqz7 started at 2022-12-07 16:49:35 +0000 UTC (0+2 container statuses recorded) Dec 7 16:59:00.607: INFO: Container csi-driver-registrar ready: true, restart count 0 Dec 7 16:59:00.607: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 16:59:00.607: INFO: coredns-677fff9cfb-4b88c started at 2022-12-07 16:50:04 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:00.607: INFO: Container coredns ready: true, restart count 0 Dec 7 16:59:00.607: INFO: netserver-3 started at 2022-12-07 16:58:49 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:00.607: INFO: Container webserver ready: false, restart count 0 Dec 7 16:59:00.607: INFO: webserver-845c8977d9-8bq77 started at 2022-12-07 16:58:19 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:00.607: INFO: Container httpd ready: true, restart count 0 Dec 7 16:59:00.607: INFO: webserver-845c8977d9-4bzmt started at 2022-12-07 16:58:46 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:00.607: INFO: Container httpd ready: true, restart count 0 Dec 7 16:59:00.607: INFO: webserver-deployment-845c8977d9-jkstp started at 2022-12-07 16:58:49 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:00.607: INFO: Container httpd ready: true, restart count 0 Dec 7 16:59:00.813: INFO: Latency metrics for node nodes-us-east4-a-zc10 Dec 7 16:59:00.813: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP:�[0m Destroying namespace "webhook-8654" for this suite. �[38;5;243m12/07/22 16:59:00.886�[0m �[1mSTEP:�[0m Destroying namespace "webhook-8654-markers" for this suite. �[38;5;243m12/07/22 16:59:00.943�[0m [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/apimachinery/webhook.go:104
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sAggregator\sShould\sbe\sable\sto\ssupport\sthe\s1\.17\sSample\sAPI\sServer\susing\sthe\scurrent\sAggregator\s\[Conformance\]$'
test/e2e/apimachinery/aggregator.go:397 k8s.io/kubernetes/test/e2e/apimachinery.TestSampleAPIServer(0xc000d4fb80, 0xc0015cb320, {0xc002050380, 0x37}) test/e2e/apimachinery/aggregator.go:397 +0x31bd k8s.io/kubernetes/test/e2e/apimachinery.glob..func1.3() test/e2e/apimachinery/aggregator.go:102 +0x125from junit_01.xml
{"msg":"FAILED [sig-api-machinery] Aggregator Should be able to support the 1.17 Sample API Server using the current Aggregator [Conformance]","completed":5,"skipped":26,"failed":1,"failures":["[sig-api-machinery] Aggregator Should be able to support the 1.17 Sample API Server using the current Aggregator [Conformance]"]} [BeforeEach] [sig-api-machinery] Aggregator test/e2e/framework/framework.go:186 �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m12/07/22 16:57:54.423�[0m Dec 7 16:57:54.423: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP:�[0m Building a namespace api object, basename aggregator �[38;5;243m12/07/22 16:57:54.424�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m12/07/22 16:57:54.556�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m12/07/22 16:57:54.61�[0m [BeforeEach] [sig-api-machinery] Aggregator test/e2e/apimachinery/aggregator.go:78 Dec 7 16:57:54.710: INFO: >>> kubeConfig: /root/.kube/config [It] Should be able to support the 1.17 Sample API Server using the current Aggregator [Conformance] test/e2e/apimachinery/aggregator.go:100 �[1mSTEP:�[0m Registering the sample API server. �[38;5;243m12/07/22 16:57:54.711�[0m Dec 7 16:57:55.404: INFO: deployment "sample-apiserver-deployment" doesn't have the required revision set Dec 7 16:57:57.674: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 7, 16, 57, 55, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 7, 16, 57, 55, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 7, 16, 57, 55, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 7, 16, 57, 55, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-b5b45d9d4\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 7 16:57:59.714: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 7, 16, 57, 55, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 7, 16, 57, 55, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 7, 16, 57, 55, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 7, 16, 57, 55, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-b5b45d9d4\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 7 16:58:01.703: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 7, 16, 57, 55, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 7, 16, 57, 55, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 7, 16, 57, 55, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 7, 16, 57, 55, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-b5b45d9d4\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 7 16:58:03.721: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 7, 16, 57, 55, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 7, 16, 57, 55, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 7, 16, 57, 55, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 7, 16, 57, 55, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-b5b45d9d4\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 7 16:58:05.704: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 7, 16, 57, 55, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 7, 16, 57, 55, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 7, 16, 57, 55, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 7, 16, 57, 55, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-b5b45d9d4\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 7 16:58:07.704: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 7, 16, 57, 55, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 7, 16, 57, 55, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 7, 16, 57, 55, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 7, 16, 57, 55, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-b5b45d9d4\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 7 16:58:09.709: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 7, 16, 57, 55, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 7, 16, 57, 55, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 7, 16, 57, 55, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 7, 16, 57, 55, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-b5b45d9d4\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 7 16:58:11.702: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 7, 16, 57, 55, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 7, 16, 57, 55, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 7, 16, 57, 55, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 7, 16, 57, 55, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-b5b45d9d4\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 7 16:58:13.716: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 7, 16, 57, 55, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 7, 16, 57, 55, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 7, 16, 57, 55, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 7, 16, 57, 55, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-b5b45d9d4\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 7 16:58:15.703: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 7, 16, 57, 55, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 7, 16, 57, 55, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 7, 16, 57, 55, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 7, 16, 57, 55, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-b5b45d9d4\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 7 16:58:17.708: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 7, 16, 57, 55, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 7, 16, 57, 55, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 7, 16, 57, 55, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 7, 16, 57, 55, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-b5b45d9d4\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 7 16:58:19.703: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 7, 16, 57, 55, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 7, 16, 57, 55, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 7, 16, 57, 55, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 7, 16, 57, 55, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-b5b45d9d4\" is progressing."}}, CollisionCount:(*int32)(nil)} Dec 7 16:59:21.987: INFO: Waited 1m0.246747208s for the sample-apiserver to be ready to handle requests. Dec 7 16:59:21.987: INFO: current APIService: {"metadata":{"name":"v1alpha1.wardle.example.com","uid":"099fcef6-4671-4373-96d5-811fbf94d7e6","resourceVersion":"22347","creationTimestamp":"2022-12-07T16:58:21Z","managedFields":[{"manager":"e2e.test","operation":"Update","apiVersion":"apiregistration.k8s.io/v1","time":"2022-12-07T16:58:21Z","fieldsType":"FieldsV1","fieldsV1":{"f:spec":{"f:caBundle":{},"f:group":{},"f:groupPriorityMinimum":{},"f:service":{".":{},"f:name":{},"f:namespace":{},"f:port":{}},"f:version":{},"f:versionPriority":{}}}},{"manager":"kube-apiserver","operation":"Update","apiVersion":"apiregistration.k8s.io/v1","time":"2022-12-07T16:59:11Z","fieldsType":"FieldsV1","fieldsV1":{"f:status":{"f:conditions":{".":{},"k:{\"type\":\"Available\"}":{".":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}},"subresource":"status"}]},"spec":{"service":{"namespace":"aggregator-1412","name":"sample-api","port":7443},"group":"wardle.example.com","version":"v1alpha1","caBundle":"LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSURGakNDQWY2Z0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFkTVJzd0dRWURWUVFERXhKbE1tVXQKYzJWeWRtVnlMV05sY25RdFkyRXdIaGNOTWpJeE1qQTNNVFkxTnpVMFdoY05Nekl4TWpBME1UWTFOelUwV2pBZApNUnN3R1FZRFZRUURFeEpsTW1VdGMyVnlkbVZ5TFdObGNuUXRZMkV3Z2dFaU1BMEdDU3FHU0liM0RRRUJBUVVBCkE0SUJEd0F3Z2dFS0FvSUJBUURHZ1YxeUloRW11Ly9Ob2ovYk9kZnFlNDBEajltenNlMVZGQjFCMldnQ1BSUjUKc0EyNEpnWGF0ZjBEclFoekUxWlI3U0thUFhxMjdPZjZ3bThTOVp1S01Jb3M5blQvbkhhRWZJUmJUUlJHcFRpagpkNHZ3aG52S28xS2pOWVhJQlNoOVlnMlV0dElyeTBxQUZEM0RSKytRRkZRUTZYN2hMdXdGQi9LM3dkcEh6RjEyCkJSUE9mdTFnanV1V2lMTTBXbXIxTUtwZ0c3UUZPZ0d3YXVUcFh1dnpPMTZrcGl2bURpU0Qrd0ozSUJjdVVJb0wKd29iaEhWZTNWYTBObHdYcnBwakNBbWowNk5JSkkycEZkcFNxdHozZStFNmdhNmZtamg3R3VpbUFIOFVwb2VpMwpXT29rK2Z1TmNTRWd6RGRqU1dDeGZaWEJVQUxWV2NLblEwQ0ZxeEpuQWdNQkFBR2pZVEJmTUE0R0ExVWREd0VCCi93UUVBd0lDcERBUEJnTlZIUk1CQWY4RUJUQURBUUgvTUIwR0ExVWREZ1FXQkJRMk5Qc1dkckJJWXNId3FJenIKdFdKalNOU1RLakFkQmdOVkhSRUVGakFVZ2hKbE1tVXRjMlZ5ZG1WeUxXTmxjblF0WTJFd0RRWUpLb1pJaHZjTgpBUUVMQlFBRGdnRUJBRW5OQ0tFZWswUTVqMVpabzR5cWRLSk93Qk85NUxCZzZRNXFsNS9ZdmYyQ3hORjVDeTlsCmlaOE80amtRMS9ZSnJuWFZnaFlXMnl6NGpvaGlDZTNJdWxabkJzait1amFJUDEvWDdKa3VoVDhyb3B1ODhpRDYKbE10ZWh5MkNJRWhrWnJ4VFQvU0FlTjRLSkFvN0szUkZDK3ZWSkhuN0tsNTJZdGFTcWg5K2p6amt5cUNLQUhGNQowT1ZYY0JiTG4yWGc4QnZUT1R6REJ6aEJjNTIxVWkxaHpkbUY5bnh4cmltTTR2NnVBSXhoM1djYk9QTnY0anZ2ClhMT001N21ZVFh3cmN6a0c2Z0ZkNWMybnZtUHprQXF4Wit4MXI3MEFySkFUOFdqKytRRktBdktLbHFlWGR2bnAKVnNGcjZFcGRFNDY0NGZTbzhUaXd6YlFnTm52NDk5WGhLbE09Ci0tLS0tRU5EIENFUlRJRklDQVRFLS0tLS0K","groupPriorityMinimum":2000,"versionPriority":200},"status":{"conditions":[{"type":"Available","status":"False","lastTransitionTime":"2022-12-07T16:58:21Z","reason":"FailedDiscoveryCheck","message":"failing or missing response from https://100.66.83.122:7443/apis/wardle.example.com/v1alpha1: Get \"https://100.66.83.122:7443/apis/wardle.example.com/v1alpha1\": dial tcp 100.66.83.122:7443: i/o timeout"}]}} Dec 7 16:59:21.989: INFO: current pods: {"metadata":{"resourceVersion":"22843"},"items":[{"metadata":{"name":"sample-apiserver-deployment-b5b45d9d4-2fzcf","generateName":"sample-apiserver-deployment-b5b45d9d4-","namespace":"aggregator-1412","uid":"743caf02-1c90-45b1-8117-40884bff8b2f","resourceVersion":"19778","creationTimestamp":"2022-12-07T16:57:55Z","labels":{"apiserver":"true","app":"sample-apiserver","pod-template-hash":"b5b45d9d4"},"annotations":{"cni.projectcalico.org/containerID":"8b302772d200621c3476ff491644484ce7d7dc7341cc34073277ea2b60415486","cni.projectcalico.org/podIP":"100.113.109.221/32","cni.projectcalico.org/podIPs":"100.113.109.221/32"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"sample-apiserver-deployment-b5b45d9d4","uid":"31c8053d-e756-4766-a150-cc0cc0407e18","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2022-12-07T16:57:55Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:apiserver":{},"f:app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"31c8053d-e756-4766-a150-cc0cc0407e18\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"etcd\"}":{".":{},"f:command":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}},"k:{\"name\":\"sample-apiserver\"}":{".":{},"f:args":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:readinessProbe":{".":{},"f:failureThreshold":{},"f:httpGet":{".":{},"f:path":{},"f:port":{},"f:scheme":{}},"f:initialDelaySeconds":{},"f:periodSeconds":{},"f:successThreshold":{},"f:timeoutSeconds":{}},"f:resources":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/apiserver.local.config/certificates\"}":{".":{},"f:mountPath":{},"f:name":{},"f:readOnly":{}}}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{},"f:volumes":{".":{},"k:{\"name\":\"apiserver-certs\"}":{".":{},"f:name":{},"f:secret":{".":{},"f:defaultMode":{},"f:secretName":{}}}}}}},{"manager":"calico","operation":"Update","apiVersion":"v1","time":"2022-12-07T16:57:57Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:cni.projectcalico.org/containerID":{},"f:cni.projectcalico.org/podIP":{},"f:cni.projectcalico.org/podIPs":{}}}},"subresource":"status"},{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2022-12-07T16:58:20Z","fieldsType":"FieldsV1","fieldsV1":{"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:phase":{},"f:podIP":{},"f:podIPs":{".":{},"k:{\"ip\":\"100.113.109.221\"}":{".":{},"f:ip":{}}},"f:startTime":{}}},"subresource":"status"}]},"spec":{"volumes":[{"name":"apiserver-certs","secret":{"secretName":"sample-apiserver-secret","defaultMode":420}},{"name":"kube-api-access-pprdc","projected":{"sources":[{"serviceAccountToken":{"expirationSeconds":3607,"path":"token"}},{"configMap":{"name":"kube-root-ca.crt","items":[{"key":"ca.crt","path":"ca.crt"}]}},{"downwardAPI":{"items":[{"path":"namespace","fieldRef":{"apiVersion":"v1","fieldPath":"metadata.namespace"}}]}}],"defaultMode":420}}],"containers":[{"name":"sample-apiserver","image":"registry.k8s.io/e2e-test-images/sample-apiserver:1.17.5","args":["--etcd-servers=http://127.0.0.1:2379","--tls-cert-file=/apiserver.local.config/certificates/tls.crt","--tls-private-key-file=/apiserver.local.config/certificates/tls.key","--audit-log-path=-","--audit-log-maxage=0","--audit-log-maxbackup=0"],"resources":{},"volumeMounts":[{"name":"apiserver-certs","readOnly":true,"mountPath":"/apiserver.local.config/certificates"},{"name":"kube-api-access-pprdc","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"readinessProbe":{"httpGet":{"path":"/readyz","port":443,"scheme":"HTTPS"},"initialDelaySeconds":20,"timeoutSeconds":1,"periodSeconds":1,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"},{"name":"etcd","image":"registry.k8s.io/etcd:3.5.5-0","command":["/usr/local/bin/etcd","--listen-client-urls","http://127.0.0.1:2379","--advertise-client-urls","http://127.0.0.1:2379"],"resources":{},"volumeMounts":[{"name":"kube-api-access-pprdc","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":0,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","nodeName":"nodes-us-east4-a-nfxp","securityContext":{},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true,"preemptionPolicy":"PreemptLowerPriority"},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2022-12-07T16:57:55Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2022-12-07T16:58:19Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2022-12-07T16:58:19Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2022-12-07T16:57:55Z"}],"hostIP":"10.0.16.6","podIP":"100.113.109.221","podIPs":[{"ip":"100.113.109.221"}],"startTime":"2022-12-07T16:57:55Z","containerStatuses":[{"name":"etcd","state":{"running":{"startedAt":"2022-12-07T16:57:59Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.k8s.io/etcd:3.5.5-0","imageID":"registry.k8s.io/etcd@sha256:b83c1d70989e1fe87583607bf5aee1ee34e52773d4755b95f5cf5a451962f3a4","containerID":"containerd://ad5a605cb12dd2cee6925e3899b1b9a090149782db8896aaac5a91b6fa624c5f","started":true},{"name":"sample-apiserver","state":{"running":{"startedAt":"2022-12-07T16:57:59Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.k8s.io/e2e-test-images/sample-apiserver:1.17.5","imageID":"registry.k8s.io/e2e-test-images/sample-apiserver@sha256:f9c93b92b6ff750b41a93c4e4fe0bfe384597aeb841e2539d5444815c55b2d8f","containerID":"containerd://37455734592de8908f18489aa9491b6bc6c0c68e13070864b21b03aafabfae80","started":true}],"qosClass":"BestEffort"}}]} Dec 7 16:59:22.259: INFO: logs of sample-apiserver-deployment-b5b45d9d4-2fzcf/sample-apiserver (error: <nil>): W1207 16:58:00.303665 1 configmap_cafile_content.go:102] unable to load initial CA bundle for: "client-ca::kube-system::extension-apiserver-authentication::client-ca-file" due to: configmap "extension-apiserver-authentication" not found W1207 16:58:00.303831 1 configmap_cafile_content.go:102] unable to load initial CA bundle for: "client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" due to: configmap "extension-apiserver-authentication" not found I1207 16:58:00.325491 1 plugins.go:158] Loaded 3 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,MutatingAdmissionWebhook,BanFlunder. I1207 16:58:00.325587 1 plugins.go:161] Loaded 1 validating admission controller(s) successfully in the following order: ValidatingAdmissionWebhook. I1207 16:58:00.327056 1 client.go:361] parsed scheme: "endpoint" I1207 16:58:00.327144 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:2379 0 <nil>}] I1207 16:58:00.327945 1 client.go:361] parsed scheme: "endpoint" I1207 16:58:00.328014 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:2379 0 <nil>}] I1207 16:58:00.330311 1 client.go:361] parsed scheme: "endpoint" I1207 16:58:00.333202 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:2379 0 <nil>}] I1207 16:58:00.333999 1 client.go:361] parsed scheme: "endpoint" I1207 16:58:00.334069 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:2379 0 <nil>}] I1207 16:58:00.375637 1 secure_serving.go:178] Serving securely on [::]:443 I1207 16:58:00.375884 1 configmap_cafile_content.go:205] Starting client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I1207 16:58:00.375986 1 shared_informer.go:197] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I1207 16:58:00.376113 1 dynamic_serving_content.go:129] Starting serving-cert::/apiserver.local.config/certificates/tls.crt::/apiserver.local.config/certificates/tls.key I1207 16:58:00.376242 1 tlsconfig.go:219] Starting DynamicServingCertificateController I1207 16:58:00.376368 1 configmap_cafile_content.go:205] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file I1207 16:58:00.376453 1 shared_informer.go:197] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I1207 16:58:00.476622 1 shared_informer.go:204] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I1207 16:58:00.476964 1 shared_informer.go:204] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I1207 16:58:00.862529 1 client.go:361] parsed scheme: "endpoint" I1207 16:58:00.862609 1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{http://127.0.0.1:2379 0 <nil>}] Dec 7 16:59:22.308: INFO: logs of sample-apiserver-deployment-b5b45d9d4-2fzcf/etcd (error: <nil>): {"level":"info","ts":"2022-12-07T16:58:00.065Z","caller":"etcdmain/etcd.go:73","msg":"Running: ","args":["/usr/local/bin/etcd","--listen-client-urls","http://127.0.0.1:2379","--advertise-client-urls","http://127.0.0.1:2379"]} {"level":"warn","ts":"2022-12-07T16:58:00.065Z","caller":"etcdmain/etcd.go:105","msg":"'data-dir' was empty; using default","data-dir":"default.etcd"} {"level":"info","ts":"2022-12-07T16:58:00.065Z","caller":"embed/etcd.go:124","msg":"configuring peer listeners","listen-peer-urls":["http://localhost:2380"]} {"level":"info","ts":"2022-12-07T16:58:00.108Z","caller":"embed/etcd.go:132","msg":"configuring client listeners","listen-client-urls":["http://127.0.0.1:2379"]} {"level":"info","ts":"2022-12-07T16:58:00.108Z","caller":"embed/etcd.go:306","msg":"starting an etcd server","etcd-version":"3.5.5","git-sha":"19002cfc6","go-version":"go1.16.15","go-os":"linux","go-arch":"amd64","max-cpu-set":2,"max-cpu-available":2,"member-initialized":false,"name":"default","data-dir":"default.etcd","wal-dir":"","wal-dir-dedicated":"","member-dir":"default.etcd/member","force-new-cluster":false,"heartbeat-interval":"100ms","election-timeout":"1s","initial-election-tick-advance":true,"snapshot-count":100000,"snapshot-catchup-entries":5000,"initial-advertise-peer-urls":["http://localhost:2380"],"listen-peer-urls":["http://localhost:2380"],"advertise-client-urls":["http://127.0.0.1:2379"],"listen-client-urls":["http://127.0.0.1:2379"],"listen-metrics-urls":[],"cors":["*"],"host-whitelist":["*"],"initial-cluster":"default=http://localhost:2380","initial-cluster-state":"new","initial-cluster-token":"etcd-cluster","quota-backend-bytes":2147483648,"max-request-bytes":1572864,"max-concurrent-streams":4294967295,"pre-vote":true,"initial-corrupt-check":false,"corrupt-check-time-interval":"0s","compact-check-time-enabled":false,"compact-check-time-interval":"1m0s","auto-compaction-mode":"periodic","auto-compaction-retention":"0s","auto-compaction-interval":"0s","discovery-url":"","discovery-proxy":"","downgrade-check-interval":"5s"} {"level":"info","ts":"2022-12-07T16:58:00.112Z","caller":"etcdserver/backend.go:81","msg":"opened backend db","path":"default.etcd/member/snap/db","took":"3.72327ms"} {"level":"info","ts":"2022-12-07T16:58:00.154Z","caller":"etcdserver/raft.go:494","msg":"starting local member","local-member-id":"8e9e05c52164694d","cluster-id":"cdf818194e3a8c32"} {"level":"info","ts":"2022-12-07T16:58:00.154Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d switched to configuration voters=()"} {"level":"info","ts":"2022-12-07T16:58:00.154Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d became follower at term 0"} {"level":"info","ts":"2022-12-07T16:58:00.154Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"newRaft 8e9e05c52164694d [peers: [], term: 0, commit: 0, applied: 0, lastindex: 0, lastterm: 0]"} {"level":"info","ts":"2022-12-07T16:58:00.154Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d became follower at term 1"} {"level":"info","ts":"2022-12-07T16:58:00.155Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d switched to configuration voters=(10276657743932975437)"} {"level":"warn","ts":"2022-12-07T16:58:00.158Z","caller":"auth/store.go:1233","msg":"simple token is not cryptographically signed"} {"level":"info","ts":"2022-12-07T16:58:00.160Z","caller":"mvcc/kvstore.go:393","msg":"kvstore restored","current-rev":1} {"level":"info","ts":"2022-12-07T16:58:00.162Z","caller":"etcdserver/quota.go:94","msg":"enabled backend quota with default value","quota-name":"v3-applier","quota-size-bytes":2147483648,"quota-size":"2.1 GB"} {"level":"info","ts":"2022-12-07T16:58:00.165Z","caller":"etcdserver/server.go:854","msg":"starting etcd server","local-member-id":"8e9e05c52164694d","local-server-version":"3.5.5","cluster-version":"to_be_decided"} {"level":"info","ts":"2022-12-07T16:58:00.189Z","caller":"embed/etcd.go:275","msg":"now serving peer/client/metrics","local-member-id":"8e9e05c52164694d","initial-advertise-peer-urls":["http://localhost:2380"],"listen-peer-urls":["http://localhost:2380"],"advertise-client-urls":["http://127.0.0.1:2379"],"listen-client-urls":["http://127.0.0.1:2379"],"listen-metrics-urls":[]} {"level":"info","ts":"2022-12-07T16:58:00.191Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d switched to configuration voters=(10276657743932975437)"} {"level":"info","ts":"2022-12-07T16:58:00.191Z","caller":"etcdserver/server.go:738","msg":"started as single-node; fast-forwarding election ticks","local-member-id":"8e9e05c52164694d","forward-ticks":9,"forward-duration":"900ms","election-ticks":10,"election-timeout":"1s"} {"level":"info","ts":"2022-12-07T16:58:00.191Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"cdf818194e3a8c32","local-member-id":"8e9e05c52164694d","added-peer-id":"8e9e05c52164694d","added-peer-peer-urls":["http://localhost:2380"]} {"level":"info","ts":"2022-12-07T16:58:00.192Z","caller":"embed/etcd.go:584","msg":"serving peer traffic","address":"127.0.0.1:2380"} {"level":"info","ts":"2022-12-07T16:58:00.192Z","caller":"embed/etcd.go:556","msg":"cmux::serve","address":"127.0.0.1:2380"} {"level":"info","ts":"2022-12-07T16:58:00.256Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d is starting a new election at term 1"} {"level":"info","ts":"2022-12-07T16:58:00.256Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d became pre-candidate at term 1"} {"level":"info","ts":"2022-12-07T16:58:00.256Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d received MsgPreVoteResp from 8e9e05c52164694d at term 1"} {"level":"info","ts":"2022-12-07T16:58:00.257Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d became candidate at term 2"} {"level":"info","ts":"2022-12-07T16:58:00.257Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d received MsgVoteResp from 8e9e05c52164694d at term 2"} {"level":"info","ts":"2022-12-07T16:58:00.257Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d became leader at term 2"} {"level":"info","ts":"2022-12-07T16:58:00.257Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: 8e9e05c52164694d elected leader 8e9e05c52164694d at term 2"} {"level":"info","ts":"2022-12-07T16:58:00.260Z","caller":"etcdserver/server.go:2563","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"} {"level":"info","ts":"2022-12-07T16:58:00.262Z","caller":"etcdserver/server.go:2054","msg":"published local member to cluster through raft","local-member-id":"8e9e05c52164694d","local-member-attributes":"{Name:default ClientURLs:[http://127.0.0.1:2379]}","request-path":"/0/members/8e9e05c52164694d/attributes","cluster-id":"cdf818194e3a8c32","publish-timeout":"7s"} {"level":"info","ts":"2022-12-07T16:58:00.262Z","caller":"embed/serve.go:100","msg":"ready to serve client requests"} {"level":"info","ts":"2022-12-07T16:58:00.263Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"cdf818194e3a8c32","local-member-id":"8e9e05c52164694d","cluster-version":"3.5"} {"level":"info","ts":"2022-12-07T16:58:00.263Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"} {"level":"info","ts":"2022-12-07T16:58:00.263Z","caller":"etcdserver/server.go:2587","msg":"cluster version is updated","cluster-version":"3.5"} {"level":"info","ts":"2022-12-07T16:58:00.263Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"} {"level":"info","ts":"2022-12-07T16:58:00.263Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"} {"level":"info","ts":"2022-12-07T16:58:00.267Z","caller":"embed/serve.go:146","msg":"serving client traffic insecurely; this is strongly discouraged!","address":"127.0.0.1:2379"} Dec 7 16:59:22.308: INFO: Unexpected error: gave up waiting for apiservice wardle to come up successfully: <*errors.errorString | 0xc00011dc50>: { s: "timed out waiting for the condition", } Dec 7 16:59:22.308: FAIL: gave up waiting for apiservice wardle to come up successfully: timed out waiting for the condition Full Stack Trace k8s.io/kubernetes/test/e2e/apimachinery.TestSampleAPIServer(0xc000d4fb80, 0xc0015cb320, {0xc002050380, 0x37}) test/e2e/apimachinery/aggregator.go:397 +0x31bd k8s.io/kubernetes/test/e2e/apimachinery.glob..func1.3() test/e2e/apimachinery/aggregator.go:102 +0x125 [AfterEach] [sig-api-machinery] Aggregator test/e2e/apimachinery/aggregator.go:68 [AfterEach] [sig-api-machinery] Aggregator test/e2e/framework/framework.go:187 �[1mSTEP:�[0m Collecting events from namespace "aggregator-1412". �[38;5;243m12/07/22 16:59:23.288�[0m �[1mSTEP:�[0m Found 12 events. �[38;5;243m12/07/22 16:59:23.351�[0m Dec 7 16:59:23.351: INFO: At 2022-12-07 16:57:55 +0000 UTC - event for sample-apiserver-deployment: {deployment-controller } ScalingReplicaSet: Scaled up replica set sample-apiserver-deployment-b5b45d9d4 to 1 Dec 7 16:59:23.351: INFO: At 2022-12-07 16:57:55 +0000 UTC - event for sample-apiserver-deployment-b5b45d9d4: {replicaset-controller } SuccessfulCreate: Created pod: sample-apiserver-deployment-b5b45d9d4-2fzcf Dec 7 16:59:23.351: INFO: At 2022-12-07 16:57:55 +0000 UTC - event for sample-apiserver-deployment-b5b45d9d4-2fzcf: {default-scheduler } Scheduled: Successfully assigned aggregator-1412/sample-apiserver-deployment-b5b45d9d4-2fzcf to nodes-us-east4-a-nfxp Dec 7 16:59:23.351: INFO: At 2022-12-07 16:57:58 +0000 UTC - event for sample-apiserver-deployment-b5b45d9d4-2fzcf: {kubelet nodes-us-east4-a-nfxp} Pulling: Pulling image "registry.k8s.io/e2e-test-images/sample-apiserver:1.17.5" Dec 7 16:59:23.351: INFO: At 2022-12-07 16:57:59 +0000 UTC - event for sample-apiserver-deployment-b5b45d9d4-2fzcf: {kubelet nodes-us-east4-a-nfxp} Pulled: Successfully pulled image "registry.k8s.io/e2e-test-images/sample-apiserver:1.17.5" in 1.663608244s Dec 7 16:59:23.351: INFO: At 2022-12-07 16:57:59 +0000 UTC - event for sample-apiserver-deployment-b5b45d9d4-2fzcf: {kubelet nodes-us-east4-a-nfxp} Created: Created container sample-apiserver Dec 7 16:59:23.351: INFO: At 2022-12-07 16:57:59 +0000 UTC - event for sample-apiserver-deployment-b5b45d9d4-2fzcf: {kubelet nodes-us-east4-a-nfxp} Started: Started container sample-apiserver Dec 7 16:59:23.351: INFO: At 2022-12-07 16:57:59 +0000 UTC - event for sample-apiserver-deployment-b5b45d9d4-2fzcf: {kubelet nodes-us-east4-a-nfxp} Pulled: Container image "registry.k8s.io/etcd:3.5.5-0" already present on machine Dec 7 16:59:23.351: INFO: At 2022-12-07 16:57:59 +0000 UTC - event for sample-apiserver-deployment-b5b45d9d4-2fzcf: {kubelet nodes-us-east4-a-nfxp} Created: Created container etcd Dec 7 16:59:23.351: INFO: At 2022-12-07 16:57:59 +0000 UTC - event for sample-apiserver-deployment-b5b45d9d4-2fzcf: {kubelet nodes-us-east4-a-nfxp} Started: Started container etcd Dec 7 16:59:23.351: INFO: At 2022-12-07 16:59:22 +0000 UTC - event for sample-apiserver-deployment-b5b45d9d4-2fzcf: {kubelet nodes-us-east4-a-nfxp} Killing: Stopping container sample-apiserver Dec 7 16:59:23.351: INFO: At 2022-12-07 16:59:22 +0000 UTC - event for sample-apiserver-deployment-b5b45d9d4-2fzcf: {kubelet nodes-us-east4-a-nfxp} Killing: Stopping container etcd Dec 7 16:59:23.395: INFO: POD NODE PHASE GRACE CONDITIONS Dec 7 16:59:23.395: INFO: Dec 7 16:59:23.483: INFO: Logging node info for node control-plane-us-east4-a-vd91 Dec 7 16:59:23.528: INFO: Node Info: &Node{ObjectMeta:{control-plane-us-east4-a-vd91 74d54d8e-e0bc-4c7d-bf3c-5b66ce025930 22281 0 2022-12-07 16:47:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-standard-2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east4 failure-domain.beta.kubernetes.io/zone:us-east4-a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:control-plane-us-east4-a-vd91 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node-role.kubernetes.io/node: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:e2-standard-2 topology.gke.io/zone:us-east4-a topology.kubernetes.io/region:us-east4 topology.kubernetes.io/zone:us-east4-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/instances/control-plane-us-east4-a-vd91"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.5/32 projectcalico.org/IPv4IPIPTunnelAddr:100.101.18.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-12-07 16:47:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2022-12-07 16:48:18 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {calico-node Update v1 2022-12-07 16:48:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}}}}} status} {cloud-controller-manager Update v1 2022-12-07 16:48:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2022-12-07 16:48:34 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:48:39 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:48:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-12-07 16:59:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:gce://gce-gci-upg-lat-1-3-ctl-skew/us-east4-a/control-plane-us-east4-a-vd91,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8332767232 0} {<nil>} 8137468Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8227909632 0} {<nil>} 8035068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-07 16:48:39 +0000 UTC,LastTransitionTime:2022-12-07 16:48:39 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-07 16:59:10 +0000 UTC,LastTransitionTime:2022-12-07 16:47:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-07 16:59:10 +0000 UTC,LastTransitionTime:2022-12-07 16:47:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-07 16:59:10 +0000 UTC,LastTransitionTime:2022-12-07 16:47:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-07 16:59:10 +0000 UTC,LastTransitionTime:2022-12-07 16:48:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.5,},NodeAddress{Type:ExternalIP,Address:35.245.23.229,},NodeAddress{Type:Hostname,Address:control-plane-us-east4-a-vd91,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e32750d839dd77bbe79d8a1be267141a,SystemUUID:e32750d8-39dd-77bb-e79d-8a1be267141a,BootID:572b6367-72b8-4ea4-b559-5c84c54662ce,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gcr.io/k8s-staging-etcdadm/etcd-manager@sha256:f3a63853502cb3956fa708fea524be3b333036ebc1cd1dadd81abd9f1fe61043 gcr.io/k8s-staging-etcdadm/etcd-manager:v3.0.20220831-21-g12041b4c],SizeBytes:231516108,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.25.4],SizeBytes:129085904,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.25.4],SizeBytes:118436153,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.4],SizeBytes:63279305,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.25.4],SizeBytes:51921208,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-alpha.2],SizeBytes:42203406,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-alpha.2],SizeBytes:41463710,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:2b6acd7f677f76ffe12ecf3ea7df92eb9b1bdb07336d1ac2a54c7631fb753f7e docker.io/calico/kube-controllers:v3.24.5],SizeBytes:31137169,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2 registry.k8s.io/sig-storage/csi-provisioner:v2.1.0],SizeBytes:21205045,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:50c3cfd458fc8e0bf3c8c521eac39172009382fc66dc5044a330d137c6ed0b09 registry.k8s.io/sig-storage/csi-attacher:v3.1.0],SizeBytes:20103959,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a registry.k8s.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:9af9bf28430b00a0cedeb2ec29acadce45e6afcecd8bdf31c793c624cfa75fa7 registry.k8s.io/sig-storage/csi-snapshotter:v3.0.3],SizeBytes:19500777,},ContainerImage{Names:[docker.io/k8scloudprovidergcp/cloud-controller-manager@sha256:881fd1095937638040723973ade90e6700f1c831a78fb585a3227c4d021b0df9 docker.io/k8scloudprovidergcp/cloud-controller-manager:latest],SizeBytes:18702875,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-alpha.2],SizeBytes:4954573,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 7 16:59:23.528: INFO: Logging kubelet events for node control-plane-us-east4-a-vd91 Dec 7 16:59:23.573: INFO: Logging pods the kubelet thinks is on node control-plane-us-east4-a-vd91 Dec 7 16:59:23.646: INFO: dns-controller-8946976bb-6t8hj started at 2022-12-07 16:48:19 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:23.646: INFO: Container dns-controller ready: true, restart count 0 Dec 7 16:59:23.646: INFO: calico-kube-controllers-7bc879d8d6-t4vrx started at 2022-12-07 16:48:39 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:23.646: INFO: Container calico-kube-controllers ready: true, restart count 0 Dec 7 16:59:23.646: INFO: etcd-manager-events-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:23.646: INFO: Container etcd-manager ready: true, restart count 0 Dec 7 16:59:23.646: INFO: kube-controller-manager-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:23.646: INFO: Container kube-controller-manager ready: true, restart count 2 Dec 7 16:59:23.646: INFO: calico-node-zgvgx started at 2022-12-07 16:48:06 +0000 UTC (3+1 container statuses recorded) Dec 7 16:59:23.646: INFO: Init container upgrade-ipam ready: true, restart count 0 Dec 7 16:59:23.646: INFO: Init container install-cni ready: true, restart count 0 Dec 7 16:59:23.646: INFO: Init container mount-bpffs ready: true, restart count 0 Dec 7 16:59:23.646: INFO: Container calico-node ready: true, restart count 0 Dec 7 16:59:23.646: INFO: kube-proxy-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:23.646: INFO: Container kube-proxy ready: true, restart count 0 Dec 7 16:59:23.646: INFO: csi-gce-pd-node-z9fsn started at 2022-12-07 16:48:06 +0000 UTC (0+2 container statuses recorded) Dec 7 16:59:23.646: INFO: Container csi-driver-registrar ready: true, restart count 0 Dec 7 16:59:23.646: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 16:59:23.646: INFO: csi-gce-pd-controller-689c9f4444-b5qql started at 2022-12-07 16:48:18 +0000 UTC (0+5 container statuses recorded) Dec 7 16:59:23.646: INFO: Container csi-attacher ready: true, restart count 0 Dec 7 16:59:23.646: INFO: Container csi-provisioner ready: true, restart count 0 Dec 7 16:59:23.646: INFO: Container csi-resizer ready: true, restart count 0 Dec 7 16:59:23.646: INFO: Container csi-snapshotter ready: true, restart count 0 Dec 7 16:59:23.646: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 16:59:23.646: INFO: kops-controller-mnn6f started at 2022-12-07 16:48:18 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:23.646: INFO: Container kops-controller ready: true, restart count 0 Dec 7 16:59:23.646: INFO: cloud-controller-manager-xd6xh started at 2022-12-07 16:48:18 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:23.646: INFO: Container cloud-controller-manager ready: true, restart count 0 Dec 7 16:59:23.646: INFO: kube-scheduler-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:23.646: INFO: Container kube-scheduler ready: true, restart count 0 Dec 7 16:59:23.646: INFO: etcd-manager-main-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:23.646: INFO: Container etcd-manager ready: true, restart count 0 Dec 7 16:59:23.646: INFO: kube-apiserver-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+2 container statuses recorded) Dec 7 16:59:23.646: INFO: Container healthcheck ready: true, restart count 0 Dec 7 16:59:23.646: INFO: Container kube-apiserver ready: true, restart count 1 Dec 7 16:59:23.965: INFO: Latency metrics for node control-plane-us-east4-a-vd91 Dec 7 16:59:23.965: INFO: Logging node info for node nodes-us-east4-a-5680 Dec 7 16:59:24.000: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east4-a-5680 b9473b45-598f-43c3-aafc-dc872ade1274 22564 0 2022-12-07 16:49:31 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east4 failure-domain.beta.kubernetes.io/zone:us-east4-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east4-a-5680 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east4-a topology.hostpath.csi/node:nodes-us-east4-a-5680 topology.kubernetes.io/region:us-east4 topology.kubernetes.io/zone:us-east4-a] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-5522":"nodes-us-east4-a-5680","csi-hostpath-ephemeral-7154":"nodes-us-east4-a-5680","csi-hostpath-provisioning-3810":"nodes-us-east4-a-5680","csi-hostpath-volume-5950":"nodes-us-east4-a-5680","csi-hostpath-volume-expand-4661":"nodes-us-east4-a-5680","pd.csi.storage.gke.io":"projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/instances/nodes-us-east4-a-5680"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.3/32 projectcalico.org/IPv4IPIPTunnelAddr:100.119.115.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2022-12-07 16:49:31 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2022-12-07 16:49:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2022-12-07 16:49:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:49:41 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:49:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {calico-node Update v1 2022-12-07 16:49:59 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2022-12-07 16:59:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2022-12-07 16:59:17 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:gce://gce-gci-upg-lat-1-3-ctl-skew/us-east4-a/nodes-us-east4-a-5680,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-07 16:49:58 +0000 UTC,LastTransitionTime:2022-12-07 16:49:58 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-07 16:59:13 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-07 16:59:13 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-07 16:59:13 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-07 16:59:13 +0000 UTC,LastTransitionTime:2022-12-07 16:49:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.3,},NodeAddress{Type:ExternalIP,Address:34.86.83.231,},NodeAddress{Type:Hostname,Address:nodes-us-east4-a-5680,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:5676434e0327952eef9a8130969e32db,SystemUUID:5676434e-0327-952e-ef9a-8130969e32db,BootID:f4cd280b-a7ea-43c2-b78f-d43fab064010,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.4],SizeBytes:63279305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:51155161,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 registry.k8s.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/disks/pvc-a5cc56b8-d8e5-4487-b9b8-e2af120cc039],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/disks/pvc-a5cc56b8-d8e5-4487-b9b8-e2af120cc039,DevicePath:,},},Config:nil,},} Dec 7 16:59:24.000: INFO: Logging kubelet events for node nodes-us-east4-a-5680 Dec 7 16:59:24.068: INFO: Logging pods the kubelet thinks is on node nodes-us-east4-a-5680 Dec 7 16:59:24.118: INFO: ss-0 started at 2022-12-07 16:57:29 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:24.118: INFO: Container webserver ready: true, restart count 0 Dec 7 16:59:24.118: INFO: kube-proxy-nodes-us-east4-a-5680 started at 2022-12-07 16:49:34 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:24.118: INFO: Container kube-proxy ready: true, restart count 0 Dec 7 16:59:24.118: INFO: netserver-0 started at 2022-12-07 16:58:49 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:24.118: INFO: Container webserver ready: true, restart count 0 Dec 7 16:59:24.118: INFO: webserver-766c9598db-mfn5b started at 2022-12-07 16:58:55 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:24.118: INFO: Container httpd ready: true, restart count 0 Dec 7 16:59:24.118: INFO: csi-hostpathplugin-0 started at 2022-12-07 16:58:15 +0000 UTC (0+7 container statuses recorded) Dec 7 16:59:24.118: INFO: Container csi-attacher ready: true, restart count 0 Dec 7 16:59:24.118: INFO: Container csi-provisioner ready: true, restart count 0 Dec 7 16:59:24.118: INFO: Container csi-resizer ready: true, restart count 0 Dec 7 16:59:24.118: INFO: Container csi-snapshotter ready: true, restart count 0 Dec 7 16:59:24.118: INFO: Container hostpath ready: true, restart count 0 Dec 7 16:59:24.118: INFO: Container liveness-probe ready: true, restart count 0 Dec 7 16:59:24.118: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 7 16:59:24.118: INFO: csi-hostpathplugin-0 started at 2022-12-07 16:58:17 +0000 UTC (0+7 container statuses recorded) Dec 7 16:59:24.118: INFO: Container csi-attacher ready: true, restart count 0 Dec 7 16:59:24.118: INFO: Container csi-provisioner ready: true, restart count 0 Dec 7 16:59:24.118: INFO: Container csi-resizer ready: true, restart count 0 Dec 7 16:59:24.118: INFO: Container csi-snapshotter ready: true, restart count 0 Dec 7 16:59:24.118: INFO: Container hostpath ready: true, restart count 0 Dec 7 16:59:24.118: INFO: Container liveness-probe ready: true, restart count 0 Dec 7 16:59:24.118: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 7 16:59:24.118: INFO: csi-hostpathplugin-0 started at 2022-12-07 16:57:14 +0000 UTC (0+7 container statuses recorded) Dec 7 16:59:24.118: INFO: Container csi-attacher ready: true, restart count 0 Dec 7 16:59:24.118: INFO: Container csi-provisioner ready: true, restart count 0 Dec 7 16:59:24.118: INFO: Container csi-resizer ready: true, restart count 0 Dec 7 16:59:24.118: INFO: Container csi-snapshotter ready: true, restart count 0 Dec 7 16:59:24.118: INFO: Container hostpath ready: true, restart count 0 Dec 7 16:59:24.118: INFO: Container liveness-probe ready: true, restart count 0 Dec 7 16:59:24.118: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 7 16:59:24.118: INFO: csi-gce-pd-node-9n22s started at 2022-12-07 16:49:34 +0000 UTC (0+2 container statuses recorded) Dec 7 16:59:24.118: INFO: Container csi-driver-registrar ready: true, restart count 0 Dec 7 16:59:24.118: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 16:59:24.118: INFO: netserver-0 started at 2022-12-07 16:59:07 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:24.118: INFO: Container webserver ready: false, restart count 0 Dec 7 16:59:24.118: INFO: csi-hostpathplugin-0 started at 2022-12-07 16:56:35 +0000 UTC (0+7 container statuses recorded) Dec 7 16:59:24.118: INFO: Container csi-attacher ready: true, restart count 0 Dec 7 16:59:24.118: INFO: Container csi-provisioner ready: true, restart count 0 Dec 7 16:59:24.118: INFO: Container csi-resizer ready: true, restart count 0 Dec 7 16:59:24.118: INFO: Container csi-snapshotter ready: true, restart count 0 Dec 7 16:59:24.118: INFO: Container hostpath ready: true, restart count 0 Dec 7 16:59:24.118: INFO: Container liveness-probe ready: true, restart count 0 Dec 7 16:59:24.118: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 7 16:59:24.118: INFO: liveness-688a09ea-d9a6-407b-9398-11c557f91559 started at 2022-12-07 16:59:05 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:24.118: INFO: Container agnhost-container ready: true, restart count 0 Dec 7 16:59:24.118: INFO: webserver-766c9598db-drl6f started at 2022-12-07 16:59:04 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:24.118: INFO: Container httpd ready: true, restart count 0 Dec 7 16:59:24.118: INFO: webserver-766c9598db-zclkf started at 2022-12-07 16:59:11 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:24.118: INFO: Container httpd ready: true, restart count 0 Dec 7 16:59:24.118: INFO: csi-hostpathplugin-0 started at 2022-12-07 16:57:21 +0000 UTC (0+7 container statuses recorded) Dec 7 16:59:24.118: INFO: Container csi-attacher ready: true, restart count 0 Dec 7 16:59:24.118: INFO: Container csi-provisioner ready: true, restart count 0 Dec 7 16:59:24.118: INFO: Container csi-resizer ready: true, restart count 0 Dec 7 16:59:24.118: INFO: Container csi-snapshotter ready: true, restart count 0 Dec 7 16:59:24.118: INFO: Container hostpath ready: true, restart count 0 Dec 7 16:59:24.118: INFO: Container liveness-probe ready: true, restart count 0 Dec 7 16:59:24.118: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 7 16:59:24.118: INFO: calico-node-wvpd9 started at 2022-12-07 16:49:34 +0000 UTC (3+1 container statuses recorded) Dec 7 16:59:24.118: INFO: Init container upgrade-ipam ready: true, restart count 0 Dec 7 16:59:24.118: INFO: Init container install-cni ready: true, restart count 0 Dec 7 16:59:24.118: INFO: Init container mount-bpffs ready: true, restart count 0 Dec 7 16:59:24.118: INFO: Container calico-node ready: true, restart count 0 Dec 7 16:59:24.409: INFO: Latency metrics for node nodes-us-east4-a-5680 Dec 7 16:59:24.409: INFO: Logging node info for node nodes-us-east4-a-nfxp Dec 7 16:59:24.461: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east4-a-nfxp 958029bf-d66a-424c-a80d-b1d485df133b 22768 0 2022-12-07 16:49:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east4 failure-domain.beta.kubernetes.io/zone:us-east4-a io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east4-a-nfxp kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east4-a topology.hostpath.csi/node:nodes-us-east4-a-nfxp topology.kubernetes.io/region:us-east4 topology.kubernetes.io/zone:us-east4-a] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-3139":"csi-mock-csi-mock-volumes-3139","pd.csi.storage.gke.io":"projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/instances/nodes-us-east4-a-nfxp"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.6/32 projectcalico.org/IPv4IPIPTunnelAddr:100.113.109.192 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2022-12-07 16:49:28 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2022-12-07 16:49:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2022-12-07 16:49:29 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:49:41 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:49:48 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {calico-node Update v1 2022-12-07 16:49:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:59:20 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2022-12-07 16:59:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:gce://gce-gci-upg-lat-1-3-ctl-skew/us-east4-a/nodes-us-east4-a-nfxp,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-07 16:49:53 +0000 UTC,LastTransitionTime:2022-12-07 16:49:53 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-07 16:59:20 +0000 UTC,LastTransitionTime:2022-12-07 16:49:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-07 16:59:20 +0000 UTC,LastTransitionTime:2022-12-07 16:49:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-07 16:59:20 +0000 UTC,LastTransitionTime:2022-12-07 16:49:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-07 16:59:20 +0000 UTC,LastTransitionTime:2022-12-07 16:49:48 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.6,},NodeAddress{Type:ExternalIP,Address:34.145.242.1,},NodeAddress{Type:Hostname,Address:nodes-us-east4-a-nfxp,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:796e3b73d867da488abd70a5df2fe10f,SystemUUID:796e3b73-d867-da48-8abd-70a5df2fe10f,BootID:2b784aad-5897-4bb4-bb49-6bae545d9488,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:b83c1d70989e1fe87583607bf5aee1ee34e52773d4755b95f5cf5a451962f3a4 registry.k8s.io/etcd:3.5.5-0],SizeBytes:102417044,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.4],SizeBytes:63279305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:51155161,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:f9c93b92b6ff750b41a93c4e4fe0bfe384597aeb841e2539d5444815c55b2d8f registry.k8s.io/e2e-test-images/sample-apiserver:1.17.5],SizeBytes:24316368,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:aa60f453d64dfb3c3fd9e7306f988c36c6352c4f2d956aa90467f2808091effa registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.5],SizeBytes:15209420,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:7000509,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/disks/pvc-584849ee-9bda-401f-b082-2917e251db99],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/disks/pvc-584849ee-9bda-401f-b082-2917e251db99,DevicePath:,},},Config:nil,},} Dec 7 16:59:24.461: INFO: Logging kubelet events for node nodes-us-east4-a-nfxp Dec 7 16:59:24.493: INFO: Logging pods the kubelet thinks is on node nodes-us-east4-a-nfxp Dec 7 16:59:24.533: INFO: csi-mockplugin-0 started at 2022-12-07 16:58:26 +0000 UTC (0+4 container statuses recorded) Dec 7 16:59:24.533: INFO: Container busybox ready: true, restart count 0 Dec 7 16:59:24.533: INFO: Container csi-provisioner ready: false, restart count 1 Dec 7 16:59:24.533: INFO: Container driver-registrar ready: true, restart count 0 Dec 7 16:59:24.533: INFO: Container mock ready: true, restart count 0 Dec 7 16:59:24.533: INFO: kube-proxy-nodes-us-east4-a-nfxp started at 2022-12-07 16:49:29 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:24.533: INFO: Container kube-proxy ready: true, restart count 0 Dec 7 16:59:24.533: INFO: csi-gce-pd-node-vcz5x started at 2022-12-07 16:49:29 +0000 UTC (0+2 container statuses recorded) Dec 7 16:59:24.533: INFO: Container csi-driver-registrar ready: true, restart count 0 Dec 7 16:59:24.533: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 16:59:24.533: INFO: dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4 started at 2022-12-07 16:53:00 +0000 UTC (0+3 container statuses recorded) Dec 7 16:59:24.533: INFO: Container jessie-querier ready: true, restart count 0 Dec 7 16:59:24.533: INFO: Container querier ready: true, restart count 0 Dec 7 16:59:24.533: INFO: Container webserver ready: true, restart count 0 Dec 7 16:59:24.533: INFO: netserver-1 started at 2022-12-07 16:59:07 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:24.533: INFO: Container webserver ready: false, restart count 0 Dec 7 16:59:24.533: INFO: webserver-766c9598db-vdmjg started at 2022-12-07 16:59:14 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:24.533: INFO: Container httpd ready: true, restart count 0 Dec 7 16:59:24.533: INFO: calico-node-f2cxs started at 2022-12-07 16:49:29 +0000 UTC (3+1 container statuses recorded) Dec 7 16:59:24.533: INFO: Init container upgrade-ipam ready: true, restart count 0 Dec 7 16:59:24.533: INFO: Init container install-cni ready: true, restart count 0 Dec 7 16:59:24.533: INFO: Init container mount-bpffs ready: true, restart count 0 Dec 7 16:59:24.533: INFO: Container calico-node ready: true, restart count 0 Dec 7 16:59:24.533: INFO: webserver-766c9598db-7sd8q started at 2022-12-07 16:59:07 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:24.533: INFO: Container httpd ready: true, restart count 0 Dec 7 16:59:24.533: INFO: ss-1 started at 2022-12-07 16:57:57 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:24.533: INFO: Container webserver ready: true, restart count 0 Dec 7 16:59:24.533: INFO: netserver-1 started at 2022-12-07 16:58:49 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:24.533: INFO: Container webserver ready: true, restart count 0 Dec 7 16:59:24.533: INFO: webserver-766c9598db-9x6mf started at 2022-12-07 16:58:56 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:24.533: INFO: Container httpd ready: true, restart count 0 Dec 7 16:59:24.533: INFO: coredns-677fff9cfb-rv6b9 started at 2022-12-07 16:49:48 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:24.533: INFO: Container coredns ready: true, restart count 0 Dec 7 16:59:24.533: INFO: coredns-autoscaler-db7b97744-2cf6q started at 2022-12-07 16:49:48 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:24.533: INFO: Container autoscaler ready: true, restart count 0 Dec 7 16:59:24.740: INFO: Latency metrics for node nodes-us-east4-a-nfxp Dec 7 16:59:24.740: INFO: Logging node info for node nodes-us-east4-a-v6tj Dec 7 16:59:24.770: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east4-a-v6tj 7ccb4554-dd50-4efe-9be3-d3667475ec25 22649 0 2022-12-07 16:49:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east4 failure-domain.beta.kubernetes.io/zone:us-east4-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east4-a-v6tj kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east4-a topology.hostpath.csi/node:nodes-us-east4-a-v6tj topology.kubernetes.io/region:us-east4 topology.kubernetes.io/zone:us-east4-a] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-5906":"nodes-us-east4-a-v6tj","pd.csi.storage.gke.io":"projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/instances/nodes-us-east4-a-v6tj"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.2/32 projectcalico.org/IPv4IPIPTunnelAddr:100.123.60.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2022-12-07 16:49:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2022-12-07 16:49:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2022-12-07 16:49:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:49:49 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:49:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {calico-node Update v1 2022-12-07 16:50:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2022-12-07 16:59:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:gce://gce-gci-upg-lat-1-3-ctl-skew/us-east4-a/nodes-us-east4-a-v6tj,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111196160 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006338560 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-07 16:49:59 +0000 UTC,LastTransitionTime:2022-12-07 16:49:59 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-07 16:59:18 +0000 UTC,LastTransitionTime:2022-12-07 16:49:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-07 16:59:18 +0000 UTC,LastTransitionTime:2022-12-07 16:49:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-07 16:59:18 +0000 UTC,LastTransitionTime:2022-12-07 16:49:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-07 16:59:18 +0000 UTC,LastTransitionTime:2022-12-07 16:49:55 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.2,},NodeAddress{Type:ExternalIP,Address:35.245.137.186,},NodeAddress{Type:Hostname,Address:nodes-us-east4-a-v6tj,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a77ca3c48fb1245cde75a6429c818c0a,SystemUUID:a77ca3c4-8fb1-245c-de75-a6429c818c0a,BootID:65d4f8a4-acd4-4bf8-8839-6a047fad3abd,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.4],SizeBytes:63279305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:51155161,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 registry.k8s.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:7000509,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/disks/pvc-80019b4d-1982-4a98-b8b1-d28c5c76124e],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 7 16:59:24.770: INFO: Logging kubelet events for node nodes-us-east4-a-v6tj Dec 7 16:59:24.822: INFO: Logging pods the kubelet thinks is on node nodes-us-east4-a-v6tj Dec 7 16:59:24.878: INFO: kube-proxy-nodes-us-east4-a-v6tj started at 2022-12-07 16:49:37 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:24.878: INFO: Container kube-proxy ready: true, restart count 0 Dec 7 16:59:24.878: INFO: ss-2 started at 2022-12-07 16:59:14 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:24.878: INFO: Container webserver ready: false, restart count 0 Dec 7 16:59:24.878: INFO: calico-node-j442m started at 2022-12-07 16:49:37 +0000 UTC (3+1 container statuses recorded) Dec 7 16:59:24.878: INFO: Init container upgrade-ipam ready: true, restart count 0 Dec 7 16:59:24.878: INFO: Init container install-cni ready: true, restart count 0 Dec 7 16:59:24.878: INFO: Init container mount-bpffs ready: true, restart count 0 Dec 7 16:59:24.878: INFO: Container calico-node ready: true, restart count 0 Dec 7 16:59:24.878: INFO: hostexec-nodes-us-east4-a-v6tj-2r7ht started at 2022-12-07 16:59:23 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:24.878: INFO: Container agnhost-container ready: false, restart count 0 Dec 7 16:59:24.878: INFO: rs-5tlmg started at 2022-12-07 16:58:02 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:24.878: INFO: Container donothing ready: false, restart count 0 Dec 7 16:59:24.878: INFO: netserver-2 started at 2022-12-07 16:58:49 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:24.878: INFO: Container webserver ready: true, restart count 0 Dec 7 16:59:24.878: INFO: startup-2e8d2279-54e7-4fc7-9972-ae34c5441678 started at 2022-12-07 16:56:49 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:24.878: INFO: Container busybox ready: false, restart count 0 Dec 7 16:59:24.878: INFO: csi-gce-pd-node-n8bdx started at 2022-12-07 16:49:37 +0000 UTC (0+2 container statuses recorded) Dec 7 16:59:24.878: INFO: Container csi-driver-registrar ready: true, restart count 0 Dec 7 16:59:24.878: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 16:59:24.878: INFO: webserver-766c9598db-xtz2w started at 2022-12-07 16:59:11 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:24.878: INFO: Container httpd ready: true, restart count 0 Dec 7 16:59:24.878: INFO: test-webserver-a36ffc4e-c902-4377-a67d-79ee0a457752 started at 2022-12-07 16:58:12 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:24.878: INFO: Container test-webserver ready: true, restart count 0 Dec 7 16:59:24.878: INFO: dns-test-06368a01-e7af-4fa1-b7e5-678e01789d34 started at 2022-12-07 16:59:02 +0000 UTC (0+3 container statuses recorded) Dec 7 16:59:24.878: INFO: Container jessie-querier ready: true, restart count 0 Dec 7 16:59:24.878: INFO: Container querier ready: true, restart count 0 Dec 7 16:59:24.878: INFO: Container webserver ready: true, restart count 0 Dec 7 16:59:24.878: INFO: csi-hostpathplugin-0 started at 2022-12-07 16:58:36 +0000 UTC (0+7 container statuses recorded) Dec 7 16:59:24.878: INFO: Container csi-attacher ready: true, restart count 0 Dec 7 16:59:24.878: INFO: Container csi-provisioner ready: true, restart count 0 Dec 7 16:59:24.878: INFO: Container csi-resizer ready: true, restart count 0 Dec 7 16:59:24.878: INFO: Container csi-snapshotter ready: true, restart count 0 Dec 7 16:59:24.878: INFO: Container hostpath ready: true, restart count 0 Dec 7 16:59:24.878: INFO: Container liveness-probe ready: true, restart count 0 Dec 7 16:59:24.878: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 7 16:59:24.878: INFO: busybox-22533820-ef53-4013-8f4e-de8a6fe84848 started at 2022-12-07 16:56:56 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:24.878: INFO: Container busybox ready: true, restart count 0 Dec 7 16:59:24.878: INFO: netserver-2 started at 2022-12-07 16:59:07 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:24.878: INFO: Container webserver ready: false, restart count 0 Dec 7 16:59:24.878: INFO: webserver-766c9598db-qtmrr started at 2022-12-07 16:58:55 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:24.878: INFO: Container httpd ready: true, restart count 0 Dec 7 16:59:24.878: INFO: webserver-766c9598db-r2tkk started at 2022-12-07 16:58:56 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:24.878: INFO: Container httpd ready: true, restart count 0 Dec 7 16:59:24.878: INFO: hostexec-nodes-us-east4-a-v6tj-6jhhb started at 2022-12-07 16:59:11 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:24.878: INFO: Container agnhost-container ready: true, restart count 0 Dec 7 16:59:25.112: INFO: Latency metrics for node nodes-us-east4-a-v6tj Dec 7 16:59:25.112: INFO: Logging node info for node nodes-us-east4-a-zc10 Dec 7 16:59:25.146: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east4-a-zc10 c6cc41ef-a044-4188-9cdf-9af619e808de 22146 0 2022-12-07 16:49:31 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east4 failure-domain.beta.kubernetes.io/zone:us-east4-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east4-a-zc10 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east4-a topology.hostpath.csi/node:nodes-us-east4-a-zc10 topology.kubernetes.io/region:us-east4 topology.kubernetes.io/zone:us-east4-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/instances/nodes-us-east4-a-zc10"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.4/32 projectcalico.org/IPv4IPIPTunnelAddr:100.113.50.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-12-07 16:49:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:49:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2022-12-07 16:49:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:49:41 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:49:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {calico-node Update v1 2022-12-07 16:49:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2022-12-07 16:59:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:gce://gce-gci-upg-lat-1-3-ctl-skew/us-east4-a/nodes-us-east4-a-zc10,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111196160 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006338560 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-07 16:49:56 +0000 UTC,LastTransitionTime:2022-12-07 16:49:56 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-07 16:59:04 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-07 16:59:04 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-07 16:59:04 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-07 16:59:04 +0000 UTC,LastTransitionTime:2022-12-07 16:49:52 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.4,},NodeAddress{Type:ExternalIP,Address:35.188.253.28,},NodeAddress{Type:Hostname,Address:nodes-us-east4-a-zc10,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f5ea7883cc54b5706859a5f8fc4d24dd,SystemUUID:f5ea7883-cc54-b570-6859-a5f8fc4d24dd,BootID:6c425a3b-23de-41f0-9815-f6a0465861ce,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.4],SizeBytes:63279305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:51155161,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:7000509,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 7 16:59:25.146: INFO: Logging kubelet events for node nodes-us-east4-a-zc10 Dec 7 16:59:25.177: INFO: Logging pods the kubelet thinks is on node nodes-us-east4-a-zc10 Dec 7 16:59:25.233: INFO: host-test-container-pod started at 2022-12-07 16:59:20 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:25.233: INFO: Container agnhost-container ready: false, restart count 0 Dec 7 16:59:25.233: INFO: pod-terminate-status-0-3 started at 2022-12-07 16:59:21 +0000 UTC (1+1 container statuses recorded) Dec 7 16:59:25.233: INFO: Init container fail ready: false, restart count 0 Dec 7 16:59:25.233: INFO: Container blocked ready: false, restart count 0 Dec 7 16:59:25.233: INFO: test-container-pod started at 2022-12-07 16:59:20 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:25.233: INFO: Container webserver ready: false, restart count 0 Dec 7 16:59:25.233: INFO: test-pod-f91fccd5-bf5b-4043-a381-b579ff8465de started at <nil> (0+0 container statuses recorded) Dec 7 16:59:25.233: INFO: pod-terminate-status-2-3 started at 2022-12-07 16:59:20 +0000 UTC (1+1 container statuses recorded) Dec 7 16:59:25.233: INFO: Init container fail ready: false, restart count 0 Dec 7 16:59:25.233: INFO: Container blocked ready: false, restart count 0 Dec 7 16:59:25.233: INFO: webserver-766c9598db-fmcz5 started at 2022-12-07 16:59:01 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:25.233: INFO: Container httpd ready: true, restart count 0 Dec 7 16:59:25.233: INFO: netserver-3 started at 2022-12-07 16:59:07 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:25.233: INFO: Container webserver ready: false, restart count 0 Dec 7 16:59:25.233: INFO: kube-proxy-nodes-us-east4-a-zc10 started at 2022-12-07 16:49:35 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:25.233: INFO: Container kube-proxy ready: true, restart count 0 Dec 7 16:59:25.233: INFO: calico-node-g8zkr started at 2022-12-07 16:49:35 +0000 UTC (3+1 container statuses recorded) Dec 7 16:59:25.233: INFO: Init container upgrade-ipam ready: true, restart count 0 Dec 7 16:59:25.233: INFO: Init container install-cni ready: true, restart count 0 Dec 7 16:59:25.233: INFO: Init container mount-bpffs ready: true, restart count 0 Dec 7 16:59:25.233: INFO: Container calico-node ready: true, restart count 0 Dec 7 16:59:25.233: INFO: pod-terminate-status-1-3 started at 2022-12-07 16:59:21 +0000 UTC (1+1 container statuses recorded) Dec 7 16:59:25.233: INFO: Init container fail ready: false, restart count 0 Dec 7 16:59:25.233: INFO: Container blocked ready: false, restart count 0 Dec 7 16:59:25.233: INFO: annotationupdate6d4bb5d1-2797-48f6-81e3-e72978aaeffd started at 2022-12-07 16:59:21 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:25.233: INFO: Container client-container ready: false, restart count 0 Dec 7 16:59:25.233: INFO: webserver-766c9598db-bv9q6 started at 2022-12-07 16:59:06 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:25.233: INFO: Container httpd ready: true, restart count 0 Dec 7 16:59:25.233: INFO: privileged-pod started at 2022-12-07 16:58:33 +0000 UTC (0+2 container statuses recorded) Dec 7 16:59:25.233: INFO: Container not-privileged-container ready: true, restart count 0 Dec 7 16:59:25.233: INFO: Container privileged-container ready: true, restart count 0 Dec 7 16:59:25.233: INFO: netserver-3 started at 2022-12-07 16:58:49 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:25.233: INFO: Container webserver ready: true, restart count 0 Dec 7 16:59:25.233: INFO: csi-gce-pd-node-vtqz7 started at 2022-12-07 16:49:35 +0000 UTC (0+2 container statuses recorded) Dec 7 16:59:25.233: INFO: Container csi-driver-registrar ready: true, restart count 0 Dec 7 16:59:25.233: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 16:59:25.233: INFO: coredns-677fff9cfb-4b88c started at 2022-12-07 16:50:04 +0000 UTC (0+1 container statuses recorded) Dec 7 16:59:25.233: INFO: Container coredns ready: true, restart count 0 Dec 7 16:59:25.506: INFO: Latency metrics for node nodes-us-east4-a-zc10 Dec 7 16:59:25.506: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP:�[0m Destroying namespace "aggregator-1412" for this suite. �[38;5;243m12/07/22 16:59:25.549�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-apps\]\sReplicaSet\sshould\sserve\sa\sbasic\simage\son\seach\sreplica\swith\sa\sprivate\simage$'
test/e2e/apps/replica_set.go:119 k8s.io/kubernetes/test/e2e/apps.glob..func9.2() test/e2e/apps/replica_set.go:119 +0x190from junit_01.xml
{"msg":"FAILED [sig-apps] ReplicaSet should serve a basic image on each replica with a private image","completed":38,"skipped":333,"failed":1,"failures":["[sig-apps] ReplicaSet should serve a basic image on each replica with a private image"]} [BeforeEach] [sig-apps] ReplicaSet test/e2e/framework/framework.go:186 �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m12/07/22 17:07:37.587�[0m Dec 7 17:07:37.587: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP:�[0m Building a namespace api object, basename replicaset �[38;5;243m12/07/22 17:07:37.589�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m12/07/22 17:07:37.713�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m12/07/22 17:07:37.783�[0m [It] should serve a basic image on each replica with a private image test/e2e/apps/replica_set.go:115 Dec 7 17:07:37.865: INFO: Creating ReplicaSet my-hostname-private-9e75431e-621c-4eb3-8da2-e3518e05bc2a Dec 7 17:07:37.988: INFO: Pod name my-hostname-private-9e75431e-621c-4eb3-8da2-e3518e05bc2a: Found 1 pods out of 1 Dec 7 17:07:37.988: INFO: Ensuring a pod for ReplicaSet "my-hostname-private-9e75431e-621c-4eb3-8da2-e3518e05bc2a" is running Dec 7 17:07:37.988: INFO: Waiting up to 5m0s for pod "my-hostname-private-9e75431e-621c-4eb3-8da2-e3518e05bc2a-gmw8c" in namespace "replicaset-8443" to be "running" Dec 7 17:07:38.085: INFO: Pod "my-hostname-private-9e75431e-621c-4eb3-8da2-e3518e05bc2a-gmw8c": Phase="Pending", Reason="", readiness=false. Elapsed: 97.03619ms Dec 7 17:07:40.118: INFO: Pod "my-hostname-private-9e75431e-621c-4eb3-8da2-e3518e05bc2a-gmw8c": Phase="Pending", Reason="", readiness=false. Elapsed: 2.130817795s Dec 7 17:07:42.113: INFO: Pod "my-hostname-private-9e75431e-621c-4eb3-8da2-e3518e05bc2a-gmw8c": Phase="Pending", Reason="", readiness=false. Elapsed: 4.125834699s Dec 7 17:07:44.114: INFO: Pod "my-hostname-private-9e75431e-621c-4eb3-8da2-e3518e05bc2a-gmw8c": Phase="Running", Reason="", readiness=true. Elapsed: 6.125991559s Dec 7 17:07:44.114: INFO: Pod "my-hostname-private-9e75431e-621c-4eb3-8da2-e3518e05bc2a-gmw8c" satisfied condition "running" Dec 7 17:07:44.114: INFO: Pod "my-hostname-private-9e75431e-621c-4eb3-8da2-e3518e05bc2a-gmw8c" is running (conditions: []) Dec 7 17:07:44.114: INFO: Trying to dial the pod Dec 7 17:08:19.380: INFO: Controller my-hostname-private-9e75431e-621c-4eb3-8da2-e3518e05bc2a: Failed to GET from replica 1 [my-hostname-private-9e75431e-621c-4eb3-8da2-e3518e05bc2a-gmw8c]: the server is currently unable to handle the request (get pods my-hostname-private-9e75431e-621c-4eb3-8da2-e3518e05bc2a-gmw8c) pod status: v1.PodStatus{Phase:"Pending", Conditions:[]v1.PodCondition(nil), Message:"", Reason:"", NominatedNodeName:"", HostIP:"", PodIP:"", PodIPs:[]v1.PodIP(nil), StartTime:<nil>, InitContainerStatuses:[]v1.ContainerStatus(nil), ContainerStatuses:[]v1.ContainerStatus(nil), QOSClass:"BestEffort", EphemeralContainerStatuses:[]v1.ContainerStatus(nil)} Dec 7 17:08:54.201: INFO: Controller my-hostname-private-9e75431e-621c-4eb3-8da2-e3518e05bc2a: Failed to GET from replica 1 [my-hostname-private-9e75431e-621c-4eb3-8da2-e3518e05bc2a-gmw8c]: the server is currently unable to handle the request (get pods my-hostname-private-9e75431e-621c-4eb3-8da2-e3518e05bc2a-gmw8c) pod status: v1.PodStatus{Phase:"Pending", Conditions:[]v1.PodCondition(nil), Message:"", Reason:"", NominatedNodeName:"", HostIP:"", PodIP:"", PodIPs:[]v1.PodIP(nil), StartTime:<nil>, InitContainerStatuses:[]v1.ContainerStatus(nil), ContainerStatuses:[]v1.ContainerStatus(nil), QOSClass:"BestEffort", EphemeralContainerStatuses:[]v1.ContainerStatus(nil)} Dec 7 17:09:29.200: INFO: Controller my-hostname-private-9e75431e-621c-4eb3-8da2-e3518e05bc2a: Failed to GET from replica 1 [my-hostname-private-9e75431e-621c-4eb3-8da2-e3518e05bc2a-gmw8c]: the server is currently unable to handle the request (get pods my-hostname-private-9e75431e-621c-4eb3-8da2-e3518e05bc2a-gmw8c) pod status: v1.PodStatus{Phase:"Pending", Conditions:[]v1.PodCondition(nil), Message:"", Reason:"", NominatedNodeName:"", HostIP:"", PodIP:"", PodIPs:[]v1.PodIP(nil), StartTime:<nil>, InitContainerStatuses:[]v1.ContainerStatus(nil), ContainerStatuses:[]v1.ContainerStatus(nil), QOSClass:"BestEffort", EphemeralContainerStatuses:[]v1.ContainerStatus(nil)} Dec 7 17:10:04.211: INFO: Controller my-hostname-private-9e75431e-621c-4eb3-8da2-e3518e05bc2a: Failed to GET from replica 1 [my-hostname-private-9e75431e-621c-4eb3-8da2-e3518e05bc2a-gmw8c]: the server is currently unable to handle the request (get pods my-hostname-private-9e75431e-621c-4eb3-8da2-e3518e05bc2a-gmw8c) pod status: v1.PodStatus{Phase:"Pending", Conditions:[]v1.PodCondition(nil), Message:"", Reason:"", NominatedNodeName:"", HostIP:"", PodIP:"", PodIPs:[]v1.PodIP(nil), StartTime:<nil>, InitContainerStatuses:[]v1.ContainerStatus(nil), ContainerStatuses:[]v1.ContainerStatus(nil), QOSClass:"BestEffort", EphemeralContainerStatuses:[]v1.ContainerStatus(nil)} Dec 7 17:10:34.315: INFO: Controller my-hostname-private-9e75431e-621c-4eb3-8da2-e3518e05bc2a: Failed to GET from replica 1 [my-hostname-private-9e75431e-621c-4eb3-8da2-e3518e05bc2a-gmw8c]: the server is currently unable to handle the request (get pods my-hostname-private-9e75431e-621c-4eb3-8da2-e3518e05bc2a-gmw8c) pod status: v1.PodStatus{Phase:"Pending", Conditions:[]v1.PodCondition(nil), Message:"", Reason:"", NominatedNodeName:"", HostIP:"", PodIP:"", PodIPs:[]v1.PodIP(nil), StartTime:<nil>, InitContainerStatuses:[]v1.ContainerStatus(nil), ContainerStatuses:[]v1.ContainerStatus(nil), QOSClass:"BestEffort", EphemeralContainerStatuses:[]v1.ContainerStatus(nil)} Dec 7 17:10:34.315: FAIL: Did not get expected responses within the timeout period of 120.00 seconds. Full Stack Trace k8s.io/kubernetes/test/e2e/apps.glob..func9.2() test/e2e/apps/replica_set.go:119 +0x190 [AfterEach] [sig-apps] ReplicaSet test/e2e/framework/framework.go:187 �[1mSTEP:�[0m Collecting events from namespace "replicaset-8443". �[38;5;243m12/07/22 17:10:34.316�[0m �[1mSTEP:�[0m Found 7 events. �[38;5;243m12/07/22 17:10:34.344�[0m Dec 7 17:10:34.344: INFO: At 2022-12-07 17:07:37 +0000 UTC - event for my-hostname-private-9e75431e-621c-4eb3-8da2-e3518e05bc2a: {replicaset-controller } SuccessfulCreate: Created pod: my-hostname-private-9e75431e-621c-4eb3-8da2-e3518e05bc2a-gmw8c Dec 7 17:10:34.344: INFO: At 2022-12-07 17:07:38 +0000 UTC - event for my-hostname-private-9e75431e-621c-4eb3-8da2-e3518e05bc2a-gmw8c: {default-scheduler } Scheduled: Successfully assigned replicaset-8443/my-hostname-private-9e75431e-621c-4eb3-8da2-e3518e05bc2a-gmw8c to nodes-us-east4-a-nfxp Dec 7 17:10:34.344: INFO: At 2022-12-07 17:07:39 +0000 UTC - event for my-hostname-private-9e75431e-621c-4eb3-8da2-e3518e05bc2a-gmw8c: {kubelet nodes-us-east4-a-nfxp} FailedMount: MountVolume.SetUp failed for volume "kube-api-access-x5xzw" : failed to sync configmap cache: timed out waiting for the condition Dec 7 17:10:34.344: INFO: At 2022-12-07 17:07:40 +0000 UTC - event for my-hostname-private-9e75431e-621c-4eb3-8da2-e3518e05bc2a-gmw8c: {kubelet nodes-us-east4-a-nfxp} Pulling: Pulling image "gcr.io/k8s-authenticated-test/agnhost:2.6" Dec 7 17:10:34.344: INFO: At 2022-12-07 17:07:42 +0000 UTC - event for my-hostname-private-9e75431e-621c-4eb3-8da2-e3518e05bc2a-gmw8c: {kubelet nodes-us-east4-a-nfxp} Pulled: Successfully pulled image "gcr.io/k8s-authenticated-test/agnhost:2.6" in 2.447970207s Dec 7 17:10:34.344: INFO: At 2022-12-07 17:07:42 +0000 UTC - event for my-hostname-private-9e75431e-621c-4eb3-8da2-e3518e05bc2a-gmw8c: {kubelet nodes-us-east4-a-nfxp} Created: Created container my-hostname-private-9e75431e-621c-4eb3-8da2-e3518e05bc2a Dec 7 17:10:34.344: INFO: At 2022-12-07 17:07:42 +0000 UTC - event for my-hostname-private-9e75431e-621c-4eb3-8da2-e3518e05bc2a-gmw8c: {kubelet nodes-us-east4-a-nfxp} Started: Started container my-hostname-private-9e75431e-621c-4eb3-8da2-e3518e05bc2a Dec 7 17:10:34.371: INFO: POD NODE PHASE GRACE CONDITIONS Dec 7 17:10:34.371: INFO: my-hostname-private-9e75431e-621c-4eb3-8da2-e3518e05bc2a-gmw8c nodes-us-east4-a-nfxp Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-07 17:07:37 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-12-07 17:07:43 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-07 17:07:43 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-07 17:07:37 +0000 UTC }] Dec 7 17:10:34.371: INFO: Dec 7 17:10:34.432: INFO: Logging node info for node control-plane-us-east4-a-vd91 Dec 7 17:10:34.464: INFO: Node Info: &Node{ObjectMeta:{control-plane-us-east4-a-vd91 74d54d8e-e0bc-4c7d-bf3c-5b66ce025930 51325 0 2022-12-07 16:47:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-standard-2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east4 failure-domain.beta.kubernetes.io/zone:us-east4-a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:control-plane-us-east4-a-vd91 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node-role.kubernetes.io/node: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:e2-standard-2 topology.gke.io/zone:us-east4-a topology.kubernetes.io/region:us-east4 topology.kubernetes.io/zone:us-east4-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/instances/control-plane-us-east4-a-vd91"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.5/32 projectcalico.org/IPv4IPIPTunnelAddr:100.101.18.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-12-07 16:47:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2022-12-07 16:48:18 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {calico-node Update v1 2022-12-07 16:48:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}}}}} status} {cloud-controller-manager Update v1 2022-12-07 16:48:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2022-12-07 16:48:34 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:48:39 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:48:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-12-07 17:09:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:gce://gce-gci-upg-lat-1-3-ctl-skew/us-east4-a/control-plane-us-east4-a-vd91,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8332767232 0} {<nil>} 8137468Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8227909632 0} {<nil>} 8035068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-07 16:48:39 +0000 UTC,LastTransitionTime:2022-12-07 16:48:39 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-07 17:09:22 +0000 UTC,LastTransitionTime:2022-12-07 16:47:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-07 17:09:22 +0000 UTC,LastTransitionTime:2022-12-07 16:47:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-07 17:09:22 +0000 UTC,LastTransitionTime:2022-12-07 16:47:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-07 17:09:22 +0000 UTC,LastTransitionTime:2022-12-07 16:48:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.5,},NodeAddress{Type:ExternalIP,Address:35.245.23.229,},NodeAddress{Type:Hostname,Address:control-plane-us-east4-a-vd91,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e32750d839dd77bbe79d8a1be267141a,SystemUUID:e32750d8-39dd-77bb-e79d-8a1be267141a,BootID:572b6367-72b8-4ea4-b559-5c84c54662ce,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gcr.io/k8s-staging-etcdadm/etcd-manager@sha256:f3a63853502cb3956fa708fea524be3b333036ebc1cd1dadd81abd9f1fe61043 gcr.io/k8s-staging-etcdadm/etcd-manager:v3.0.20220831-21-g12041b4c],SizeBytes:231516108,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.25.4],SizeBytes:129085904,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.25.4],SizeBytes:118436153,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.4],SizeBytes:63279305,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.25.4],SizeBytes:51921208,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-alpha.2],SizeBytes:42203406,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-alpha.2],SizeBytes:41463710,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:2b6acd7f677f76ffe12ecf3ea7df92eb9b1bdb07336d1ac2a54c7631fb753f7e docker.io/calico/kube-controllers:v3.24.5],SizeBytes:31137169,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2 registry.k8s.io/sig-storage/csi-provisioner:v2.1.0],SizeBytes:21205045,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:50c3cfd458fc8e0bf3c8c521eac39172009382fc66dc5044a330d137c6ed0b09 registry.k8s.io/sig-storage/csi-attacher:v3.1.0],SizeBytes:20103959,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a registry.k8s.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:9af9bf28430b00a0cedeb2ec29acadce45e6afcecd8bdf31c793c624cfa75fa7 registry.k8s.io/sig-storage/csi-snapshotter:v3.0.3],SizeBytes:19500777,},ContainerImage{Names:[docker.io/k8scloudprovidergcp/cloud-controller-manager@sha256:881fd1095937638040723973ade90e6700f1c831a78fb585a3227c4d021b0df9 docker.io/k8scloudprovidergcp/cloud-controller-manager:latest],SizeBytes:18702875,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-alpha.2],SizeBytes:4954573,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 7 17:10:34.465: INFO: Logging kubelet events for node control-plane-us-east4-a-vd91 Dec 7 17:10:34.498: INFO: Logging pods the kubelet thinks is on node control-plane-us-east4-a-vd91 Dec 7 17:10:34.537: INFO: etcd-manager-events-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:34.537: INFO: Container etcd-manager ready: true, restart count 0 Dec 7 17:10:34.537: INFO: kube-controller-manager-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:34.537: INFO: Container kube-controller-manager ready: true, restart count 2 Dec 7 17:10:34.537: INFO: dns-controller-8946976bb-6t8hj started at 2022-12-07 16:48:19 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:34.537: INFO: Container dns-controller ready: true, restart count 0 Dec 7 17:10:34.537: INFO: kube-proxy-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:34.537: INFO: Container kube-proxy ready: true, restart count 0 Dec 7 17:10:34.537: INFO: csi-gce-pd-node-z9fsn started at 2022-12-07 16:48:06 +0000 UTC (0+2 container statuses recorded) Dec 7 17:10:34.537: INFO: Container csi-driver-registrar ready: true, restart count 0 Dec 7 17:10:34.537: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 17:10:34.537: INFO: kops-controller-mnn6f started at 2022-12-07 16:48:18 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:34.537: INFO: Container kops-controller ready: true, restart count 0 Dec 7 17:10:34.537: INFO: cloud-controller-manager-xd6xh started at 2022-12-07 16:48:18 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:34.537: INFO: Container cloud-controller-manager ready: true, restart count 0 Dec 7 17:10:34.537: INFO: calico-node-zgvgx started at 2022-12-07 16:48:06 +0000 UTC (3+1 container statuses recorded) Dec 7 17:10:34.537: INFO: Init container upgrade-ipam ready: true, restart count 0 Dec 7 17:10:34.537: INFO: Init container install-cni ready: true, restart count 0 Dec 7 17:10:34.537: INFO: Init container mount-bpffs ready: true, restart count 0 Dec 7 17:10:34.537: INFO: Container calico-node ready: true, restart count 0 Dec 7 17:10:34.537: INFO: calico-kube-controllers-7bc879d8d6-t4vrx started at 2022-12-07 16:48:39 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:34.537: INFO: Container calico-kube-controllers ready: true, restart count 0 Dec 7 17:10:34.537: INFO: kube-scheduler-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:34.537: INFO: Container kube-scheduler ready: true, restart count 0 Dec 7 17:10:34.537: INFO: etcd-manager-main-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:34.537: INFO: Container etcd-manager ready: true, restart count 0 Dec 7 17:10:34.537: INFO: kube-apiserver-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+2 container statuses recorded) Dec 7 17:10:34.537: INFO: Container healthcheck ready: true, restart count 0 Dec 7 17:10:34.537: INFO: Container kube-apiserver ready: true, restart count 1 Dec 7 17:10:34.537: INFO: csi-gce-pd-controller-689c9f4444-b5qql started at 2022-12-07 16:48:18 +0000 UTC (0+5 container statuses recorded) Dec 7 17:10:34.537: INFO: Container csi-attacher ready: true, restart count 0 Dec 7 17:10:34.537: INFO: Container csi-provisioner ready: true, restart count 0 Dec 7 17:10:34.537: INFO: Container csi-resizer ready: true, restart count 0 Dec 7 17:10:34.537: INFO: Container csi-snapshotter ready: true, restart count 0 Dec 7 17:10:34.537: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 17:10:34.686: INFO: Latency metrics for node control-plane-us-east4-a-vd91 Dec 7 17:10:34.686: INFO: Logging node info for node nodes-us-east4-a-5680 Dec 7 17:10:34.713: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east4-a-5680 b9473b45-598f-43c3-aafc-dc872ade1274 53275 0 2022-12-07 16:49:31 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east4 failure-domain.beta.kubernetes.io/zone:us-east4-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east4-a-5680 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east4-a topology.hostpath.csi/node:nodes-us-east4-a-5680 topology.kubernetes.io/region:us-east4 topology.kubernetes.io/zone:us-east4-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/instances/nodes-us-east4-a-5680"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.3/32 projectcalico.org/IPv4IPIPTunnelAddr:100.119.115.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2022-12-07 16:49:31 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2022-12-07 16:49:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2022-12-07 16:49:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:49:41 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:49:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {calico-node Update v1 2022-12-07 16:49:59 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2022-12-07 17:10:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:gce://gce-gci-upg-lat-1-3-ctl-skew/us-east4-a/nodes-us-east4-a-5680,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-07 16:49:58 +0000 UTC,LastTransitionTime:2022-12-07 16:49:58 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-07 17:09:58 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-07 17:09:58 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-07 17:09:58 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-07 17:09:58 +0000 UTC,LastTransitionTime:2022-12-07 16:49:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.3,},NodeAddress{Type:ExternalIP,Address:34.86.83.231,},NodeAddress{Type:Hostname,Address:nodes-us-east4-a-5680,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:5676434e0327952eef9a8130969e32db,SystemUUID:5676434e-0327-952e-ef9a-8130969e32db,BootID:f4cd280b-a7ea-43c2-b78f-d43fab064010,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.4],SizeBytes:63279305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:51155161,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 registry.k8s.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 7 17:10:34.713: INFO: Logging kubelet events for node nodes-us-east4-a-5680 Dec 7 17:10:34.744: INFO: Logging pods the kubelet thinks is on node nodes-us-east4-a-5680 Dec 7 17:10:34.778: INFO: deployment-749564ff97-jxzk2 started at 2022-12-07 17:09:41 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:34.778: INFO: Container nginx ready: false, restart count 0 Dec 7 17:10:34.778: INFO: inline-volume-qdfzg started at 2022-12-07 17:08:47 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:34.778: INFO: Container volume-tester ready: false, restart count 0 Dec 7 17:10:34.778: INFO: calico-node-wvpd9 started at 2022-12-07 16:49:34 +0000 UTC (3+1 container statuses recorded) Dec 7 17:10:34.778: INFO: Init container upgrade-ipam ready: true, restart count 0 Dec 7 17:10:34.778: INFO: Init container install-cni ready: true, restart count 0 Dec 7 17:10:34.778: INFO: Init container mount-bpffs ready: true, restart count 0 Dec 7 17:10:34.778: INFO: Container calico-node ready: true, restart count 0 Dec 7 17:10:34.778: INFO: kube-proxy-nodes-us-east4-a-5680 started at 2022-12-07 16:49:34 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:34.778: INFO: Container kube-proxy ready: true, restart count 0 Dec 7 17:10:34.778: INFO: csi-gce-pd-node-9n22s started at 2022-12-07 16:49:34 +0000 UTC (0+2 container statuses recorded) Dec 7 17:10:34.778: INFO: Container csi-driver-registrar ready: true, restart count 0 Dec 7 17:10:34.778: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 17:10:34.945: INFO: Latency metrics for node nodes-us-east4-a-5680 Dec 7 17:10:34.945: INFO: Logging node info for node nodes-us-east4-a-nfxp Dec 7 17:10:34.976: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east4-a-nfxp 958029bf-d66a-424c-a80d-b1d485df133b 49893 0 2022-12-07 16:49:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east4 failure-domain.beta.kubernetes.io/zone:us-east4-a io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east4-a-nfxp kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east4-a topology.hostpath.csi/node:nodes-us-east4-a-nfxp topology.kubernetes.io/region:us-east4 topology.kubernetes.io/zone:us-east4-a] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-206":"nodes-us-east4-a-nfxp","pd.csi.storage.gke.io":"projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/instances/nodes-us-east4-a-nfxp"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.6/32 projectcalico.org/IPv4IPIPTunnelAddr:100.113.109.192 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2022-12-07 16:49:28 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2022-12-07 16:49:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2022-12-07 16:49:29 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:49:41 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:49:48 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {calico-node Update v1 2022-12-07 16:49:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2022-12-07 17:08:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:gce://gce-gci-upg-lat-1-3-ctl-skew/us-east4-a/nodes-us-east4-a-nfxp,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-07 16:49:53 +0000 UTC,LastTransitionTime:2022-12-07 16:49:53 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-07 17:08:34 +0000 UTC,LastTransitionTime:2022-12-07 16:49:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-07 17:08:34 +0000 UTC,LastTransitionTime:2022-12-07 16:49:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-07 17:08:34 +0000 UTC,LastTransitionTime:2022-12-07 16:49:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-07 17:08:34 +0000 UTC,LastTransitionTime:2022-12-07 16:49:48 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.6,},NodeAddress{Type:ExternalIP,Address:34.145.242.1,},NodeAddress{Type:Hostname,Address:nodes-us-east4-a-nfxp,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:796e3b73d867da488abd70a5df2fe10f,SystemUUID:796e3b73-d867-da48-8abd-70a5df2fe10f,BootID:2b784aad-5897-4bb4-bb49-6bae545d9488,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:b83c1d70989e1fe87583607bf5aee1ee34e52773d4755b95f5cf5a451962f3a4 registry.k8s.io/etcd:3.5.5-0],SizeBytes:102417044,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.4],SizeBytes:63279305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:51155161,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:f9c93b92b6ff750b41a93c4e4fe0bfe384597aeb841e2539d5444815c55b2d8f registry.k8s.io/e2e-test-images/sample-apiserver:1.17.5],SizeBytes:24316368,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:aa60f453d64dfb3c3fd9e7306f988c36c6352c4f2d956aa90467f2808091effa registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.5],SizeBytes:15209420,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:38e6b091d238094f081efad3e2b362e6480b2156f5f4fba6ea46835ecdcd47e2 registry.k8s.io/build-image/distroless-iptables:v0.1.1],SizeBytes:7634231,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:7000509,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 7 17:10:34.976: INFO: Logging kubelet events for node nodes-us-east4-a-nfxp Dec 7 17:10:35.008: INFO: Logging pods the kubelet thinks is on node nodes-us-east4-a-nfxp Dec 7 17:10:35.049: INFO: coredns-autoscaler-db7b97744-2cf6q started at 2022-12-07 16:49:48 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:35.049: INFO: Container autoscaler ready: true, restart count 0 Dec 7 17:10:35.049: INFO: csi-mockplugin-attacher-0 started at 2022-12-07 17:08:39 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:35.049: INFO: Container csi-attacher ready: true, restart count 0 Dec 7 17:10:35.049: INFO: agnhost started at 2022-12-07 17:04:12 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:35.049: INFO: Container agnhost ready: true, restart count 0 Dec 7 17:10:35.049: INFO: webserver-pod started at 2022-12-07 17:06:48 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:35.049: INFO: Container agnhost ready: false, restart count 0 Dec 7 17:10:35.049: INFO: kube-proxy-nodes-us-east4-a-nfxp started at 2022-12-07 16:49:29 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:35.049: INFO: Container kube-proxy ready: true, restart count 0 Dec 7 17:10:35.049: INFO: my-hostname-private-9e75431e-621c-4eb3-8da2-e3518e05bc2a-gmw8c started at 2022-12-07 17:07:37 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:35.049: INFO: Container my-hostname-private-9e75431e-621c-4eb3-8da2-e3518e05bc2a ready: true, restart count 0 Dec 7 17:10:35.050: INFO: csi-gce-pd-node-vcz5x started at 2022-12-07 16:49:29 +0000 UTC (0+2 container statuses recorded) Dec 7 17:10:35.050: INFO: Container csi-driver-registrar ready: true, restart count 0 Dec 7 17:10:35.050: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 17:10:35.050: INFO: calico-node-f2cxs started at 2022-12-07 16:49:29 +0000 UTC (3+1 container statuses recorded) Dec 7 17:10:35.050: INFO: Init container upgrade-ipam ready: true, restart count 0 Dec 7 17:10:35.050: INFO: Init container install-cni ready: true, restart count 0 Dec 7 17:10:35.050: INFO: Init container mount-bpffs ready: true, restart count 0 Dec 7 17:10:35.050: INFO: Container calico-node ready: true, restart count 0 Dec 7 17:10:35.050: INFO: dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4 started at 2022-12-07 16:53:00 +0000 UTC (0+3 container statuses recorded) Dec 7 17:10:35.050: INFO: Container jessie-querier ready: true, restart count 1 Dec 7 17:10:35.050: INFO: Container querier ready: true, restart count 1 Dec 7 17:10:35.050: INFO: Container webserver ready: true, restart count 0 Dec 7 17:10:35.050: INFO: csi-mockplugin-0 started at 2022-12-07 17:08:39 +0000 UTC (0+3 container statuses recorded) Dec 7 17:10:35.050: INFO: Container csi-provisioner ready: true, restart count 0 Dec 7 17:10:35.050: INFO: Container driver-registrar ready: true, restart count 0 Dec 7 17:10:35.050: INFO: Container mock ready: true, restart count 0 Dec 7 17:10:35.050: INFO: pvc-volume-tester-4qt5z started at 2022-12-07 17:08:44 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:35.050: INFO: Container volume-tester ready: true, restart count 0 Dec 7 17:10:35.050: INFO: coredns-677fff9cfb-rv6b9 started at 2022-12-07 16:49:48 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:35.050: INFO: Container coredns ready: true, restart count 0 Dec 7 17:10:35.233: INFO: Latency metrics for node nodes-us-east4-a-nfxp Dec 7 17:10:35.233: INFO: Logging node info for node nodes-us-east4-a-v6tj Dec 7 17:10:35.261: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east4-a-v6tj 7ccb4554-dd50-4efe-9be3-d3667475ec25 53459 0 2022-12-07 16:49:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east4 failure-domain.beta.kubernetes.io/zone:us-east4-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east4-a-v6tj kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east4-a topology.hostpath.csi/node:nodes-us-east4-a-v6tj topology.kubernetes.io/region:us-east4 topology.kubernetes.io/zone:us-east4-a] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-1803":"nodes-us-east4-a-v6tj","pd.csi.storage.gke.io":"projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/instances/nodes-us-east4-a-v6tj"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.2/32 projectcalico.org/IPv4IPIPTunnelAddr:100.123.60.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2022-12-07 16:49:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2022-12-07 16:49:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2022-12-07 16:49:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:49:49 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:49:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {calico-node Update v1 2022-12-07 16:50:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2022-12-07 17:10:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:gce://gce-gci-upg-lat-1-3-ctl-skew/us-east4-a/nodes-us-east4-a-v6tj,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111196160 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006338560 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-07 16:49:59 +0000 UTC,LastTransitionTime:2022-12-07 16:49:59 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-07 17:10:04 +0000 UTC,LastTransitionTime:2022-12-07 16:49:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-07 17:10:04 +0000 UTC,LastTransitionTime:2022-12-07 16:49:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-07 17:10:04 +0000 UTC,LastTransitionTime:2022-12-07 16:49:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-07 17:10:04 +0000 UTC,LastTransitionTime:2022-12-07 16:49:55 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.2,},NodeAddress{Type:ExternalIP,Address:35.245.137.186,},NodeAddress{Type:Hostname,Address:nodes-us-east4-a-v6tj,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a77ca3c48fb1245cde75a6429c818c0a,SystemUUID:a77ca3c4-8fb1-245c-de75-a6429c818c0a,BootID:65d4f8a4-acd4-4bf8-8839-6a047fad3abd,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:b83c1d70989e1fe87583607bf5aee1ee34e52773d4755b95f5cf5a451962f3a4 registry.k8s.io/etcd:3.5.5-0],SizeBytes:102417044,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.4],SizeBytes:63279305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:51155161,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 registry.k8s.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:7000509,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 7 17:10:35.262: INFO: Logging kubelet events for node nodes-us-east4-a-v6tj Dec 7 17:10:35.294: INFO: Logging pods the kubelet thinks is on node nodes-us-east4-a-v6tj Dec 7 17:10:35.331: INFO: calico-node-j442m started at 2022-12-07 16:49:37 +0000 UTC (3+1 container statuses recorded) Dec 7 17:10:35.331: INFO: Init container upgrade-ipam ready: true, restart count 0 Dec 7 17:10:35.331: INFO: Init container install-cni ready: true, restart count 0 Dec 7 17:10:35.331: INFO: Init container mount-bpffs ready: true, restart count 0 Dec 7 17:10:35.331: INFO: Container calico-node ready: true, restart count 0 Dec 7 17:10:35.331: INFO: csi-hostpathplugin-0 started at 2022-12-07 17:10:02 +0000 UTC (0+7 container statuses recorded) Dec 7 17:10:35.331: INFO: Container csi-attacher ready: true, restart count 0 Dec 7 17:10:35.331: INFO: Container csi-provisioner ready: true, restart count 0 Dec 7 17:10:35.331: INFO: Container csi-resizer ready: true, restart count 0 Dec 7 17:10:35.331: INFO: Container csi-snapshotter ready: true, restart count 0 Dec 7 17:10:35.331: INFO: Container hostpath ready: true, restart count 0 Dec 7 17:10:35.331: INFO: Container liveness-probe ready: true, restart count 0 Dec 7 17:10:35.331: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 7 17:10:35.331: INFO: deployment-97c6466db-8j54p started at 2022-12-07 17:09:41 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:35.331: INFO: Container nginx ready: false, restart count 0 Dec 7 17:10:35.331: INFO: csi-gce-pd-node-n8bdx started at 2022-12-07 16:49:37 +0000 UTC (0+2 container statuses recorded) Dec 7 17:10:35.331: INFO: Container csi-driver-registrar ready: true, restart count 0 Dec 7 17:10:35.331: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 17:10:35.331: INFO: webserver-pod started at 2022-12-07 17:05:48 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:35.331: INFO: Container agnhost ready: false, restart count 0 Dec 7 17:10:35.331: INFO: deployment-749564ff97-hqtsk started at 2022-12-07 17:09:41 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:35.331: INFO: Container nginx ready: false, restart count 0 Dec 7 17:10:35.331: INFO: inline-volume-tester-kkxcz started at 2022-12-07 17:10:02 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:35.331: INFO: Container csi-volume-tester ready: true, restart count 0 Dec 7 17:10:35.331: INFO: kube-proxy-nodes-us-east4-a-v6tj started at 2022-12-07 16:49:37 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:35.331: INFO: Container kube-proxy ready: true, restart count 0 Dec 7 17:10:35.532: INFO: Latency metrics for node nodes-us-east4-a-v6tj Dec 7 17:10:35.532: INFO: Logging node info for node nodes-us-east4-a-zc10 Dec 7 17:10:35.561: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east4-a-zc10 c6cc41ef-a044-4188-9cdf-9af619e808de 52063 0 2022-12-07 16:49:31 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east4 failure-domain.beta.kubernetes.io/zone:us-east4-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east4-a-zc10 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east4-a topology.hostpath.csi/node:nodes-us-east4-a-zc10 topology.kubernetes.io/region:us-east4 topology.kubernetes.io/zone:us-east4-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/instances/nodes-us-east4-a-zc10"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.4/32 projectcalico.org/IPv4IPIPTunnelAddr:100.113.50.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-12-07 16:49:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:49:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2022-12-07 16:49:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:49:41 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:49:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {calico-node Update v1 2022-12-07 16:49:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2022-12-07 17:09:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:gce://gce-gci-upg-lat-1-3-ctl-skew/us-east4-a/nodes-us-east4-a-zc10,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111196160 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006338560 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-07 16:49:56 +0000 UTC,LastTransitionTime:2022-12-07 16:49:56 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-07 17:09:28 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-07 17:09:28 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-07 17:09:28 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-07 17:09:28 +0000 UTC,LastTransitionTime:2022-12-07 16:49:52 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.4,},NodeAddress{Type:ExternalIP,Address:35.188.253.28,},NodeAddress{Type:Hostname,Address:nodes-us-east4-a-zc10,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f5ea7883cc54b5706859a5f8fc4d24dd,SystemUUID:f5ea7883-cc54-b570-6859-a5f8fc4d24dd,BootID:6c425a3b-23de-41f0-9815-f6a0465861ce,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.4],SizeBytes:63279305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:51155161,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:7000509,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 7 17:10:35.561: INFO: Logging kubelet events for node nodes-us-east4-a-zc10 Dec 7 17:10:35.594: INFO: Logging pods the kubelet thinks is on node nodes-us-east4-a-zc10 Dec 7 17:10:35.634: INFO: kube-proxy-nodes-us-east4-a-zc10 started at 2022-12-07 16:49:35 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:35.634: INFO: Container kube-proxy ready: true, restart count 0 Dec 7 17:10:35.634: INFO: calico-node-g8zkr started at 2022-12-07 16:49:35 +0000 UTC (3+1 container statuses recorded) Dec 7 17:10:35.634: INFO: Init container upgrade-ipam ready: true, restart count 0 Dec 7 17:10:35.634: INFO: Init container install-cni ready: true, restart count 0 Dec 7 17:10:35.634: INFO: Init container mount-bpffs ready: true, restart count 0 Dec 7 17:10:35.634: INFO: Container calico-node ready: true, restart count 0 Dec 7 17:10:35.634: INFO: deployment-749564ff97-kh5fs started at 2022-12-07 17:09:41 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:35.634: INFO: Container nginx ready: false, restart count 0 Dec 7 17:10:35.634: INFO: send-events-eda64968-5254-4632-9e8d-6a0d0d941533 started at 2022-12-07 17:09:52 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:35.634: INFO: Container p ready: true, restart count 0 Dec 7 17:10:35.634: INFO: csi-gce-pd-node-vtqz7 started at 2022-12-07 16:49:35 +0000 UTC (0+2 container statuses recorded) Dec 7 17:10:35.634: INFO: Container csi-driver-registrar ready: true, restart count 0 Dec 7 17:10:35.634: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 17:10:35.634: INFO: coredns-677fff9cfb-4b88c started at 2022-12-07 16:50:04 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:35.634: INFO: Container coredns ready: true, restart count 0 Dec 7 17:10:35.789: INFO: Latency metrics for node nodes-us-east4-a-zc10 Dec 7 17:10:35.789: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP:�[0m Destroying namespace "replicaset-8443" for this suite. �[38;5;243m12/07/22 17:10:35.823�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-cli\]\sKubectl\sclient\sUpdate\sDemo\sshould\sscale\sa\sreplication\scontroller\s\s\[Conformance\]$'
test/e2e/kubectl/kubectl.go:363 k8s.io/kubernetes/test/e2e/kubectl.glob..func1.6.3() test/e2e/kubectl/kubectl.go:363 +0x4e5from junit_01.xml
{"msg":"FAILED [sig-cli] Kubectl client Update Demo should scale a replication controller [Conformance]","completed":16,"skipped":114,"failed":1,"failures":["[sig-cli] Kubectl client Update Demo should scale a replication controller [Conformance]"]} [BeforeEach] [sig-cli] Kubectl client test/e2e/framework/framework.go:186 �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m12/07/22 17:03:46.853�[0m Dec 7 17:03:46.853: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP:�[0m Building a namespace api object, basename kubectl �[38;5;243m12/07/22 17:03:46.854�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m12/07/22 17:03:46.942�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m12/07/22 17:03:46.992�[0m [BeforeEach] [sig-cli] Kubectl client test/e2e/kubectl/kubectl.go:272 [BeforeEach] Update Demo test/e2e/kubectl/kubectl.go:324 [It] should scale a replication controller [Conformance] test/e2e/kubectl/kubectl.go:350 �[1mSTEP:�[0m creating a replication controller �[38;5;243m12/07/22 17:03:47.044�[0m Dec 7 17:03:47.044: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 create -f -' Dec 7 17:03:48.956: INFO: stderr: "" Dec 7 17:03:48.956: INFO: stdout: "replicationcontroller/update-demo-nautilus created\n" �[1mSTEP:�[0m waiting for all containers in name=update-demo pods to come up. �[38;5;243m12/07/22 17:03:48.956�[0m Dec 7 17:03:48.956: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo' Dec 7 17:03:49.129: INFO: stderr: "" Dec 7 17:03:49.130: INFO: stdout: "update-demo-nautilus-n6zs4 update-demo-nautilus-nx666 " Dec 7 17:03:49.130: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods update-demo-nautilus-n6zs4 -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}' Dec 7 17:03:49.317: INFO: stderr: "" Dec 7 17:03:49.317: INFO: stdout: "" Dec 7 17:03:49.317: INFO: update-demo-nautilus-n6zs4 is created but not running Dec 7 17:03:54.317: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo' Dec 7 17:03:54.500: INFO: stderr: "" Dec 7 17:03:54.500: INFO: stdout: "update-demo-nautilus-n6zs4 update-demo-nautilus-nx666 " Dec 7 17:03:54.500: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods update-demo-nautilus-n6zs4 -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}' Dec 7 17:03:54.661: INFO: stderr: "" Dec 7 17:03:54.661: INFO: stdout: "true" Dec 7 17:03:54.661: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods update-demo-nautilus-n6zs4 -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}' Dec 7 17:03:54.829: INFO: stderr: "" Dec 7 17:03:54.829: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.5" Dec 7 17:03:54.829: INFO: validating pod update-demo-nautilus-n6zs4 Dec 7 17:03:54.861: INFO: got data: { "image": "nautilus.jpg" } Dec 7 17:03:54.861: INFO: Unmarshalled json jpg/img => {nautilus.jpg} , expecting nautilus.jpg . Dec 7 17:03:54.861: INFO: update-demo-nautilus-n6zs4 is verified up and running Dec 7 17:03:54.861: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods update-demo-nautilus-nx666 -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}' Dec 7 17:03:55.023: INFO: stderr: "" Dec 7 17:03:55.023: INFO: stdout: "" Dec 7 17:03:55.023: INFO: update-demo-nautilus-nx666 is created but not running Dec 7 17:04:00.024: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo' Dec 7 17:04:00.225: INFO: stderr: "" Dec 7 17:04:00.225: INFO: stdout: "update-demo-nautilus-n6zs4 update-demo-nautilus-nx666 " Dec 7 17:04:00.225: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods update-demo-nautilus-n6zs4 -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}' Dec 7 17:04:00.376: INFO: stderr: "" Dec 7 17:04:00.376: INFO: stdout: "true" Dec 7 17:04:00.376: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods update-demo-nautilus-n6zs4 -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}' Dec 7 17:04:00.531: INFO: stderr: "" Dec 7 17:04:00.531: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.5" Dec 7 17:04:00.531: INFO: validating pod update-demo-nautilus-n6zs4 Dec 7 17:04:00.560: INFO: got data: { "image": "nautilus.jpg" } Dec 7 17:04:00.560: INFO: Unmarshalled json jpg/img => {nautilus.jpg} , expecting nautilus.jpg . Dec 7 17:04:00.560: INFO: update-demo-nautilus-n6zs4 is verified up and running Dec 7 17:04:00.560: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods update-demo-nautilus-nx666 -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}' Dec 7 17:04:00.726: INFO: stderr: "" Dec 7 17:04:00.726: INFO: stdout: "true" Dec 7 17:04:00.726: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods update-demo-nautilus-nx666 -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}' Dec 7 17:04:00.882: INFO: stderr: "" Dec 7 17:04:00.882: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.5" Dec 7 17:04:00.882: INFO: validating pod update-demo-nautilus-nx666 Dec 7 17:04:00.973: INFO: got data: { "image": "nautilus.jpg" } Dec 7 17:04:00.973: INFO: Unmarshalled json jpg/img => {nautilus.jpg} , expecting nautilus.jpg . Dec 7 17:04:00.973: INFO: update-demo-nautilus-nx666 is verified up and running �[1mSTEP:�[0m scaling down the replication controller �[38;5;243m12/07/22 17:04:00.973�[0m Dec 7 17:04:00.975: INFO: scanned /root for discovery docs: <nil> Dec 7 17:04:00.975: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 scale rc update-demo-nautilus --replicas=1 --timeout=5m' Dec 7 17:04:02.253: INFO: stderr: "" Dec 7 17:04:02.254: INFO: stdout: "replicationcontroller/update-demo-nautilus scaled\n" �[1mSTEP:�[0m waiting for all containers in name=update-demo pods to come up. �[38;5;243m12/07/22 17:04:02.254�[0m Dec 7 17:04:02.254: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo' Dec 7 17:04:02.443: INFO: stderr: "" Dec 7 17:04:02.443: INFO: stdout: "update-demo-nautilus-n6zs4 update-demo-nautilus-nx666 " �[1mSTEP:�[0m Replicas for name=update-demo: expected=1 actual=2 �[38;5;243m12/07/22 17:04:02.443�[0m Dec 7 17:04:07.443: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo' Dec 7 17:04:07.634: INFO: stderr: "" Dec 7 17:04:07.634: INFO: stdout: "update-demo-nautilus-n6zs4 update-demo-nautilus-nx666 " �[1mSTEP:�[0m Replicas for name=update-demo: expected=1 actual=2 �[38;5;243m12/07/22 17:04:07.634�[0m Dec 7 17:04:12.635: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo' Dec 7 17:04:12.795: INFO: stderr: "" Dec 7 17:04:12.795: INFO: stdout: "update-demo-nautilus-n6zs4 " Dec 7 17:04:12.795: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods update-demo-nautilus-n6zs4 -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}' Dec 7 17:04:12.960: INFO: stderr: "" Dec 7 17:04:12.960: INFO: stdout: "true" Dec 7 17:04:12.960: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods update-demo-nautilus-n6zs4 -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}' Dec 7 17:04:13.125: INFO: stderr: "" Dec 7 17:04:13.125: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.5" Dec 7 17:04:13.125: INFO: validating pod update-demo-nautilus-n6zs4 Dec 7 17:04:13.164: INFO: got data: { "image": "nautilus.jpg" } Dec 7 17:04:13.164: INFO: Unmarshalled json jpg/img => {nautilus.jpg} , expecting nautilus.jpg . Dec 7 17:04:13.164: INFO: update-demo-nautilus-n6zs4 is verified up and running �[1mSTEP:�[0m scaling up the replication controller �[38;5;243m12/07/22 17:04:13.164�[0m Dec 7 17:04:13.166: INFO: scanned /root for discovery docs: <nil> Dec 7 17:04:13.166: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 scale rc update-demo-nautilus --replicas=2 --timeout=5m' Dec 7 17:04:14.432: INFO: stderr: "" Dec 7 17:04:14.432: INFO: stdout: "replicationcontroller/update-demo-nautilus scaled\n" �[1mSTEP:�[0m waiting for all containers in name=update-demo pods to come up. �[38;5;243m12/07/22 17:04:14.432�[0m Dec 7 17:04:14.432: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo' Dec 7 17:04:14.610: INFO: stderr: "" Dec 7 17:04:14.610: INFO: stdout: "update-demo-nautilus-n6zs4 update-demo-nautilus-qpkjm " Dec 7 17:04:14.610: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods update-demo-nautilus-n6zs4 -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}' Dec 7 17:04:14.766: INFO: stderr: "" Dec 7 17:04:14.766: INFO: stdout: "true" Dec 7 17:04:14.766: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods update-demo-nautilus-n6zs4 -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}' Dec 7 17:04:14.928: INFO: stderr: "" Dec 7 17:04:14.928: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.5" Dec 7 17:04:14.928: INFO: validating pod update-demo-nautilus-n6zs4 Dec 7 17:04:14.957: INFO: got data: { "image": "nautilus.jpg" } Dec 7 17:04:14.957: INFO: Unmarshalled json jpg/img => {nautilus.jpg} , expecting nautilus.jpg . Dec 7 17:04:14.957: INFO: update-demo-nautilus-n6zs4 is verified up and running Dec 7 17:04:14.958: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods update-demo-nautilus-qpkjm -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}' Dec 7 17:04:15.113: INFO: stderr: "" Dec 7 17:04:15.113: INFO: stdout: "" Dec 7 17:04:15.113: INFO: update-demo-nautilus-qpkjm is created but not running Dec 7 17:04:20.113: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo' Dec 7 17:04:20.294: INFO: stderr: "" Dec 7 17:04:20.294: INFO: stdout: "update-demo-nautilus-n6zs4 update-demo-nautilus-qpkjm " Dec 7 17:04:20.294: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods update-demo-nautilus-n6zs4 -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}' Dec 7 17:04:20.455: INFO: stderr: "" Dec 7 17:04:20.455: INFO: stdout: "true" Dec 7 17:04:20.455: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods update-demo-nautilus-n6zs4 -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}' Dec 7 17:04:20.612: INFO: stderr: "" Dec 7 17:04:20.612: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.5" Dec 7 17:04:20.612: INFO: validating pod update-demo-nautilus-n6zs4 Dec 7 17:04:20.647: INFO: got data: { "image": "nautilus.jpg" } Dec 7 17:04:20.647: INFO: Unmarshalled json jpg/img => {nautilus.jpg} , expecting nautilus.jpg . Dec 7 17:04:20.647: INFO: update-demo-nautilus-n6zs4 is verified up and running Dec 7 17:04:20.647: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods update-demo-nautilus-qpkjm -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}' Dec 7 17:04:20.814: INFO: stderr: "" Dec 7 17:04:20.814: INFO: stdout: "true" Dec 7 17:04:20.814: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods update-demo-nautilus-qpkjm -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}' Dec 7 17:04:20.989: INFO: stderr: "" Dec 7 17:04:20.989: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.5" Dec 7 17:04:20.989: INFO: validating pod update-demo-nautilus-qpkjm Dec 7 17:04:51.024: INFO: update-demo-nautilus-qpkjm is running right image but validator function failed: the server is currently unable to handle the request (get pods update-demo-nautilus-qpkjm) Dec 7 17:04:56.024: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo' Dec 7 17:04:56.286: INFO: stderr: "" Dec 7 17:04:56.287: INFO: stdout: "update-demo-nautilus-n6zs4 update-demo-nautilus-qpkjm " Dec 7 17:04:56.287: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods update-demo-nautilus-n6zs4 -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}' Dec 7 17:04:56.483: INFO: stderr: "" Dec 7 17:04:56.483: INFO: stdout: "true" Dec 7 17:04:56.483: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods update-demo-nautilus-n6zs4 -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}' Dec 7 17:04:56.681: INFO: stderr: "" Dec 7 17:04:56.681: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.5" Dec 7 17:04:56.681: INFO: validating pod update-demo-nautilus-n6zs4 Dec 7 17:04:56.745: INFO: got data: { "image": "nautilus.jpg" } Dec 7 17:04:56.745: INFO: Unmarshalled json jpg/img => {nautilus.jpg} , expecting nautilus.jpg . Dec 7 17:04:56.746: INFO: update-demo-nautilus-n6zs4 is verified up and running Dec 7 17:04:56.746: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods update-demo-nautilus-qpkjm -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}' Dec 7 17:04:56.922: INFO: stderr: "" Dec 7 17:04:56.922: INFO: stdout: "true" Dec 7 17:04:56.922: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods update-demo-nautilus-qpkjm -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}' Dec 7 17:04:57.103: INFO: stderr: "" Dec 7 17:04:57.103: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.5" Dec 7 17:04:57.103: INFO: validating pod update-demo-nautilus-qpkjm Dec 7 17:05:27.141: INFO: update-demo-nautilus-qpkjm is running right image but validator function failed: the server is currently unable to handle the request (get pods update-demo-nautilus-qpkjm) Dec 7 17:05:32.141: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo' Dec 7 17:05:32.357: INFO: stderr: "" Dec 7 17:05:32.357: INFO: stdout: "update-demo-nautilus-n6zs4 update-demo-nautilus-qpkjm " Dec 7 17:05:32.357: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods update-demo-nautilus-n6zs4 -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}' Dec 7 17:05:32.549: INFO: stderr: "" Dec 7 17:05:32.549: INFO: stdout: "true" Dec 7 17:05:32.549: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods update-demo-nautilus-n6zs4 -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}' Dec 7 17:05:32.757: INFO: stderr: "" Dec 7 17:05:32.757: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.5" Dec 7 17:05:32.757: INFO: validating pod update-demo-nautilus-n6zs4 Dec 7 17:05:32.806: INFO: got data: { "image": "nautilus.jpg" } Dec 7 17:05:32.806: INFO: Unmarshalled json jpg/img => {nautilus.jpg} , expecting nautilus.jpg . Dec 7 17:05:32.806: INFO: update-demo-nautilus-n6zs4 is verified up and running Dec 7 17:05:32.806: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods update-demo-nautilus-qpkjm -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}' Dec 7 17:05:33.006: INFO: stderr: "" Dec 7 17:05:33.006: INFO: stdout: "true" Dec 7 17:05:33.006: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods update-demo-nautilus-qpkjm -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}' Dec 7 17:05:33.189: INFO: stderr: "" Dec 7 17:05:33.189: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.5" Dec 7 17:05:33.189: INFO: validating pod update-demo-nautilus-qpkjm Dec 7 17:06:03.270: INFO: update-demo-nautilus-qpkjm is running right image but validator function failed: the server is currently unable to handle the request (get pods update-demo-nautilus-qpkjm) Dec 7 17:06:08.271: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo' Dec 7 17:06:08.449: INFO: stderr: "" Dec 7 17:06:08.450: INFO: stdout: "update-demo-nautilus-n6zs4 update-demo-nautilus-qpkjm " Dec 7 17:06:08.450: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods update-demo-nautilus-n6zs4 -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}' Dec 7 17:06:08.605: INFO: stderr: "" Dec 7 17:06:08.605: INFO: stdout: "true" Dec 7 17:06:08.605: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods update-demo-nautilus-n6zs4 -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}' Dec 7 17:06:08.768: INFO: stderr: "" Dec 7 17:06:08.768: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.5" Dec 7 17:06:08.768: INFO: validating pod update-demo-nautilus-n6zs4 Dec 7 17:06:08.803: INFO: got data: { "image": "nautilus.jpg" } Dec 7 17:06:08.803: INFO: Unmarshalled json jpg/img => {nautilus.jpg} , expecting nautilus.jpg . Dec 7 17:06:08.803: INFO: update-demo-nautilus-n6zs4 is verified up and running Dec 7 17:06:08.803: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods update-demo-nautilus-qpkjm -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}' Dec 7 17:06:08.959: INFO: stderr: "" Dec 7 17:06:08.959: INFO: stdout: "true" Dec 7 17:06:08.959: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods update-demo-nautilus-qpkjm -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}' Dec 7 17:06:09.121: INFO: stderr: "" Dec 7 17:06:09.121: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.5" Dec 7 17:06:09.121: INFO: validating pod update-demo-nautilus-qpkjm Dec 7 17:06:39.150: INFO: update-demo-nautilus-qpkjm is running right image but validator function failed: the server is currently unable to handle the request (get pods update-demo-nautilus-qpkjm) Dec 7 17:06:44.151: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo' Dec 7 17:06:44.332: INFO: stderr: "" Dec 7 17:06:44.332: INFO: stdout: "update-demo-nautilus-n6zs4 update-demo-nautilus-qpkjm " Dec 7 17:06:44.332: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods update-demo-nautilus-n6zs4 -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}' Dec 7 17:06:44.494: INFO: stderr: "" Dec 7 17:06:44.494: INFO: stdout: "true" Dec 7 17:06:44.494: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods update-demo-nautilus-n6zs4 -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}' Dec 7 17:06:44.656: INFO: stderr: "" Dec 7 17:06:44.656: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.5" Dec 7 17:06:44.656: INFO: validating pod update-demo-nautilus-n6zs4 Dec 7 17:06:44.695: INFO: got data: { "image": "nautilus.jpg" } Dec 7 17:06:44.695: INFO: Unmarshalled json jpg/img => {nautilus.jpg} , expecting nautilus.jpg . Dec 7 17:06:44.695: INFO: update-demo-nautilus-n6zs4 is verified up and running Dec 7 17:06:44.695: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods update-demo-nautilus-qpkjm -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}' Dec 7 17:06:44.867: INFO: stderr: "" Dec 7 17:06:44.867: INFO: stdout: "true" Dec 7 17:06:44.867: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods update-demo-nautilus-qpkjm -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}' Dec 7 17:06:45.051: INFO: stderr: "" Dec 7 17:06:45.051: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.5" Dec 7 17:06:45.051: INFO: validating pod update-demo-nautilus-qpkjm Dec 7 17:07:15.079: INFO: update-demo-nautilus-qpkjm is running right image but validator function failed: the server is currently unable to handle the request (get pods update-demo-nautilus-qpkjm) Dec 7 17:07:20.080: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo' Dec 7 17:07:20.260: INFO: stderr: "" Dec 7 17:07:20.260: INFO: stdout: "update-demo-nautilus-n6zs4 update-demo-nautilus-qpkjm " Dec 7 17:07:20.260: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods update-demo-nautilus-n6zs4 -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}' Dec 7 17:07:20.422: INFO: stderr: "" Dec 7 17:07:20.422: INFO: stdout: "true" Dec 7 17:07:20.422: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods update-demo-nautilus-n6zs4 -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}' Dec 7 17:07:20.586: INFO: stderr: "" Dec 7 17:07:20.586: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.5" Dec 7 17:07:20.586: INFO: validating pod update-demo-nautilus-n6zs4 Dec 7 17:07:20.616: INFO: got data: { "image": "nautilus.jpg" } Dec 7 17:07:20.616: INFO: Unmarshalled json jpg/img => {nautilus.jpg} , expecting nautilus.jpg . Dec 7 17:07:20.616: INFO: update-demo-nautilus-n6zs4 is verified up and running Dec 7 17:07:20.616: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods update-demo-nautilus-qpkjm -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}' Dec 7 17:07:20.810: INFO: stderr: "" Dec 7 17:07:20.810: INFO: stdout: "true" Dec 7 17:07:20.810: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods update-demo-nautilus-qpkjm -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}' Dec 7 17:07:20.970: INFO: stderr: "" Dec 7 17:07:20.970: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.5" Dec 7 17:07:20.970: INFO: validating pod update-demo-nautilus-qpkjm Dec 7 17:07:50.998: INFO: update-demo-nautilus-qpkjm is running right image but validator function failed: the server is currently unable to handle the request (get pods update-demo-nautilus-qpkjm) Dec 7 17:07:55.999: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo' Dec 7 17:07:56.188: INFO: stderr: "" Dec 7 17:07:56.188: INFO: stdout: "update-demo-nautilus-n6zs4 update-demo-nautilus-qpkjm " Dec 7 17:07:56.188: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods update-demo-nautilus-n6zs4 -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}' Dec 7 17:07:56.416: INFO: stderr: "" Dec 7 17:07:56.416: INFO: stdout: "true" Dec 7 17:07:56.416: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods update-demo-nautilus-n6zs4 -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}' Dec 7 17:07:56.583: INFO: stderr: "" Dec 7 17:07:56.583: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.5" Dec 7 17:07:56.583: INFO: validating pod update-demo-nautilus-n6zs4 Dec 7 17:07:56.645: INFO: got data: { "image": "nautilus.jpg" } Dec 7 17:07:56.645: INFO: Unmarshalled json jpg/img => {nautilus.jpg} , expecting nautilus.jpg . Dec 7 17:07:56.645: INFO: update-demo-nautilus-n6zs4 is verified up and running Dec 7 17:07:56.645: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods update-demo-nautilus-qpkjm -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}' Dec 7 17:07:56.820: INFO: stderr: "" Dec 7 17:07:56.820: INFO: stdout: "true" Dec 7 17:07:56.820: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods update-demo-nautilus-qpkjm -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}' Dec 7 17:07:56.971: INFO: stderr: "" Dec 7 17:07:56.971: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.5" Dec 7 17:07:56.971: INFO: validating pod update-demo-nautilus-qpkjm Dec 7 17:08:27.006: INFO: update-demo-nautilus-qpkjm is running right image but validator function failed: the server is currently unable to handle the request (get pods update-demo-nautilus-qpkjm) Dec 7 17:08:32.007: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo' Dec 7 17:08:32.193: INFO: stderr: "" Dec 7 17:08:32.193: INFO: stdout: "update-demo-nautilus-n6zs4 update-demo-nautilus-qpkjm " Dec 7 17:08:32.193: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods update-demo-nautilus-n6zs4 -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}' Dec 7 17:08:32.347: INFO: stderr: "" Dec 7 17:08:32.347: INFO: stdout: "true" Dec 7 17:08:32.347: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods update-demo-nautilus-n6zs4 -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}' Dec 7 17:08:32.512: INFO: stderr: "" Dec 7 17:08:32.512: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.5" Dec 7 17:08:32.512: INFO: validating pod update-demo-nautilus-n6zs4 Dec 7 17:08:32.542: INFO: got data: { "image": "nautilus.jpg" } Dec 7 17:08:32.542: INFO: Unmarshalled json jpg/img => {nautilus.jpg} , expecting nautilus.jpg . Dec 7 17:08:32.542: INFO: update-demo-nautilus-n6zs4 is verified up and running Dec 7 17:08:32.542: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods update-demo-nautilus-qpkjm -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}' Dec 7 17:08:32.702: INFO: stderr: "" Dec 7 17:08:32.702: INFO: stdout: "true" Dec 7 17:08:32.702: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods update-demo-nautilus-qpkjm -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}' Dec 7 17:08:32.875: INFO: stderr: "" Dec 7 17:08:32.875: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.5" Dec 7 17:08:32.875: INFO: validating pod update-demo-nautilus-qpkjm Dec 7 17:09:02.910: INFO: update-demo-nautilus-qpkjm is running right image but validator function failed: the server is currently unable to handle the request (get pods update-demo-nautilus-qpkjm) Dec 7 17:09:07.911: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo' Dec 7 17:09:08.090: INFO: stderr: "" Dec 7 17:09:08.090: INFO: stdout: "update-demo-nautilus-n6zs4 update-demo-nautilus-qpkjm " Dec 7 17:09:08.090: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods update-demo-nautilus-n6zs4 -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}' Dec 7 17:09:08.249: INFO: stderr: "" Dec 7 17:09:08.249: INFO: stdout: "true" Dec 7 17:09:08.249: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods update-demo-nautilus-n6zs4 -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}' Dec 7 17:09:08.412: INFO: stderr: "" Dec 7 17:09:08.412: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.5" Dec 7 17:09:08.412: INFO: validating pod update-demo-nautilus-n6zs4 Dec 7 17:09:08.440: INFO: got data: { "image": "nautilus.jpg" } Dec 7 17:09:08.440: INFO: Unmarshalled json jpg/img => {nautilus.jpg} , expecting nautilus.jpg . Dec 7 17:09:08.440: INFO: update-demo-nautilus-n6zs4 is verified up and running Dec 7 17:09:08.440: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods update-demo-nautilus-qpkjm -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}' Dec 7 17:09:08.596: INFO: stderr: "" Dec 7 17:09:08.596: INFO: stdout: "true" Dec 7 17:09:08.596: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods update-demo-nautilus-qpkjm -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}' Dec 7 17:09:08.749: INFO: stderr: "" Dec 7 17:09:08.749: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.5" Dec 7 17:09:08.749: INFO: validating pod update-demo-nautilus-qpkjm Dec 7 17:09:38.777: INFO: update-demo-nautilus-qpkjm is running right image but validator function failed: the server is currently unable to handle the request (get pods update-demo-nautilus-qpkjm) Dec 7 17:09:43.777: FAIL: Timed out after 300 seconds waiting for name=update-demo pods to reach valid state Full Stack Trace k8s.io/kubernetes/test/e2e/kubectl.glob..func1.6.3() test/e2e/kubectl/kubectl.go:363 +0x4e5 �[1mSTEP:�[0m using delete to clean up resources �[38;5;243m12/07/22 17:09:43.777�[0m Dec 7 17:09:43.777: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 delete --grace-period=0 --force -f -' Dec 7 17:09:43.963: INFO: stderr: "Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely.\n" Dec 7 17:09:43.963: INFO: stdout: "replicationcontroller \"update-demo-nautilus\" force deleted\n" Dec 7 17:09:43.963: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get rc,svc -l name=update-demo --no-headers' Dec 7 17:09:44.147: INFO: stderr: "No resources found in kubectl-8594 namespace.\n" Dec 7 17:09:44.147: INFO: stdout: "" Dec 7 17:09:44.147: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/00b94c5d-764e-11ed-9620-66dbcc265a58/kubectl --server=https://34.145.193.77 --kubeconfig=/root/.kube/config --namespace=kubectl-8594 get pods -l name=update-demo -o go-template={{ range .items }}{{ if not .metadata.deletionTimestamp }}{{ .metadata.name }}{{ "\n" }}{{ end }}{{ end }}' Dec 7 17:09:44.306: INFO: stderr: "" Dec 7 17:09:44.306: INFO: stdout: "" [AfterEach] [sig-cli] Kubectl client test/e2e/framework/framework.go:187 �[1mSTEP:�[0m Collecting events from namespace "kubectl-8594". �[38;5;243m12/07/22 17:09:44.306�[0m �[1mSTEP:�[0m Found 21 events. �[38;5;243m12/07/22 17:09:44.335�[0m Dec 7 17:09:44.335: INFO: At 2022-12-07 17:03:48 +0000 UTC - event for update-demo-nautilus: {replication-controller } SuccessfulCreate: Created pod: update-demo-nautilus-nx666 Dec 7 17:09:44.335: INFO: At 2022-12-07 17:03:49 +0000 UTC - event for update-demo-nautilus: {replication-controller } SuccessfulCreate: Created pod: update-demo-nautilus-n6zs4 Dec 7 17:09:44.335: INFO: At 2022-12-07 17:03:49 +0000 UTC - event for update-demo-nautilus-n6zs4: {default-scheduler } Scheduled: Successfully assigned kubectl-8594/update-demo-nautilus-n6zs4 to nodes-us-east4-a-zc10 Dec 7 17:09:44.335: INFO: At 2022-12-07 17:03:49 +0000 UTC - event for update-demo-nautilus-nx666: {default-scheduler } Scheduled: Successfully assigned kubectl-8594/update-demo-nautilus-nx666 to nodes-us-east4-a-5680 Dec 7 17:09:44.335: INFO: At 2022-12-07 17:03:51 +0000 UTC - event for update-demo-nautilus-n6zs4: {kubelet nodes-us-east4-a-zc10} Pulled: Container image "registry.k8s.io/e2e-test-images/nautilus:1.5" already present on machine Dec 7 17:09:44.335: INFO: At 2022-12-07 17:03:51 +0000 UTC - event for update-demo-nautilus-n6zs4: {kubelet nodes-us-east4-a-zc10} Created: Created container update-demo Dec 7 17:09:44.335: INFO: At 2022-12-07 17:03:51 +0000 UTC - event for update-demo-nautilus-n6zs4: {kubelet nodes-us-east4-a-zc10} Started: Started container update-demo Dec 7 17:09:44.335: INFO: At 2022-12-07 17:03:51 +0000 UTC - event for update-demo-nautilus-nx666: {kubelet nodes-us-east4-a-5680} Pulling: Pulling image "registry.k8s.io/e2e-test-images/nautilus:1.5" Dec 7 17:09:44.335: INFO: At 2022-12-07 17:03:54 +0000 UTC - event for update-demo-nautilus-nx666: {kubelet nodes-us-east4-a-5680} Pulled: Successfully pulled image "registry.k8s.io/e2e-test-images/nautilus:1.5" in 2.917232775s Dec 7 17:09:44.335: INFO: At 2022-12-07 17:03:54 +0000 UTC - event for update-demo-nautilus-nx666: {kubelet nodes-us-east4-a-5680} Created: Created container update-demo Dec 7 17:09:44.335: INFO: At 2022-12-07 17:03:55 +0000 UTC - event for update-demo-nautilus-nx666: {kubelet nodes-us-east4-a-5680} Started: Started container update-demo Dec 7 17:09:44.335: INFO: At 2022-12-07 17:04:01 +0000 UTC - event for update-demo-nautilus: {replication-controller } SuccessfulDelete: Deleted pod: update-demo-nautilus-nx666 Dec 7 17:09:44.335: INFO: At 2022-12-07 17:04:01 +0000 UTC - event for update-demo-nautilus-nx666: {kubelet nodes-us-east4-a-5680} Killing: Stopping container update-demo Dec 7 17:09:44.335: INFO: At 2022-12-07 17:04:13 +0000 UTC - event for update-demo-nautilus: {replication-controller } SuccessfulCreate: Created pod: update-demo-nautilus-qpkjm Dec 7 17:09:44.335: INFO: At 2022-12-07 17:04:13 +0000 UTC - event for update-demo-nautilus-qpkjm: {default-scheduler } Scheduled: Successfully assigned kubectl-8594/update-demo-nautilus-qpkjm to nodes-us-east4-a-nfxp Dec 7 17:09:44.335: INFO: At 2022-12-07 17:04:14 +0000 UTC - event for update-demo-nautilus-qpkjm: {kubelet nodes-us-east4-a-nfxp} Pulling: Pulling image "registry.k8s.io/e2e-test-images/nautilus:1.5" Dec 7 17:09:44.335: INFO: At 2022-12-07 17:04:16 +0000 UTC - event for update-demo-nautilus-qpkjm: {kubelet nodes-us-east4-a-nfxp} Pulled: Successfully pulled image "registry.k8s.io/e2e-test-images/nautilus:1.5" in 2.479321151s Dec 7 17:09:44.335: INFO: At 2022-12-07 17:04:16 +0000 UTC - event for update-demo-nautilus-qpkjm: {kubelet nodes-us-east4-a-nfxp} Created: Created container update-demo Dec 7 17:09:44.335: INFO: At 2022-12-07 17:04:16 +0000 UTC - event for update-demo-nautilus-qpkjm: {kubelet nodes-us-east4-a-nfxp} Started: Started container update-demo Dec 7 17:09:44.335: INFO: At 2022-12-07 17:09:43 +0000 UTC - event for update-demo-nautilus-n6zs4: {kubelet nodes-us-east4-a-zc10} Killing: Stopping container update-demo Dec 7 17:09:44.335: INFO: At 2022-12-07 17:09:43 +0000 UTC - event for update-demo-nautilus-qpkjm: {kubelet nodes-us-east4-a-nfxp} Killing: Stopping container update-demo Dec 7 17:09:44.366: INFO: POD NODE PHASE GRACE CONDITIONS Dec 7 17:09:44.366: INFO: update-demo-nautilus-n6zs4 nodes-us-east4-a-zc10 Running 30s [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-07 17:03:49 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-12-07 17:03:51 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-07 17:03:51 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-07 17:03:49 +0000 UTC }] Dec 7 17:09:44.366: INFO: update-demo-nautilus-qpkjm nodes-us-east4-a-nfxp Running 30s [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-07 17:04:13 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-12-07 17:04:17 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-07 17:04:17 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-07 17:04:13 +0000 UTC }] Dec 7 17:09:44.366: INFO: Dec 7 17:09:44.469: INFO: Logging node info for node control-plane-us-east4-a-vd91 Dec 7 17:09:44.498: INFO: Node Info: &Node{ObjectMeta:{control-plane-us-east4-a-vd91 74d54d8e-e0bc-4c7d-bf3c-5b66ce025930 51325 0 2022-12-07 16:47:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-standard-2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east4 failure-domain.beta.kubernetes.io/zone:us-east4-a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:control-plane-us-east4-a-vd91 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node-role.kubernetes.io/node: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:e2-standard-2 topology.gke.io/zone:us-east4-a topology.kubernetes.io/region:us-east4 topology.kubernetes.io/zone:us-east4-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/instances/control-plane-us-east4-a-vd91"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.5/32 projectcalico.org/IPv4IPIPTunnelAddr:100.101.18.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-12-07 16:47:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2022-12-07 16:48:18 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {calico-node Update v1 2022-12-07 16:48:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}}}}} status} {cloud-controller-manager Update v1 2022-12-07 16:48:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2022-12-07 16:48:34 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:48:39 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:48:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-12-07 17:09:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:gce://gce-gci-upg-lat-1-3-ctl-skew/us-east4-a/control-plane-us-east4-a-vd91,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8332767232 0} {<nil>} 8137468Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8227909632 0} {<nil>} 8035068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-07 16:48:39 +0000 UTC,LastTransitionTime:2022-12-07 16:48:39 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-07 17:09:22 +0000 UTC,LastTransitionTime:2022-12-07 16:47:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-07 17:09:22 +0000 UTC,LastTransitionTime:2022-12-07 16:47:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-07 17:09:22 +0000 UTC,LastTransitionTime:2022-12-07 16:47:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-07 17:09:22 +0000 UTC,LastTransitionTime:2022-12-07 16:48:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.5,},NodeAddress{Type:ExternalIP,Address:35.245.23.229,},NodeAddress{Type:Hostname,Address:control-plane-us-east4-a-vd91,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e32750d839dd77bbe79d8a1be267141a,SystemUUID:e32750d8-39dd-77bb-e79d-8a1be267141a,BootID:572b6367-72b8-4ea4-b559-5c84c54662ce,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gcr.io/k8s-staging-etcdadm/etcd-manager@sha256:f3a63853502cb3956fa708fea524be3b333036ebc1cd1dadd81abd9f1fe61043 gcr.io/k8s-staging-etcdadm/etcd-manager:v3.0.20220831-21-g12041b4c],SizeBytes:231516108,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.25.4],SizeBytes:129085904,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.25.4],SizeBytes:118436153,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.4],SizeBytes:63279305,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.25.4],SizeBytes:51921208,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-alpha.2],SizeBytes:42203406,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-alpha.2],SizeBytes:41463710,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:2b6acd7f677f76ffe12ecf3ea7df92eb9b1bdb07336d1ac2a54c7631fb753f7e docker.io/calico/kube-controllers:v3.24.5],SizeBytes:31137169,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2 registry.k8s.io/sig-storage/csi-provisioner:v2.1.0],SizeBytes:21205045,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:50c3cfd458fc8e0bf3c8c521eac39172009382fc66dc5044a330d137c6ed0b09 registry.k8s.io/sig-storage/csi-attacher:v3.1.0],SizeBytes:20103959,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a registry.k8s.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:9af9bf28430b00a0cedeb2ec29acadce45e6afcecd8bdf31c793c624cfa75fa7 registry.k8s.io/sig-storage/csi-snapshotter:v3.0.3],SizeBytes:19500777,},ContainerImage{Names:[docker.io/k8scloudprovidergcp/cloud-controller-manager@sha256:881fd1095937638040723973ade90e6700f1c831a78fb585a3227c4d021b0df9 docker.io/k8scloudprovidergcp/cloud-controller-manager:latest],SizeBytes:18702875,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-alpha.2],SizeBytes:4954573,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 7 17:09:44.498: INFO: Logging kubelet events for node control-plane-us-east4-a-vd91 Dec 7 17:09:44.529: INFO: Logging pods the kubelet thinks is on node control-plane-us-east4-a-vd91 Dec 7 17:09:44.569: INFO: csi-gce-pd-controller-689c9f4444-b5qql started at 2022-12-07 16:48:18 +0000 UTC (0+5 container statuses recorded) Dec 7 17:09:44.569: INFO: Container csi-attacher ready: true, restart count 0 Dec 7 17:09:44.569: INFO: Container csi-provisioner ready: true, restart count 0 Dec 7 17:09:44.569: INFO: Container csi-resizer ready: true, restart count 0 Dec 7 17:09:44.569: INFO: Container csi-snapshotter ready: true, restart count 0 Dec 7 17:09:44.569: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 17:09:44.569: INFO: kube-scheduler-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:44.569: INFO: Container kube-scheduler ready: true, restart count 0 Dec 7 17:09:44.569: INFO: etcd-manager-main-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:44.569: INFO: Container etcd-manager ready: true, restart count 0 Dec 7 17:09:44.569: INFO: kube-apiserver-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+2 container statuses recorded) Dec 7 17:09:44.569: INFO: Container healthcheck ready: true, restart count 0 Dec 7 17:09:44.569: INFO: Container kube-apiserver ready: true, restart count 1 Dec 7 17:09:44.569: INFO: etcd-manager-events-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:44.569: INFO: Container etcd-manager ready: true, restart count 0 Dec 7 17:09:44.569: INFO: kube-controller-manager-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:44.569: INFO: Container kube-controller-manager ready: true, restart count 2 Dec 7 17:09:44.569: INFO: dns-controller-8946976bb-6t8hj started at 2022-12-07 16:48:19 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:44.569: INFO: Container dns-controller ready: true, restart count 0 Dec 7 17:09:44.569: INFO: cloud-controller-manager-xd6xh started at 2022-12-07 16:48:18 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:44.569: INFO: Container cloud-controller-manager ready: true, restart count 0 Dec 7 17:09:44.569: INFO: kube-proxy-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:44.569: INFO: Container kube-proxy ready: true, restart count 0 Dec 7 17:09:44.569: INFO: csi-gce-pd-node-z9fsn started at 2022-12-07 16:48:06 +0000 UTC (0+2 container statuses recorded) Dec 7 17:09:44.569: INFO: Container csi-driver-registrar ready: true, restart count 0 Dec 7 17:09:44.569: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 17:09:44.569: INFO: kops-controller-mnn6f started at 2022-12-07 16:48:18 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:44.569: INFO: Container kops-controller ready: true, restart count 0 Dec 7 17:09:44.569: INFO: calico-node-zgvgx started at 2022-12-07 16:48:06 +0000 UTC (3+1 container statuses recorded) Dec 7 17:09:44.569: INFO: Init container upgrade-ipam ready: true, restart count 0 Dec 7 17:09:44.569: INFO: Init container install-cni ready: true, restart count 0 Dec 7 17:09:44.569: INFO: Init container mount-bpffs ready: true, restart count 0 Dec 7 17:09:44.569: INFO: Container calico-node ready: true, restart count 0 Dec 7 17:09:44.569: INFO: calico-kube-controllers-7bc879d8d6-t4vrx started at 2022-12-07 16:48:39 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:44.569: INFO: Container calico-kube-controllers ready: true, restart count 0 Dec 7 17:09:44.794: INFO: Latency metrics for node control-plane-us-east4-a-vd91 Dec 7 17:09:44.794: INFO: Logging node info for node nodes-us-east4-a-5680 Dec 7 17:09:44.822: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east4-a-5680 b9473b45-598f-43c3-aafc-dc872ade1274 51480 0 2022-12-07 16:49:31 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east4 failure-domain.beta.kubernetes.io/zone:us-east4-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east4-a-5680 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east4-a topology.hostpath.csi/node:nodes-us-east4-a-5680 topology.kubernetes.io/region:us-east4 topology.kubernetes.io/zone:us-east4-a] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-5034":"nodes-us-east4-a-5680","pd.csi.storage.gke.io":"projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/instances/nodes-us-east4-a-5680"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.3/32 projectcalico.org/IPv4IPIPTunnelAddr:100.119.115.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2022-12-07 16:49:31 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2022-12-07 16:49:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2022-12-07 16:49:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:49:41 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:49:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {calico-node Update v1 2022-12-07 16:49:59 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 17:09:28 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2022-12-07 17:09:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:gce://gce-gci-upg-lat-1-3-ctl-skew/us-east4-a/nodes-us-east4-a-5680,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-07 16:49:58 +0000 UTC,LastTransitionTime:2022-12-07 16:49:58 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-07 17:09:28 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-07 17:09:28 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-07 17:09:28 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-07 17:09:28 +0000 UTC,LastTransitionTime:2022-12-07 16:49:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.3,},NodeAddress{Type:ExternalIP,Address:34.86.83.231,},NodeAddress{Type:Hostname,Address:nodes-us-east4-a-5680,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:5676434e0327952eef9a8130969e32db,SystemUUID:5676434e-0327-952e-ef9a-8130969e32db,BootID:f4cd280b-a7ea-43c2-b78f-d43fab064010,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.4],SizeBytes:63279305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:51155161,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 registry.k8s.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-5034^c7350d68-7651-11ed-907f-fa5ce46b05fc],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-5034^c7350d68-7651-11ed-907f-fa5ce46b05fc,DevicePath:,},},Config:nil,},} Dec 7 17:09:44.822: INFO: Logging kubelet events for node nodes-us-east4-a-5680 Dec 7 17:09:44.870: INFO: Logging pods the kubelet thinks is on node nodes-us-east4-a-5680 Dec 7 17:09:44.921: INFO: deployment-749564ff97-jxzk2 started at 2022-12-07 17:09:41 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:44.921: INFO: Container nginx ready: false, restart count 0 Dec 7 17:09:44.921: INFO: calico-node-wvpd9 started at 2022-12-07 16:49:34 +0000 UTC (3+1 container statuses recorded) Dec 7 17:09:44.921: INFO: Init container upgrade-ipam ready: true, restart count 0 Dec 7 17:09:44.921: INFO: Init container install-cni ready: true, restart count 0 Dec 7 17:09:44.921: INFO: Init container mount-bpffs ready: true, restart count 0 Dec 7 17:09:44.921: INFO: Container calico-node ready: true, restart count 0 Dec 7 17:09:44.921: INFO: inline-volume-qdfzg started at 2022-12-07 17:08:47 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:44.921: INFO: Container volume-tester ready: false, restart count 0 Dec 7 17:09:44.921: INFO: adopt-release-wtxr5 started at 2022-12-07 17:09:19 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:44.921: INFO: Container c ready: true, restart count 0 Dec 7 17:09:44.921: INFO: kube-proxy-nodes-us-east4-a-5680 started at 2022-12-07 16:49:34 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:44.921: INFO: Container kube-proxy ready: true, restart count 0 Dec 7 17:09:44.921: INFO: probe-test-0bb2c881-d80f-4383-80a4-e94331805e51 started at 2022-12-07 17:09:16 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:44.921: INFO: Container probe-test-0bb2c881-d80f-4383-80a4-e94331805e51 ready: false, restart count 0 Dec 7 17:09:44.921: INFO: service-headless-toggled-wbx45 started at 2022-12-07 17:09:18 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:44.921: INFO: Container service-headless-toggled ready: true, restart count 0 Dec 7 17:09:44.921: INFO: service-headless-bhtl2 started at 2022-12-07 17:09:12 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:44.921: INFO: Container service-headless ready: true, restart count 0 Dec 7 17:09:44.921: INFO: csi-mockplugin-attacher-0 started at 2022-12-07 17:08:22 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:44.921: INFO: Container csi-attacher ready: true, restart count 0 Dec 7 17:09:44.921: INFO: hostexec-nodes-us-east4-a-5680-bjr7q started at 2022-12-07 17:09:32 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:44.921: INFO: Container agnhost-container ready: true, restart count 0 Dec 7 17:09:44.921: INFO: csi-gce-pd-node-9n22s started at 2022-12-07 16:49:34 +0000 UTC (0+2 container statuses recorded) Dec 7 17:09:44.921: INFO: Container csi-driver-registrar ready: true, restart count 0 Dec 7 17:09:44.921: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 17:09:44.921: INFO: adopt-release-h58rh started at 2022-12-07 17:09:19 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:44.921: INFO: Container c ready: true, restart count 0 Dec 7 17:09:44.921: INFO: csi-mockplugin-0 started at 2022-12-07 17:08:22 +0000 UTC (0+3 container statuses recorded) Dec 7 17:09:44.921: INFO: Container csi-provisioner ready: true, restart count 0 Dec 7 17:09:44.921: INFO: Container driver-registrar ready: true, restart count 0 Dec 7 17:09:44.921: INFO: Container mock ready: true, restart count 0 Dec 7 17:09:44.921: INFO: pvc-volume-tester-dnzbm started at 2022-12-07 17:08:34 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:44.921: INFO: Container volume-tester ready: true, restart count 0 Dec 7 17:09:44.921: INFO: hostexec-nodes-us-east4-a-5680-dlvcq started at 2022-12-07 17:09:42 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:44.921: INFO: Container agnhost-container ready: true, restart count 0 Dec 7 17:09:44.921: INFO: pod-1 started at 2022-12-07 17:08:39 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:44.921: INFO: Container donothing ready: true, restart count 0 Dec 7 17:09:44.921: INFO: csi-mockplugin-resizer-0 started at 2022-12-07 17:08:22 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:44.921: INFO: Container csi-resizer ready: true, restart count 0 Dec 7 17:09:44.921: INFO: netserver-0 started at 2022-12-07 17:09:33 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:44.921: INFO: Container webserver ready: true, restart count 0 Dec 7 17:09:45.193: INFO: Latency metrics for node nodes-us-east4-a-5680 Dec 7 17:09:45.193: INFO: Logging node info for node nodes-us-east4-a-nfxp Dec 7 17:09:45.231: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east4-a-nfxp 958029bf-d66a-424c-a80d-b1d485df133b 49893 0 2022-12-07 16:49:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east4 failure-domain.beta.kubernetes.io/zone:us-east4-a io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east4-a-nfxp kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east4-a topology.hostpath.csi/node:nodes-us-east4-a-nfxp topology.kubernetes.io/region:us-east4 topology.kubernetes.io/zone:us-east4-a] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-206":"nodes-us-east4-a-nfxp","pd.csi.storage.gke.io":"projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/instances/nodes-us-east4-a-nfxp"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.6/32 projectcalico.org/IPv4IPIPTunnelAddr:100.113.109.192 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2022-12-07 16:49:28 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2022-12-07 16:49:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2022-12-07 16:49:29 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:49:41 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:49:48 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {calico-node Update v1 2022-12-07 16:49:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2022-12-07 17:08:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:gce://gce-gci-upg-lat-1-3-ctl-skew/us-east4-a/nodes-us-east4-a-nfxp,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-07 16:49:53 +0000 UTC,LastTransitionTime:2022-12-07 16:49:53 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-07 17:08:34 +0000 UTC,LastTransitionTime:2022-12-07 16:49:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-07 17:08:34 +0000 UTC,LastTransitionTime:2022-12-07 16:49:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-07 17:08:34 +0000 UTC,LastTransitionTime:2022-12-07 16:49:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-07 17:08:34 +0000 UTC,LastTransitionTime:2022-12-07 16:49:48 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.6,},NodeAddress{Type:ExternalIP,Address:34.145.242.1,},NodeAddress{Type:Hostname,Address:nodes-us-east4-a-nfxp,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:796e3b73d867da488abd70a5df2fe10f,SystemUUID:796e3b73-d867-da48-8abd-70a5df2fe10f,BootID:2b784aad-5897-4bb4-bb49-6bae545d9488,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:b83c1d70989e1fe87583607bf5aee1ee34e52773d4755b95f5cf5a451962f3a4 registry.k8s.io/etcd:3.5.5-0],SizeBytes:102417044,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.4],SizeBytes:63279305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:51155161,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:f9c93b92b6ff750b41a93c4e4fe0bfe384597aeb841e2539d5444815c55b2d8f registry.k8s.io/e2e-test-images/sample-apiserver:1.17.5],SizeBytes:24316368,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:aa60f453d64dfb3c3fd9e7306f988c36c6352c4f2d956aa90467f2808091effa registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.5],SizeBytes:15209420,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:38e6b091d238094f081efad3e2b362e6480b2156f5f4fba6ea46835ecdcd47e2 registry.k8s.io/build-image/distroless-iptables:v0.1.1],SizeBytes:7634231,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:7000509,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 7 17:09:45.232: INFO: Logging kubelet events for node nodes-us-east4-a-nfxp Dec 7 17:09:45.268: INFO: Logging pods the kubelet thinks is on node nodes-us-east4-a-nfxp Dec 7 17:09:45.305: INFO: kube-proxy-nodes-us-east4-a-nfxp started at 2022-12-07 16:49:29 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:45.305: INFO: Container kube-proxy ready: true, restart count 0 Dec 7 17:09:45.305: INFO: my-hostname-private-9e75431e-621c-4eb3-8da2-e3518e05bc2a-gmw8c started at 2022-12-07 17:07:37 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:45.305: INFO: Container my-hostname-private-9e75431e-621c-4eb3-8da2-e3518e05bc2a ready: true, restart count 0 Dec 7 17:09:45.305: INFO: csi-gce-pd-node-vcz5x started at 2022-12-07 16:49:29 +0000 UTC (0+2 container statuses recorded) Dec 7 17:09:45.305: INFO: Container csi-driver-registrar ready: true, restart count 0 Dec 7 17:09:45.305: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 17:09:45.305: INFO: hostexec-nodes-us-east4-a-nfxp-5kpnf started at 2022-12-07 17:09:09 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:45.305: INFO: Container agnhost-container ready: true, restart count 0 Dec 7 17:09:45.305: INFO: service-headless-qpmc4 started at 2022-12-07 17:09:12 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:45.305: INFO: Container service-headless ready: true, restart count 0 Dec 7 17:09:45.305: INFO: netserver-1 started at 2022-12-07 17:09:33 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:45.305: INFO: Container webserver ready: false, restart count 0 Dec 7 17:09:45.305: INFO: calico-node-f2cxs started at 2022-12-07 16:49:29 +0000 UTC (3+1 container statuses recorded) Dec 7 17:09:45.305: INFO: Init container upgrade-ipam ready: true, restart count 0 Dec 7 17:09:45.305: INFO: Init container install-cni ready: true, restart count 0 Dec 7 17:09:45.305: INFO: Init container mount-bpffs ready: true, restart count 0 Dec 7 17:09:45.305: INFO: Container calico-node ready: true, restart count 0 Dec 7 17:09:45.305: INFO: dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4 started at 2022-12-07 16:53:00 +0000 UTC (0+3 container statuses recorded) Dec 7 17:09:45.305: INFO: Container jessie-querier ready: true, restart count 1 Dec 7 17:09:45.305: INFO: Container querier ready: true, restart count 1 Dec 7 17:09:45.305: INFO: Container webserver ready: true, restart count 0 Dec 7 17:09:45.305: INFO: csi-mockplugin-0 started at 2022-12-07 17:08:39 +0000 UTC (0+3 container statuses recorded) Dec 7 17:09:45.305: INFO: Container csi-provisioner ready: true, restart count 0 Dec 7 17:09:45.305: INFO: Container driver-registrar ready: true, restart count 0 Dec 7 17:09:45.305: INFO: Container mock ready: true, restart count 0 Dec 7 17:09:45.305: INFO: pvc-volume-tester-4qt5z started at 2022-12-07 17:08:44 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:45.305: INFO: Container volume-tester ready: true, restart count 0 Dec 7 17:09:45.305: INFO: agnhost started at 2022-12-07 17:08:04 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:45.305: INFO: Container agnhost ready: true, restart count 0 Dec 7 17:09:45.305: INFO: coredns-677fff9cfb-rv6b9 started at 2022-12-07 16:49:48 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:45.305: INFO: Container coredns ready: true, restart count 0 Dec 7 17:09:45.305: INFO: coredns-autoscaler-db7b97744-2cf6q started at 2022-12-07 16:49:48 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:45.305: INFO: Container autoscaler ready: true, restart count 0 Dec 7 17:09:45.305: INFO: csi-mockplugin-attacher-0 started at 2022-12-07 17:08:39 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:45.305: INFO: Container csi-attacher ready: true, restart count 0 Dec 7 17:09:45.305: INFO: agnhost started at 2022-12-07 17:04:12 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:45.305: INFO: Container agnhost ready: true, restart count 0 Dec 7 17:09:45.305: INFO: hostexec-nodes-us-east4-a-nfxp-gwvrj started at 2022-12-07 17:09:09 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:45.305: INFO: Container agnhost-container ready: true, restart count 0 Dec 7 17:09:45.305: INFO: pod-subpath-test-preprovisionedpv-gf6d started at 2022-12-07 17:09:21 +0000 UTC (1+1 container statuses recorded) Dec 7 17:09:45.305: INFO: Init container init-volume-preprovisionedpv-gf6d ready: true, restart count 0 Dec 7 17:09:45.305: INFO: Container test-container-subpath-preprovisionedpv-gf6d ready: false, restart count 0 Dec 7 17:09:45.305: INFO: webserver-pod started at 2022-12-07 17:06:48 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:45.305: INFO: Container agnhost ready: false, restart count 0 Dec 7 17:09:45.542: INFO: Latency metrics for node nodes-us-east4-a-nfxp Dec 7 17:09:45.542: INFO: Logging node info for node nodes-us-east4-a-v6tj Dec 7 17:09:45.574: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east4-a-v6tj 7ccb4554-dd50-4efe-9be3-d3667475ec25 51912 0 2022-12-07 16:49:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east4 failure-domain.beta.kubernetes.io/zone:us-east4-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east4-a-v6tj kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east4-a topology.hostpath.csi/node:nodes-us-east4-a-v6tj topology.kubernetes.io/region:us-east4 topology.kubernetes.io/zone:us-east4-a] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-1041":"nodes-us-east4-a-v6tj","csi-mock-csi-mock-volumes-5845":"csi-mock-csi-mock-volumes-5845","pd.csi.storage.gke.io":"projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/instances/nodes-us-east4-a-v6tj"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.2/32 projectcalico.org/IPv4IPIPTunnelAddr:100.123.60.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2022-12-07 16:49:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2022-12-07 16:49:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2022-12-07 16:49:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:49:49 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:49:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {calico-node Update v1 2022-12-07 16:50:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2022-12-07 17:09:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:gce://gce-gci-upg-lat-1-3-ctl-skew/us-east4-a/nodes-us-east4-a-v6tj,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111196160 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006338560 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-07 16:49:59 +0000 UTC,LastTransitionTime:2022-12-07 16:49:59 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-07 17:08:22 +0000 UTC,LastTransitionTime:2022-12-07 16:49:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-07 17:08:22 +0000 UTC,LastTransitionTime:2022-12-07 16:49:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-07 17:08:22 +0000 UTC,LastTransitionTime:2022-12-07 16:49:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-07 17:08:22 +0000 UTC,LastTransitionTime:2022-12-07 16:49:55 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.2,},NodeAddress{Type:ExternalIP,Address:35.245.137.186,},NodeAddress{Type:Hostname,Address:nodes-us-east4-a-v6tj,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a77ca3c48fb1245cde75a6429c818c0a,SystemUUID:a77ca3c4-8fb1-245c-de75-a6429c818c0a,BootID:65d4f8a4-acd4-4bf8-8839-6a047fad3abd,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:b83c1d70989e1fe87583607bf5aee1ee34e52773d4755b95f5cf5a451962f3a4 registry.k8s.io/etcd:3.5.5-0],SizeBytes:102417044,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.4],SizeBytes:63279305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:51155161,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 registry.k8s.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:7000509,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 7 17:09:45.574: INFO: Logging kubelet events for node nodes-us-east4-a-v6tj Dec 7 17:09:45.608: INFO: Logging pods the kubelet thinks is on node nodes-us-east4-a-v6tj Dec 7 17:09:45.646: INFO: adopt-release-xzjvv started at 2022-12-07 17:09:29 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:45.646: INFO: Container c ready: true, restart count 0 Dec 7 17:09:45.646: INFO: pod1 started at 2022-12-07 17:09:16 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:45.646: INFO: Container agnhost ready: true, restart count 0 Dec 7 17:09:45.646: INFO: service-headless-toggled-222pm started at 2022-12-07 17:09:18 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:45.646: INFO: Container service-headless-toggled ready: true, restart count 0 Dec 7 17:09:45.646: INFO: kube-proxy-nodes-us-east4-a-v6tj started at 2022-12-07 16:49:37 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:45.646: INFO: Container kube-proxy ready: true, restart count 0 Dec 7 17:09:45.646: INFO: csi-mockplugin-0 started at 2022-12-07 17:08:31 +0000 UTC (0+4 container statuses recorded) Dec 7 17:09:45.646: INFO: Container busybox ready: true, restart count 0 Dec 7 17:09:45.646: INFO: Container csi-provisioner ready: false, restart count 1 Dec 7 17:09:45.646: INFO: Container driver-registrar ready: true, restart count 0 Dec 7 17:09:45.646: INFO: Container mock ready: true, restart count 0 Dec 7 17:09:45.646: INFO: csi-mockplugin-0 started at 2022-12-07 17:09:35 +0000 UTC (0+3 container statuses recorded) Dec 7 17:09:45.646: INFO: Container csi-provisioner ready: true, restart count 0 Dec 7 17:09:45.646: INFO: Container driver-registrar ready: true, restart count 0 Dec 7 17:09:45.646: INFO: Container mock ready: true, restart count 0 Dec 7 17:09:45.646: INFO: calico-node-j442m started at 2022-12-07 16:49:37 +0000 UTC (3+1 container statuses recorded) Dec 7 17:09:45.646: INFO: Init container upgrade-ipam ready: true, restart count 0 Dec 7 17:09:45.646: INFO: Init container install-cni ready: true, restart count 0 Dec 7 17:09:45.646: INFO: Init container mount-bpffs ready: true, restart count 0 Dec 7 17:09:45.646: INFO: Container calico-node ready: true, restart count 0 Dec 7 17:09:45.646: INFO: pod2 started at 2022-12-07 17:09:20 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:45.646: INFO: Container agnhost ready: true, restart count 0 Dec 7 17:09:45.646: INFO: netserver-2 started at 2022-12-07 17:09:33 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:45.646: INFO: Container webserver ready: false, restart count 0 Dec 7 17:09:45.646: INFO: pod-subpath-test-secret-sllj started at 2022-12-07 17:09:36 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:45.646: INFO: Container test-container-subpath-secret-sllj ready: true, restart count 0 Dec 7 17:09:45.646: INFO: e2e-host-exec started at 2022-12-07 17:09:36 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:45.646: INFO: Container e2e-host-exec ready: true, restart count 0 Dec 7 17:09:45.646: INFO: deployment-97c6466db-8j54p started at <nil> (0+0 container statuses recorded) Dec 7 17:09:45.646: INFO: test-rs-bwk2f started at <nil> (0+0 container statuses recorded) Dec 7 17:09:45.646: INFO: csi-gce-pd-node-n8bdx started at 2022-12-07 16:49:37 +0000 UTC (0+2 container statuses recorded) Dec 7 17:09:45.646: INFO: Container csi-driver-registrar ready: true, restart count 0 Dec 7 17:09:45.646: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 17:09:45.646: INFO: webserver-pod started at 2022-12-07 17:05:48 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:45.646: INFO: Container agnhost ready: false, restart count 0 Dec 7 17:09:45.646: INFO: service-headless-nq94h started at 2022-12-07 17:09:12 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:45.646: INFO: Container service-headless ready: true, restart count 0 Dec 7 17:09:45.646: INFO: csi-mockplugin-attacher-0 started at 2022-12-07 17:09:35 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:45.646: INFO: Container csi-attacher ready: true, restart count 0 Dec 7 17:09:45.646: INFO: deployment-749564ff97-hqtsk started at <nil> (0+0 container statuses recorded) Dec 7 17:09:45.646: INFO: pod3 started at 2022-12-07 17:09:26 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:45.646: INFO: Container agnhost ready: true, restart count 0 Dec 7 17:09:45.891: INFO: Latency metrics for node nodes-us-east4-a-v6tj Dec 7 17:09:45.891: INFO: Logging node info for node nodes-us-east4-a-zc10 Dec 7 17:09:45.921: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east4-a-zc10 c6cc41ef-a044-4188-9cdf-9af619e808de 52063 0 2022-12-07 16:49:31 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east4 failure-domain.beta.kubernetes.io/zone:us-east4-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east4-a-zc10 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east4-a topology.hostpath.csi/node:nodes-us-east4-a-zc10 topology.kubernetes.io/region:us-east4 topology.kubernetes.io/zone:us-east4-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/instances/nodes-us-east4-a-zc10"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.4/32 projectcalico.org/IPv4IPIPTunnelAddr:100.113.50.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-12-07 16:49:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:49:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2022-12-07 16:49:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:49:41 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:49:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {calico-node Update v1 2022-12-07 16:49:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2022-12-07 17:09:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:gce://gce-gci-upg-lat-1-3-ctl-skew/us-east4-a/nodes-us-east4-a-zc10,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111196160 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006338560 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-07 16:49:56 +0000 UTC,LastTransitionTime:2022-12-07 16:49:56 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-07 17:09:28 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-07 17:09:28 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-07 17:09:28 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-07 17:09:28 +0000 UTC,LastTransitionTime:2022-12-07 16:49:52 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.4,},NodeAddress{Type:ExternalIP,Address:35.188.253.28,},NodeAddress{Type:Hostname,Address:nodes-us-east4-a-zc10,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f5ea7883cc54b5706859a5f8fc4d24dd,SystemUUID:f5ea7883-cc54-b570-6859-a5f8fc4d24dd,BootID:6c425a3b-23de-41f0-9815-f6a0465861ce,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.4],SizeBytes:63279305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:51155161,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:7000509,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 7 17:09:45.922: INFO: Logging kubelet events for node nodes-us-east4-a-zc10 Dec 7 17:09:45.954: INFO: Logging pods the kubelet thinks is on node nodes-us-east4-a-zc10 Dec 7 17:09:45.991: INFO: pod-subpath-test-preprovisionedpv-8kzx started at 2022-12-07 17:09:23 +0000 UTC (1+1 container statuses recorded) Dec 7 17:09:45.991: INFO: Init container init-volume-preprovisionedpv-8kzx ready: true, restart count 0 Dec 7 17:09:45.991: INFO: Container test-container-subpath-preprovisionedpv-8kzx ready: true, restart count 0 Dec 7 17:09:45.991: INFO: liveness-0ec6faa2-e338-4ac1-95f2-623f0e274df1 started at 2022-12-07 17:06:13 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:45.991: INFO: Container agnhost-container ready: true, restart count 0 Dec 7 17:09:45.991: INFO: netserver-3 started at 2022-12-07 17:09:33 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:45.991: INFO: Container webserver ready: true, restart count 0 Dec 7 17:09:45.991: INFO: kube-proxy-nodes-us-east4-a-zc10 started at 2022-12-07 16:49:35 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:45.991: INFO: Container kube-proxy ready: true, restart count 0 Dec 7 17:09:45.991: INFO: calico-node-g8zkr started at 2022-12-07 16:49:35 +0000 UTC (3+1 container statuses recorded) Dec 7 17:09:45.991: INFO: Init container upgrade-ipam ready: true, restart count 0 Dec 7 17:09:45.991: INFO: Init container install-cni ready: true, restart count 0 Dec 7 17:09:45.991: INFO: Init container mount-bpffs ready: true, restart count 0 Dec 7 17:09:45.991: INFO: Container calico-node ready: true, restart count 0 Dec 7 17:09:45.991: INFO: deployment-749564ff97-kh5fs started at 2022-12-07 17:09:41 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:45.991: INFO: Container nginx ready: false, restart count 0 Dec 7 17:09:45.991: INFO: pod-799e2a68-18af-42c0-9061-6ec8297d61c1 started at <nil> (0+0 container statuses recorded) Dec 7 17:09:45.991: INFO: pod-0 started at 2022-12-07 17:08:39 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:45.991: INFO: Container donothing ready: true, restart count 0 Dec 7 17:09:45.991: INFO: pod-2 started at 2022-12-07 17:08:39 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:45.991: INFO: Container donothing ready: true, restart count 0 Dec 7 17:09:45.991: INFO: test-rs-kzb7p started at 2022-12-07 17:09:45 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:45.991: INFO: Container httpd ready: false, restart count 0 Dec 7 17:09:45.991: INFO: csi-gce-pd-node-vtqz7 started at 2022-12-07 16:49:35 +0000 UTC (0+2 container statuses recorded) Dec 7 17:09:45.991: INFO: Container csi-driver-registrar ready: true, restart count 0 Dec 7 17:09:45.991: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 17:09:45.991: INFO: coredns-677fff9cfb-4b88c started at 2022-12-07 16:50:04 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:45.991: INFO: Container coredns ready: true, restart count 0 Dec 7 17:09:45.991: INFO: service-headless-toggled-pdhdf started at 2022-12-07 17:09:18 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:45.991: INFO: Container service-headless-toggled ready: true, restart count 0 Dec 7 17:09:45.991: INFO: busybox-adfee20c-1df5-49f8-a71b-a051fb70e564 started at 2022-12-07 17:08:46 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:45.991: INFO: Container busybox ready: true, restart count 0 Dec 7 17:09:45.991: INFO: verify-service-down-host-exec-pod started at 2022-12-07 17:09:45 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:45.991: INFO: Container agnhost-container ready: false, restart count 0 Dec 7 17:09:45.991: INFO: hostexec-nodes-us-east4-a-zc10-r2g8d started at 2022-12-07 17:09:10 +0000 UTC (0+1 container statuses recorded) Dec 7 17:09:45.991: INFO: Container agnhost-container ready: true, restart count 0 Dec 7 17:09:46.239: INFO: Latency metrics for node nodes-us-east4-a-zc10 Dec 7 17:09:46.239: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP:�[0m Destroying namespace "kubectl-8594" for this suite. �[38;5;243m12/07/22 17:09:46.267�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-network\]\sDNS\sshould\sprovide\sDNS\sfor\spods\sfor\sSubdomain\s\[Conformance\]$'
test/e2e/network/dns_common.go:455 k8s.io/kubernetes/test/e2e/network.assertFilesContain({0xc002b5a300?, 0x8?, 0x8?}, {0x7364f27?, 0x7?}, 0xc0017f7800?, {0x7ca2618?, 0xc002750900?}, 0x0?, {0x0, ...}) test/e2e/network/dns_common.go:455 +0x1dc k8s.io/kubernetes/test/e2e/network.assertFilesExist(...) test/e2e/network/dns_common.go:449 k8s.io/kubernetes/test/e2e/network.validateDNSResults(0xc00090bb80, 0xc0017f7800, {0xc002b5a300, 0x8, 0x8}) test/e2e/network/dns_common.go:512 +0x452 k8s.io/kubernetes/test/e2e/network.glob..func2.8() test/e2e/network/dns.go:324 +0x965from junit_01.xml
{"msg":"FAILED [sig-network] DNS should provide DNS for pods for Subdomain [Conformance]","completed":1,"skipped":29,"failed":1,"failures":["[sig-network] DNS should provide DNS for pods for Subdomain [Conformance]"]} [BeforeEach] [sig-network] DNS test/e2e/framework/framework.go:186 �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m12/07/22 16:53:00.174�[0m Dec 7 16:53:00.174: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP:�[0m Building a namespace api object, basename dns �[38;5;243m12/07/22 16:53:00.175�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m12/07/22 16:53:00.258�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m12/07/22 16:53:00.309�[0m [It] should provide DNS for pods for Subdomain [Conformance] test/e2e/network/dns.go:290 �[1mSTEP:�[0m Creating a test headless service �[38;5;243m12/07/22 16:53:00.362�[0m �[1mSTEP:�[0m Running these commands on wheezy: for i in `seq 1 600`; do check="$$(dig +notcp +noall +answer +search dns-querier-2.dns-test-service-2.dns-9942.svc.cluster.local A)" && test -n "$$check" && echo OK > /results/wheezy_udp@dns-querier-2.dns-test-service-2.dns-9942.svc.cluster.local;check="$$(dig +tcp +noall +answer +search dns-querier-2.dns-test-service-2.dns-9942.svc.cluster.local A)" && test -n "$$check" && echo OK > /results/wheezy_tcp@dns-querier-2.dns-test-service-2.dns-9942.svc.cluster.local;check="$$(dig +notcp +noall +answer +search dns-test-service-2.dns-9942.svc.cluster.local A)" && test -n "$$check" && echo OK > /results/wheezy_udp@dns-test-service-2.dns-9942.svc.cluster.local;check="$$(dig +tcp +noall +answer +search dns-test-service-2.dns-9942.svc.cluster.local A)" && test -n "$$check" && echo OK > /results/wheezy_tcp@dns-test-service-2.dns-9942.svc.cluster.local;sleep 1; done �[38;5;243m12/07/22 16:53:00.397�[0m �[1mSTEP:�[0m Running these commands on jessie: for i in `seq 1 600`; do check="$$(dig +notcp +noall +answer +search dns-querier-2.dns-test-service-2.dns-9942.svc.cluster.local A)" && test -n "$$check" && echo OK > /results/jessie_udp@dns-querier-2.dns-test-service-2.dns-9942.svc.cluster.local;check="$$(dig +tcp +noall +answer +search dns-querier-2.dns-test-service-2.dns-9942.svc.cluster.local A)" && test -n "$$check" && echo OK > /results/jessie_tcp@dns-querier-2.dns-test-service-2.dns-9942.svc.cluster.local;check="$$(dig +notcp +noall +answer +search dns-test-service-2.dns-9942.svc.cluster.local A)" && test -n "$$check" && echo OK > /results/jessie_udp@dns-test-service-2.dns-9942.svc.cluster.local;check="$$(dig +tcp +noall +answer +search dns-test-service-2.dns-9942.svc.cluster.local A)" && test -n "$$check" && echo OK > /results/jessie_tcp@dns-test-service-2.dns-9942.svc.cluster.local;sleep 1; done �[38;5;243m12/07/22 16:53:00.397�[0m �[1mSTEP:�[0m creating a pod to probe DNS �[38;5;243m12/07/22 16:53:00.397�[0m �[1mSTEP:�[0m submitting the pod to kubernetes �[38;5;243m12/07/22 16:53:00.397�[0m Dec 7 16:53:00.446: INFO: Waiting up to 15m0s for pod "dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4" in namespace "dns-9942" to be "running" Dec 7 16:53:00.474: INFO: Pod "dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4": Phase="Pending", Reason="", readiness=false. Elapsed: 27.628236ms Dec 7 16:53:02.507: INFO: Pod "dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4": Phase="Pending", Reason="", readiness=false. Elapsed: 2.060970362s Dec 7 16:53:04.503: INFO: Pod "dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4": Phase="Pending", Reason="", readiness=false. Elapsed: 4.057217148s Dec 7 16:53:06.501: INFO: Pod "dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4": Phase="Pending", Reason="", readiness=false. Elapsed: 6.055224437s Dec 7 16:53:08.502: INFO: Pod "dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4": Phase="Pending", Reason="", readiness=false. Elapsed: 8.055371124s Dec 7 16:53:10.506: INFO: Pod "dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4": Phase="Pending", Reason="", readiness=false. Elapsed: 10.059307065s Dec 7 16:53:12.508: INFO: Pod "dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4": Phase="Pending", Reason="", readiness=false. Elapsed: 12.061432487s Dec 7 16:53:14.533: INFO: Pod "dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4": Phase="Running", Reason="", readiness=true. Elapsed: 14.086739442s Dec 7 16:53:14.533: INFO: Pod "dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4" satisfied condition "running" �[1mSTEP:�[0m retrieving the pod �[38;5;243m12/07/22 16:53:14.533�[0m �[1mSTEP:�[0m looking for the results for each expected name from probers �[38;5;243m12/07/22 16:53:14.576�[0m Dec 7 16:53:44.603: INFO: Unable to read wheezy_udp@dns-querier-2.dns-test-service-2.dns-9942.svc.cluster.local from pod dns-9942/dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: the server is currently unable to handle the request (get pods dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4) Dec 7 16:54:14.632: INFO: Unable to read wheezy_tcp@dns-querier-2.dns-test-service-2.dns-9942.svc.cluster.local from pod dns-9942/dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: the server is currently unable to handle the request (get pods dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4) Dec 7 16:54:44.661: INFO: Unable to read wheezy_udp@dns-test-service-2.dns-9942.svc.cluster.local from pod dns-9942/dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: the server is currently unable to handle the request (get pods dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4) Dec 7 16:55:14.695: INFO: Unable to read wheezy_tcp@dns-test-service-2.dns-9942.svc.cluster.local from pod dns-9942/dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: the server is currently unable to handle the request (get pods dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4) Dec 7 16:55:44.756: INFO: Unable to read jessie_udp@dns-querier-2.dns-test-service-2.dns-9942.svc.cluster.local from pod dns-9942/dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: the server is currently unable to handle the request (get pods dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4) Dec 7 16:56:14.875: INFO: Unable to read jessie_tcp@dns-querier-2.dns-test-service-2.dns-9942.svc.cluster.local from pod dns-9942/dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: the server is currently unable to handle the request (get pods dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4) Dec 7 16:56:44.904: INFO: Unable to read jessie_udp@dns-test-service-2.dns-9942.svc.cluster.local from pod dns-9942/dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: the server is currently unable to handle the request (get pods dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4) Dec 7 16:57:14.938: INFO: Unable to read jessie_tcp@dns-test-service-2.dns-9942.svc.cluster.local from pod dns-9942/dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: the server is currently unable to handle the request (get pods dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4) Dec 7 16:57:14.938: INFO: Lookups using dns-9942/dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4 failed for: [wheezy_udp@dns-querier-2.dns-test-service-2.dns-9942.svc.cluster.local wheezy_tcp@dns-querier-2.dns-test-service-2.dns-9942.svc.cluster.local wheezy_udp@dns-test-service-2.dns-9942.svc.cluster.local wheezy_tcp@dns-test-service-2.dns-9942.svc.cluster.local jessie_udp@dns-querier-2.dns-test-service-2.dns-9942.svc.cluster.local jessie_tcp@dns-querier-2.dns-test-service-2.dns-9942.svc.cluster.local jessie_udp@dns-test-service-2.dns-9942.svc.cluster.local jessie_tcp@dns-test-service-2.dns-9942.svc.cluster.local] Dec 7 16:57:49.979: INFO: Unable to read wheezy_udp@dns-querier-2.dns-test-service-2.dns-9942.svc.cluster.local from pod dns-9942/dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: the server is currently unable to handle the request (get pods dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4) Dec 7 16:58:20.039: INFO: Unable to read wheezy_tcp@dns-querier-2.dns-test-service-2.dns-9942.svc.cluster.local from pod dns-9942/dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: the server is currently unable to handle the request (get pods dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4) Dec 7 16:58:50.075: INFO: Unable to read wheezy_udp@dns-test-service-2.dns-9942.svc.cluster.local from pod dns-9942/dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: the server is currently unable to handle the request (get pods dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4) Dec 7 16:59:20.125: INFO: Unable to read wheezy_tcp@dns-test-service-2.dns-9942.svc.cluster.local from pod dns-9942/dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: the server is currently unable to handle the request (get pods dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4) Dec 7 16:59:50.186: INFO: Unable to read jessie_udp@dns-querier-2.dns-test-service-2.dns-9942.svc.cluster.local from pod dns-9942/dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: the server is currently unable to handle the request (get pods dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4) Dec 7 17:00:20.279: INFO: Unable to read jessie_tcp@dns-querier-2.dns-test-service-2.dns-9942.svc.cluster.local from pod dns-9942/dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: the server is currently unable to handle the request (get pods dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4) Dec 7 17:00:50.490: INFO: Unable to read jessie_udp@dns-test-service-2.dns-9942.svc.cluster.local from pod dns-9942/dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: the server is currently unable to handle the request (get pods dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4) Dec 7 17:01:20.540: INFO: Unable to read jessie_tcp@dns-test-service-2.dns-9942.svc.cluster.local from pod dns-9942/dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: the server is currently unable to handle the request (get pods dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4) Dec 7 17:01:20.540: INFO: Lookups using dns-9942/dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4 failed for: [wheezy_udp@dns-querier-2.dns-test-service-2.dns-9942.svc.cluster.local wheezy_tcp@dns-querier-2.dns-test-service-2.dns-9942.svc.cluster.local wheezy_udp@dns-test-service-2.dns-9942.svc.cluster.local wheezy_tcp@dns-test-service-2.dns-9942.svc.cluster.local jessie_udp@dns-querier-2.dns-test-service-2.dns-9942.svc.cluster.local jessie_tcp@dns-querier-2.dns-test-service-2.dns-9942.svc.cluster.local jessie_udp@dns-test-service-2.dns-9942.svc.cluster.local jessie_tcp@dns-test-service-2.dns-9942.svc.cluster.local] Dec 7 17:01:54.967: INFO: Unable to read wheezy_udp@dns-querier-2.dns-test-service-2.dns-9942.svc.cluster.local from pod dns-9942/dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: the server is currently unable to handle the request (get pods dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4) Dec 7 17:02:25.022: INFO: Unable to read wheezy_tcp@dns-querier-2.dns-test-service-2.dns-9942.svc.cluster.local from pod dns-9942/dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: the server is currently unable to handle the request (get pods dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4) Dec 7 17:02:55.094: INFO: Unable to read wheezy_udp@dns-test-service-2.dns-9942.svc.cluster.local from pod dns-9942/dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: the server is currently unable to handle the request (get pods dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4) Dec 7 17:03:25.133: INFO: Unable to read wheezy_tcp@dns-test-service-2.dns-9942.svc.cluster.local from pod dns-9942/dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: the server is currently unable to handle the request (get pods dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4) Dec 7 17:03:55.160: INFO: Unable to read jessie_udp@dns-querier-2.dns-test-service-2.dns-9942.svc.cluster.local from pod dns-9942/dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: the server is currently unable to handle the request (get pods dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4) Dec 7 17:04:25.189: INFO: Unable to read jessie_tcp@dns-querier-2.dns-test-service-2.dns-9942.svc.cluster.local from pod dns-9942/dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: the server is currently unable to handle the request (get pods dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4) Dec 7 17:04:55.230: INFO: Unable to read jessie_udp@dns-test-service-2.dns-9942.svc.cluster.local from pod dns-9942/dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: the server is currently unable to handle the request (get pods dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4) Dec 7 17:05:25.301: INFO: Unable to read jessie_tcp@dns-test-service-2.dns-9942.svc.cluster.local from pod dns-9942/dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: the server is currently unable to handle the request (get pods dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4) Dec 7 17:05:25.301: INFO: Lookups using dns-9942/dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4 failed for: [wheezy_udp@dns-querier-2.dns-test-service-2.dns-9942.svc.cluster.local wheezy_tcp@dns-querier-2.dns-test-service-2.dns-9942.svc.cluster.local wheezy_udp@dns-test-service-2.dns-9942.svc.cluster.local wheezy_tcp@dns-test-service-2.dns-9942.svc.cluster.local jessie_udp@dns-querier-2.dns-test-service-2.dns-9942.svc.cluster.local jessie_tcp@dns-querier-2.dns-test-service-2.dns-9942.svc.cluster.local jessie_udp@dns-test-service-2.dns-9942.svc.cluster.local jessie_tcp@dns-test-service-2.dns-9942.svc.cluster.local] Dec 7 17:06:00.028: INFO: Unable to read wheezy_udp@dns-querier-2.dns-test-service-2.dns-9942.svc.cluster.local from pod dns-9942/dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: the server is currently unable to handle the request (get pods dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4) Dec 7 17:06:30.056: INFO: Unable to read wheezy_tcp@dns-querier-2.dns-test-service-2.dns-9942.svc.cluster.local from pod dns-9942/dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: the server is currently unable to handle the request (get pods dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4) Dec 7 17:07:00.084: INFO: Unable to read wheezy_udp@dns-test-service-2.dns-9942.svc.cluster.local from pod dns-9942/dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: the server is currently unable to handle the request (get pods dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4) Dec 7 17:07:30.123: INFO: Unable to read wheezy_tcp@dns-test-service-2.dns-9942.svc.cluster.local from pod dns-9942/dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: the server is currently unable to handle the request (get pods dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4) Dec 7 17:08:00.248: INFO: Unable to read jessie_udp@dns-querier-2.dns-test-service-2.dns-9942.svc.cluster.local from pod dns-9942/dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: the server is currently unable to handle the request (get pods dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4) Dec 7 17:08:30.280: INFO: Unable to read jessie_tcp@dns-querier-2.dns-test-service-2.dns-9942.svc.cluster.local from pod dns-9942/dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: the server is currently unable to handle the request (get pods dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4) Dec 7 17:09:00.319: INFO: Unable to read jessie_udp@dns-test-service-2.dns-9942.svc.cluster.local from pod dns-9942/dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: the server is currently unable to handle the request (get pods dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4) Dec 7 17:09:30.349: INFO: Unable to read jessie_tcp@dns-test-service-2.dns-9942.svc.cluster.local from pod dns-9942/dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: the server is currently unable to handle the request (get pods dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4) Dec 7 17:09:30.349: INFO: Lookups using dns-9942/dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4 failed for: [wheezy_udp@dns-querier-2.dns-test-service-2.dns-9942.svc.cluster.local wheezy_tcp@dns-querier-2.dns-test-service-2.dns-9942.svc.cluster.local wheezy_udp@dns-test-service-2.dns-9942.svc.cluster.local wheezy_tcp@dns-test-service-2.dns-9942.svc.cluster.local jessie_udp@dns-querier-2.dns-test-service-2.dns-9942.svc.cluster.local jessie_tcp@dns-querier-2.dns-test-service-2.dns-9942.svc.cluster.local jessie_udp@dns-test-service-2.dns-9942.svc.cluster.local jessie_tcp@dns-test-service-2.dns-9942.svc.cluster.local] Dec 7 17:10:00.377: INFO: Unable to read wheezy_udp@dns-querier-2.dns-test-service-2.dns-9942.svc.cluster.local from pod dns-9942/dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: the server is currently unable to handle the request (get pods dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4) Dec 7 17:10:30.404: INFO: Unable to read wheezy_tcp@dns-querier-2.dns-test-service-2.dns-9942.svc.cluster.local from pod dns-9942/dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: the server is currently unable to handle the request (get pods dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4) Dec 7 17:11:00.432: INFO: Unable to read wheezy_udp@dns-test-service-2.dns-9942.svc.cluster.local from pod dns-9942/dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: the server is currently unable to handle the request (get pods dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4) Dec 7 17:11:30.462: INFO: Unable to read wheezy_tcp@dns-test-service-2.dns-9942.svc.cluster.local from pod dns-9942/dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: the server is currently unable to handle the request (get pods dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4) Dec 7 17:12:00.492: INFO: Unable to read jessie_udp@dns-querier-2.dns-test-service-2.dns-9942.svc.cluster.local from pod dns-9942/dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: the server is currently unable to handle the request (get pods dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4) Dec 7 17:12:30.520: INFO: Unable to read jessie_tcp@dns-querier-2.dns-test-service-2.dns-9942.svc.cluster.local from pod dns-9942/dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: the server is currently unable to handle the request (get pods dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4) Dec 7 17:13:00.554: INFO: Unable to read jessie_udp@dns-test-service-2.dns-9942.svc.cluster.local from pod dns-9942/dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: the server is currently unable to handle the request (get pods dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4) Dec 7 17:13:30.583: INFO: Unable to read jessie_tcp@dns-test-service-2.dns-9942.svc.cluster.local from pod dns-9942/dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: the server is currently unable to handle the request (get pods dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4) Dec 7 17:13:30.583: INFO: Lookups using dns-9942/dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4 failed for: [wheezy_udp@dns-querier-2.dns-test-service-2.dns-9942.svc.cluster.local wheezy_tcp@dns-querier-2.dns-test-service-2.dns-9942.svc.cluster.local wheezy_udp@dns-test-service-2.dns-9942.svc.cluster.local wheezy_tcp@dns-test-service-2.dns-9942.svc.cluster.local jessie_udp@dns-querier-2.dns-test-service-2.dns-9942.svc.cluster.local jessie_tcp@dns-querier-2.dns-test-service-2.dns-9942.svc.cluster.local jessie_udp@dns-test-service-2.dns-9942.svc.cluster.local jessie_tcp@dns-test-service-2.dns-9942.svc.cluster.local] Dec 7 17:13:30.583: INFO: Unexpected error: <*errors.errorString | 0xc00023d8b0>: { s: "timed out waiting for the condition", } Dec 7 17:13:30.583: FAIL: timed out waiting for the condition Full Stack Trace k8s.io/kubernetes/test/e2e/network.assertFilesContain({0xc002b5a300?, 0x8?, 0x8?}, {0x7364f27?, 0x7?}, 0xc0017f7800?, {0x7ca2618?, 0xc002750900?}, 0x0?, {0x0, ...}) test/e2e/network/dns_common.go:455 +0x1dc k8s.io/kubernetes/test/e2e/network.assertFilesExist(...) test/e2e/network/dns_common.go:449 k8s.io/kubernetes/test/e2e/network.validateDNSResults(0xc00090bb80, 0xc0017f7800, {0xc002b5a300, 0x8, 0x8}) test/e2e/network/dns_common.go:512 +0x452 k8s.io/kubernetes/test/e2e/network.glob..func2.8() test/e2e/network/dns.go:324 +0x965 �[1mSTEP:�[0m deleting the pod �[38;5;243m12/07/22 17:13:30.583�[0m �[1mSTEP:�[0m deleting the test headless service �[38;5;243m12/07/22 17:13:30.633�[0m [AfterEach] [sig-network] DNS test/e2e/framework/framework.go:187 �[1mSTEP:�[0m Collecting events from namespace "dns-9942". �[38;5;243m12/07/22 17:13:30.692�[0m �[1mSTEP:�[0m Found 15 events. �[38;5;243m12/07/22 17:13:30.723�[0m Dec 7 17:13:30.723: INFO: At 2022-12-07 16:53:00 +0000 UTC - event for dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: {default-scheduler } Scheduled: Successfully assigned dns-9942/dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4 to nodes-us-east4-a-nfxp Dec 7 17:13:30.723: INFO: At 2022-12-07 16:53:02 +0000 UTC - event for dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: {kubelet nodes-us-east4-a-nfxp} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.40" already present on machine Dec 7 17:13:30.723: INFO: At 2022-12-07 16:53:02 +0000 UTC - event for dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: {kubelet nodes-us-east4-a-nfxp} Created: Created container webserver Dec 7 17:13:30.723: INFO: At 2022-12-07 16:53:02 +0000 UTC - event for dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: {kubelet nodes-us-east4-a-nfxp} Started: Started container webserver Dec 7 17:13:30.723: INFO: At 2022-12-07 16:53:02 +0000 UTC - event for dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: {kubelet nodes-us-east4-a-nfxp} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.40" already present on machine Dec 7 17:13:30.723: INFO: At 2022-12-07 16:53:02 +0000 UTC - event for dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: {kubelet nodes-us-east4-a-nfxp} Created: Created container querier Dec 7 17:13:30.723: INFO: At 2022-12-07 16:53:02 +0000 UTC - event for dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: {kubelet nodes-us-east4-a-nfxp} Started: Started container querier Dec 7 17:13:30.723: INFO: At 2022-12-07 16:53:02 +0000 UTC - event for dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: {kubelet nodes-us-east4-a-nfxp} Pulling: Pulling image "registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5" Dec 7 17:13:30.723: INFO: At 2022-12-07 16:53:10 +0000 UTC - event for dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: {kubelet nodes-us-east4-a-nfxp} Pulled: Successfully pulled image "registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5" in 7.616092614s Dec 7 17:13:30.723: INFO: At 2022-12-07 16:53:10 +0000 UTC - event for dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: {kubelet nodes-us-east4-a-nfxp} Created: Created container jessie-querier Dec 7 17:13:30.723: INFO: At 2022-12-07 16:53:10 +0000 UTC - event for dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: {kubelet nodes-us-east4-a-nfxp} Started: Started container jessie-querier Dec 7 17:13:30.723: INFO: At 2022-12-07 17:04:38 +0000 UTC - event for dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: {kubelet nodes-us-east4-a-nfxp} Pulled: Container image "registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5" already present on machine Dec 7 17:13:30.723: INFO: At 2022-12-07 17:13:30 +0000 UTC - event for dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: {kubelet nodes-us-east4-a-nfxp} Killing: Stopping container webserver Dec 7 17:13:30.723: INFO: At 2022-12-07 17:13:30 +0000 UTC - event for dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: {kubelet nodes-us-east4-a-nfxp} Killing: Stopping container querier Dec 7 17:13:30.723: INFO: At 2022-12-07 17:13:30 +0000 UTC - event for dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4: {kubelet nodes-us-east4-a-nfxp} Killing: Stopping container jessie-querier Dec 7 17:13:30.751: INFO: POD NODE PHASE GRACE CONDITIONS Dec 7 17:13:30.751: INFO: Dec 7 17:13:30.804: INFO: Logging node info for node control-plane-us-east4-a-vd91 Dec 7 17:13:30.834: INFO: Node Info: &Node{ObjectMeta:{control-plane-us-east4-a-vd91 74d54d8e-e0bc-4c7d-bf3c-5b66ce025930 51325 0 2022-12-07 16:47:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-standard-2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east4 failure-domain.beta.kubernetes.io/zone:us-east4-a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:control-plane-us-east4-a-vd91 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node-role.kubernetes.io/node: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:e2-standard-2 topology.gke.io/zone:us-east4-a topology.kubernetes.io/region:us-east4 topology.kubernetes.io/zone:us-east4-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/instances/control-plane-us-east4-a-vd91"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.5/32 projectcalico.org/IPv4IPIPTunnelAddr:100.101.18.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-12-07 16:47:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2022-12-07 16:48:18 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {calico-node Update v1 2022-12-07 16:48:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}}}}} status} {cloud-controller-manager Update v1 2022-12-07 16:48:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2022-12-07 16:48:34 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:48:39 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:48:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-12-07 17:09:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:gce://gce-gci-upg-lat-1-3-ctl-skew/us-east4-a/control-plane-us-east4-a-vd91,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8332767232 0} {<nil>} 8137468Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8227909632 0} {<nil>} 8035068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-07 16:48:39 +0000 UTC,LastTransitionTime:2022-12-07 16:48:39 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-07 17:09:22 +0000 UTC,LastTransitionTime:2022-12-07 16:47:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-07 17:09:22 +0000 UTC,LastTransitionTime:2022-12-07 16:47:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-07 17:09:22 +0000 UTC,LastTransitionTime:2022-12-07 16:47:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-07 17:09:22 +0000 UTC,LastTransitionTime:2022-12-07 16:48:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.5,},NodeAddress{Type:ExternalIP,Address:35.245.23.229,},NodeAddress{Type:Hostname,Address:control-plane-us-east4-a-vd91,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e32750d839dd77bbe79d8a1be267141a,SystemUUID:e32750d8-39dd-77bb-e79d-8a1be267141a,BootID:572b6367-72b8-4ea4-b559-5c84c54662ce,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gcr.io/k8s-staging-etcdadm/etcd-manager@sha256:f3a63853502cb3956fa708fea524be3b333036ebc1cd1dadd81abd9f1fe61043 gcr.io/k8s-staging-etcdadm/etcd-manager:v3.0.20220831-21-g12041b4c],SizeBytes:231516108,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.25.4],SizeBytes:129085904,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.25.4],SizeBytes:118436153,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.4],SizeBytes:63279305,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.25.4],SizeBytes:51921208,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-alpha.2],SizeBytes:42203406,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-alpha.2],SizeBytes:41463710,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:2b6acd7f677f76ffe12ecf3ea7df92eb9b1bdb07336d1ac2a54c7631fb753f7e docker.io/calico/kube-controllers:v3.24.5],SizeBytes:31137169,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2 registry.k8s.io/sig-storage/csi-provisioner:v2.1.0],SizeBytes:21205045,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:50c3cfd458fc8e0bf3c8c521eac39172009382fc66dc5044a330d137c6ed0b09 registry.k8s.io/sig-storage/csi-attacher:v3.1.0],SizeBytes:20103959,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a registry.k8s.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:9af9bf28430b00a0cedeb2ec29acadce45e6afcecd8bdf31c793c624cfa75fa7 registry.k8s.io/sig-storage/csi-snapshotter:v3.0.3],SizeBytes:19500777,},ContainerImage{Names:[docker.io/k8scloudprovidergcp/cloud-controller-manager@sha256:881fd1095937638040723973ade90e6700f1c831a78fb585a3227c4d021b0df9 docker.io/k8scloudprovidergcp/cloud-controller-manager:latest],SizeBytes:18702875,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-alpha.2],SizeBytes:4954573,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 7 17:13:30.835: INFO: Logging kubelet events for node control-plane-us-east4-a-vd91 Dec 7 17:13:30.868: INFO: Logging pods the kubelet thinks is on node control-plane-us-east4-a-vd91 Dec 7 17:13:30.937: INFO: calico-node-zgvgx started at 2022-12-07 16:48:06 +0000 UTC (3+1 container statuses recorded) Dec 7 17:13:30.937: INFO: Init container upgrade-ipam ready: true, restart count 0 Dec 7 17:13:30.937: INFO: Init container install-cni ready: true, restart count 0 Dec 7 17:13:30.937: INFO: Init container mount-bpffs ready: true, restart count 0 Dec 7 17:13:30.937: INFO: Container calico-node ready: true, restart count 0 Dec 7 17:13:30.937: INFO: calico-kube-controllers-7bc879d8d6-t4vrx started at 2022-12-07 16:48:39 +0000 UTC (0+1 container statuses recorded) Dec 7 17:13:30.937: INFO: Container calico-kube-controllers ready: true, restart count 0 Dec 7 17:13:30.937: INFO: kube-scheduler-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+1 container statuses recorded) Dec 7 17:13:30.937: INFO: Container kube-scheduler ready: true, restart count 0 Dec 7 17:13:30.937: INFO: etcd-manager-main-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+1 container statuses recorded) Dec 7 17:13:30.937: INFO: Container etcd-manager ready: true, restart count 0 Dec 7 17:13:30.937: INFO: kube-apiserver-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+2 container statuses recorded) Dec 7 17:13:30.937: INFO: Container healthcheck ready: true, restart count 0 Dec 7 17:13:30.937: INFO: Container kube-apiserver ready: true, restart count 1 Dec 7 17:13:30.937: INFO: csi-gce-pd-controller-689c9f4444-b5qql started at 2022-12-07 16:48:18 +0000 UTC (0+5 container statuses recorded) Dec 7 17:13:30.937: INFO: Container csi-attacher ready: true, restart count 0 Dec 7 17:13:30.937: INFO: Container csi-provisioner ready: true, restart count 0 Dec 7 17:13:30.937: INFO: Container csi-resizer ready: true, restart count 0 Dec 7 17:13:30.937: INFO: Container csi-snapshotter ready: true, restart count 0 Dec 7 17:13:30.937: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 17:13:30.937: INFO: etcd-manager-events-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+1 container statuses recorded) Dec 7 17:13:30.937: INFO: Container etcd-manager ready: true, restart count 0 Dec 7 17:13:30.937: INFO: kube-controller-manager-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+1 container statuses recorded) Dec 7 17:13:30.937: INFO: Container kube-controller-manager ready: true, restart count 2 Dec 7 17:13:30.937: INFO: dns-controller-8946976bb-6t8hj started at 2022-12-07 16:48:19 +0000 UTC (0+1 container statuses recorded) Dec 7 17:13:30.937: INFO: Container dns-controller ready: true, restart count 0 Dec 7 17:13:30.937: INFO: kube-proxy-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+1 container statuses recorded) Dec 7 17:13:30.937: INFO: Container kube-proxy ready: true, restart count 0 Dec 7 17:13:30.937: INFO: csi-gce-pd-node-z9fsn started at 2022-12-07 16:48:06 +0000 UTC (0+2 container statuses recorded) Dec 7 17:13:30.937: INFO: Container csi-driver-registrar ready: true, restart count 0 Dec 7 17:13:30.937: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 17:13:30.937: INFO: kops-controller-mnn6f started at 2022-12-07 16:48:18 +0000 UTC (0+1 container statuses recorded) Dec 7 17:13:30.937: INFO: Container kops-controller ready: true, restart count 0 Dec 7 17:13:30.937: INFO: cloud-controller-manager-xd6xh started at 2022-12-07 16:48:18 +0000 UTC (0+1 container statuses recorded) Dec 7 17:13:30.937: INFO: Container cloud-controller-manager ready: true, restart count 0 Dec 7 17:13:31.101: INFO: Latency metrics for node control-plane-us-east4-a-vd91 Dec 7 17:13:31.101: INFO: Logging node info for node nodes-us-east4-a-5680 Dec 7 17:13:31.131: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east4-a-5680 b9473b45-598f-43c3-aafc-dc872ade1274 53275 0 2022-12-07 16:49:31 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east4 failure-domain.beta.kubernetes.io/zone:us-east4-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east4-a-5680 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east4-a topology.hostpath.csi/node:nodes-us-east4-a-5680 topology.kubernetes.io/region:us-east4 topology.kubernetes.io/zone:us-east4-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/instances/nodes-us-east4-a-5680"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.3/32 projectcalico.org/IPv4IPIPTunnelAddr:100.119.115.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2022-12-07 16:49:31 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2022-12-07 16:49:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2022-12-07 16:49:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:49:41 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:49:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {calico-node Update v1 2022-12-07 16:49:59 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2022-12-07 17:10:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:gce://gce-gci-upg-lat-1-3-ctl-skew/us-east4-a/nodes-us-east4-a-5680,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-07 16:49:58 +0000 UTC,LastTransitionTime:2022-12-07 16:49:58 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-07 17:09:58 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-07 17:09:58 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-07 17:09:58 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-07 17:09:58 +0000 UTC,LastTransitionTime:2022-12-07 16:49:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.3,},NodeAddress{Type:ExternalIP,Address:34.86.83.231,},NodeAddress{Type:Hostname,Address:nodes-us-east4-a-5680,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:5676434e0327952eef9a8130969e32db,SystemUUID:5676434e-0327-952e-ef9a-8130969e32db,BootID:f4cd280b-a7ea-43c2-b78f-d43fab064010,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.4],SizeBytes:63279305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:51155161,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 registry.k8s.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 7 17:13:31.132: INFO: Logging kubelet events for node nodes-us-east4-a-5680 Dec 7 17:13:31.163: INFO: Logging pods the kubelet thinks is on node nodes-us-east4-a-5680 Dec 7 17:13:31.206: INFO: calico-node-wvpd9 started at 2022-12-07 16:49:34 +0000 UTC (3+1 container statuses recorded) Dec 7 17:13:31.206: INFO: Init container upgrade-ipam ready: true, restart count 0 Dec 7 17:13:31.206: INFO: Init container install-cni ready: true, restart count 0 Dec 7 17:13:31.206: INFO: Init container mount-bpffs ready: true, restart count 0 Dec 7 17:13:31.206: INFO: Container calico-node ready: true, restart count 0 Dec 7 17:13:31.206: INFO: kube-proxy-nodes-us-east4-a-5680 started at 2022-12-07 16:49:34 +0000 UTC (0+1 container statuses recorded) Dec 7 17:13:31.206: INFO: Container kube-proxy ready: true, restart count 0 Dec 7 17:13:31.206: INFO: csi-gce-pd-node-9n22s started at 2022-12-07 16:49:34 +0000 UTC (0+2 container statuses recorded) Dec 7 17:13:31.206: INFO: Container csi-driver-registrar ready: true, restart count 0 Dec 7 17:13:31.206: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 17:13:31.380: INFO: Latency metrics for node nodes-us-east4-a-5680 Dec 7 17:13:31.380: INFO: Logging node info for node nodes-us-east4-a-nfxp Dec 7 17:13:31.408: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east4-a-nfxp 958029bf-d66a-424c-a80d-b1d485df133b 53969 0 2022-12-07 16:49:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east4 failure-domain.beta.kubernetes.io/zone:us-east4-a io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east4-a-nfxp kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east4-a topology.hostpath.csi/node:nodes-us-east4-a-nfxp topology.kubernetes.io/region:us-east4 topology.kubernetes.io/zone:us-east4-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/instances/nodes-us-east4-a-nfxp"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.6/32 projectcalico.org/IPv4IPIPTunnelAddr:100.113.109.192 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2022-12-07 16:49:28 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2022-12-07 16:49:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2022-12-07 16:49:29 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:49:41 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:49:48 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {calico-node Update v1 2022-12-07 16:49:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2022-12-07 17:11:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:gce://gce-gci-upg-lat-1-3-ctl-skew/us-east4-a/nodes-us-east4-a-nfxp,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-07 16:49:53 +0000 UTC,LastTransitionTime:2022-12-07 16:49:53 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-07 17:08:34 +0000 UTC,LastTransitionTime:2022-12-07 16:49:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-07 17:08:34 +0000 UTC,LastTransitionTime:2022-12-07 16:49:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-07 17:08:34 +0000 UTC,LastTransitionTime:2022-12-07 16:49:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-07 17:08:34 +0000 UTC,LastTransitionTime:2022-12-07 16:49:48 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.6,},NodeAddress{Type:ExternalIP,Address:34.145.242.1,},NodeAddress{Type:Hostname,Address:nodes-us-east4-a-nfxp,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:796e3b73d867da488abd70a5df2fe10f,SystemUUID:796e3b73-d867-da48-8abd-70a5df2fe10f,BootID:2b784aad-5897-4bb4-bb49-6bae545d9488,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:b83c1d70989e1fe87583607bf5aee1ee34e52773d4755b95f5cf5a451962f3a4 registry.k8s.io/etcd:3.5.5-0],SizeBytes:102417044,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.4],SizeBytes:63279305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:51155161,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:f9c93b92b6ff750b41a93c4e4fe0bfe384597aeb841e2539d5444815c55b2d8f registry.k8s.io/e2e-test-images/sample-apiserver:1.17.5],SizeBytes:24316368,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:aa60f453d64dfb3c3fd9e7306f988c36c6352c4f2d956aa90467f2808091effa registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.5],SizeBytes:15209420,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:38e6b091d238094f081efad3e2b362e6480b2156f5f4fba6ea46835ecdcd47e2 registry.k8s.io/build-image/distroless-iptables:v0.1.1],SizeBytes:7634231,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:7000509,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 7 17:13:31.409: INFO: Logging kubelet events for node nodes-us-east4-a-nfxp Dec 7 17:13:31.440: INFO: Logging pods the kubelet thinks is on node nodes-us-east4-a-nfxp Dec 7 17:13:31.484: INFO: csi-gce-pd-node-vcz5x started at 2022-12-07 16:49:29 +0000 UTC (0+2 container statuses recorded) Dec 7 17:13:31.484: INFO: Container csi-driver-registrar ready: true, restart count 0 Dec 7 17:13:31.484: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 17:13:31.484: INFO: calico-node-f2cxs started at 2022-12-07 16:49:29 +0000 UTC (3+1 container statuses recorded) Dec 7 17:13:31.484: INFO: Init container upgrade-ipam ready: true, restart count 0 Dec 7 17:13:31.484: INFO: Init container install-cni ready: true, restart count 0 Dec 7 17:13:31.484: INFO: Init container mount-bpffs ready: true, restart count 0 Dec 7 17:13:31.484: INFO: Container calico-node ready: true, restart count 0 Dec 7 17:13:31.484: INFO: coredns-677fff9cfb-rv6b9 started at 2022-12-07 16:49:48 +0000 UTC (0+1 container statuses recorded) Dec 7 17:13:31.484: INFO: Container coredns ready: true, restart count 0 Dec 7 17:13:31.484: INFO: coredns-autoscaler-db7b97744-2cf6q started at 2022-12-07 16:49:48 +0000 UTC (0+1 container statuses recorded) Dec 7 17:13:31.484: INFO: Container autoscaler ready: true, restart count 0 Dec 7 17:13:31.484: INFO: agnhost started at 2022-12-07 17:04:12 +0000 UTC (0+1 container statuses recorded) Dec 7 17:13:31.484: INFO: Container agnhost ready: true, restart count 0 Dec 7 17:13:31.484: INFO: kube-proxy-nodes-us-east4-a-nfxp started at 2022-12-07 16:49:29 +0000 UTC (0+1 container statuses recorded) Dec 7 17:13:31.484: INFO: Container kube-proxy ready: true, restart count 0 Dec 7 17:13:31.658: INFO: Latency metrics for node nodes-us-east4-a-nfxp Dec 7 17:13:31.658: INFO: Logging node info for node nodes-us-east4-a-v6tj Dec 7 17:13:31.687: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east4-a-v6tj 7ccb4554-dd50-4efe-9be3-d3667475ec25 53845 0 2022-12-07 16:49:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east4 failure-domain.beta.kubernetes.io/zone:us-east4-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east4-a-v6tj kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east4-a topology.hostpath.csi/node:nodes-us-east4-a-v6tj topology.kubernetes.io/region:us-east4 topology.kubernetes.io/zone:us-east4-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/instances/nodes-us-east4-a-v6tj"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.2/32 projectcalico.org/IPv4IPIPTunnelAddr:100.123.60.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2022-12-07 16:49:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2022-12-07 16:49:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2022-12-07 16:49:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:49:49 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:49:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {calico-node Update v1 2022-12-07 16:50:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2022-12-07 17:10:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:gce://gce-gci-upg-lat-1-3-ctl-skew/us-east4-a/nodes-us-east4-a-v6tj,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111196160 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006338560 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-07 16:49:59 +0000 UTC,LastTransitionTime:2022-12-07 16:49:59 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-07 17:10:04 +0000 UTC,LastTransitionTime:2022-12-07 16:49:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-07 17:10:04 +0000 UTC,LastTransitionTime:2022-12-07 16:49:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-07 17:10:04 +0000 UTC,LastTransitionTime:2022-12-07 16:49:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-07 17:10:04 +0000 UTC,LastTransitionTime:2022-12-07 16:49:55 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.2,},NodeAddress{Type:ExternalIP,Address:35.245.137.186,},NodeAddress{Type:Hostname,Address:nodes-us-east4-a-v6tj,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a77ca3c48fb1245cde75a6429c818c0a,SystemUUID:a77ca3c4-8fb1-245c-de75-a6429c818c0a,BootID:65d4f8a4-acd4-4bf8-8839-6a047fad3abd,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:b83c1d70989e1fe87583607bf5aee1ee34e52773d4755b95f5cf5a451962f3a4 registry.k8s.io/etcd:3.5.5-0],SizeBytes:102417044,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.4],SizeBytes:63279305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:51155161,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 registry.k8s.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:7000509,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 7 17:13:31.687: INFO: Logging kubelet events for node nodes-us-east4-a-v6tj Dec 7 17:13:31.718: INFO: Logging pods the kubelet thinks is on node nodes-us-east4-a-v6tj Dec 7 17:13:31.762: INFO: csi-gce-pd-node-n8bdx started at 2022-12-07 16:49:37 +0000 UTC (0+2 container statuses recorded) Dec 7 17:13:31.762: INFO: Container csi-driver-registrar ready: true, restart count 0 Dec 7 17:13:31.762: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 17:13:31.762: INFO: kube-proxy-nodes-us-east4-a-v6tj started at 2022-12-07 16:49:37 +0000 UTC (0+1 container statuses recorded) Dec 7 17:13:31.762: INFO: Container kube-proxy ready: true, restart count 0 Dec 7 17:13:31.762: INFO: calico-node-j442m started at 2022-12-07 16:49:37 +0000 UTC (3+1 container statuses recorded) Dec 7 17:13:31.762: INFO: Init container upgrade-ipam ready: true, restart count 0 Dec 7 17:13:31.762: INFO: Init container install-cni ready: true, restart count 0 Dec 7 17:13:31.762: INFO: Init container mount-bpffs ready: true, restart count 0 Dec 7 17:13:31.762: INFO: Container calico-node ready: true, restart count 0 Dec 7 17:13:31.935: INFO: Latency metrics for node nodes-us-east4-a-v6tj Dec 7 17:13:31.935: INFO: Logging node info for node nodes-us-east4-a-zc10 Dec 7 17:13:31.964: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east4-a-zc10 c6cc41ef-a044-4188-9cdf-9af619e808de 52063 0 2022-12-07 16:49:31 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east4 failure-domain.beta.kubernetes.io/zone:us-east4-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east4-a-zc10 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east4-a topology.hostpath.csi/node:nodes-us-east4-a-zc10 topology.kubernetes.io/region:us-east4 topology.kubernetes.io/zone:us-east4-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/instances/nodes-us-east4-a-zc10"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.4/32 projectcalico.org/IPv4IPIPTunnelAddr:100.113.50.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-12-07 16:49:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:49:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2022-12-07 16:49:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:49:41 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:49:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {calico-node Update v1 2022-12-07 16:49:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2022-12-07 17:09:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:gce://gce-gci-upg-lat-1-3-ctl-skew/us-east4-a/nodes-us-east4-a-zc10,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111196160 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006338560 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-07 16:49:56 +0000 UTC,LastTransitionTime:2022-12-07 16:49:56 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-07 17:09:28 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-07 17:09:28 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-07 17:09:28 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-07 17:09:28 +0000 UTC,LastTransitionTime:2022-12-07 16:49:52 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.4,},NodeAddress{Type:ExternalIP,Address:35.188.253.28,},NodeAddress{Type:Hostname,Address:nodes-us-east4-a-zc10,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f5ea7883cc54b5706859a5f8fc4d24dd,SystemUUID:f5ea7883-cc54-b570-6859-a5f8fc4d24dd,BootID:6c425a3b-23de-41f0-9815-f6a0465861ce,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.4],SizeBytes:63279305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:51155161,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:7000509,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 7 17:13:31.965: INFO: Logging kubelet events for node nodes-us-east4-a-zc10 Dec 7 17:13:31.996: INFO: Logging pods the kubelet thinks is on node nodes-us-east4-a-zc10 Dec 7 17:13:32.039: INFO: kube-proxy-nodes-us-east4-a-zc10 started at 2022-12-07 16:49:35 +0000 UTC (0+1 container statuses recorded) Dec 7 17:13:32.039: INFO: Container kube-proxy ready: true, restart count 0 Dec 7 17:13:32.039: INFO: calico-node-g8zkr started at 2022-12-07 16:49:35 +0000 UTC (3+1 container statuses recorded) Dec 7 17:13:32.039: INFO: Init container upgrade-ipam ready: true, restart count 0 Dec 7 17:13:32.039: INFO: Init container install-cni ready: true, restart count 0 Dec 7 17:13:32.039: INFO: Init container mount-bpffs ready: true, restart count 0 Dec 7 17:13:32.039: INFO: Container calico-node ready: true, restart count 0 Dec 7 17:13:32.039: INFO: csi-gce-pd-node-vtqz7 started at 2022-12-07 16:49:35 +0000 UTC (0+2 container statuses recorded) Dec 7 17:13:32.039: INFO: Container csi-driver-registrar ready: true, restart count 0 Dec 7 17:13:32.039: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 17:13:32.039: INFO: coredns-677fff9cfb-4b88c started at 2022-12-07 16:50:04 +0000 UTC (0+1 container statuses recorded) Dec 7 17:13:32.039: INFO: Container coredns ready: true, restart count 0 Dec 7 17:13:32.189: INFO: Latency metrics for node nodes-us-east4-a-zc10 Dec 7 17:13:32.189: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP:�[0m Destroying namespace "dns-9942" for this suite. �[38;5;243m12/07/22 17:13:32.221�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-network\]\sDNS\sshould\sresolve\sDNS\sof\spartial\squalified\snames\sfor\sthe\scluster\s\[LinuxOnly\]$'
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:222 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.ConditionFunc.WithContext.func1({0x18, 0xc001450000}) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:222 +0x1b k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext({0x7c66948?, 0xc000080048?}, 0xc006e548d0?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:235 +0x57 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.poll({0x7c66948, 0xc000080048}, 0x10?, 0x2ef0845?, 0x60?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:582 +0x38 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediateWithContext({0x7c66948, 0xc000080048}, 0x6504b40?, 0xc006e54960?, 0x2568967?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:528 +0x4a k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediate(0x0?, 0x69b9e00?, 0x7c15ca0?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:514 +0x50 k8s.io/kubernetes/test/e2e/network.assertFilesContain({0xc007684000, 0xc, 0x10}, {0x7364f27, 0x7}, 0xc0000b3c00, {0x7ca2618?, 0xc0074f4180}, 0x0, {0x0, ...}) test/e2e/network/dns_common.go:455 +0x1c5 k8s.io/kubernetes/test/e2e/network.assertFilesExist(...) test/e2e/network/dns_common.go:449 k8s.io/kubernetes/test/e2e/network.validateDNSResults(0xc000a92840, 0xc0000b3c00, {0xc007684000, 0xc, 0x10}) test/e2e/network/dns_common.go:512 +0x452 k8s.io/kubernetes/test/e2e/network.glob..func2.3() test/e2e/network/dns.go:109 +0x513from junit_01.xml
E1207 17:08:35.056594 6852 runtime.go:79] Observed a panic: ginkgowrapper.FailurePanic{Message:"Dec 7 17:08:35.056: Unable to read jessie_tcp@kubernetes.default.svc from pod dns-7212/dns-test-7dcd435d-a897-40d9-ac88-6dfd0284f78b: Get \"https://34.145.193.77/api/v1/namespaces/dns-7212/pods/dns-test-7dcd435d-a897-40d9-ac88-6dfd0284f78b/proxy/results/jessie_tcp@kubernetes.default.svc\": context deadline exceeded", Filename:"vendor/k8s.io/apimachinery/pkg/util/wait/wait.go", Line:222, FullStackTrace:"k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.ConditionFunc.WithContext.func1({0x18, 0xc001450000})\n\tvendor/k8s.io/apimachinery/pkg/util/wait/wait.go:222 +0x1b\nk8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext({0x7c66948?, 0xc000080048?}, 0xc006e548d0?)\n\tvendor/k8s.io/apimachinery/pkg/util/wait/wait.go:235 +0x57\nk8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.poll({0x7c66948, 0xc000080048}, 0x10?, 0x2ef0845?, 0x60?)\n\tvendor/k8s.io/apimachinery/pkg/util/wait/wait.go:582 +0x38\nk8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediateWithContext({0x7c66948, 0xc000080048}, 0x6504b40?, 0xc006e54960?, 0x2568967?)\n\tvendor/k8s.io/apimachinery/pkg/util/wait/wait.go:528 +0x4a\nk8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediate(0x0?, 0x69b9e00?, 0x7c15ca0?)\n\tvendor/k8s.io/apimachinery/pkg/util/wait/wait.go:514 +0x50\nk8s.io/kubernetes/test/e2e/network.assertFilesContain({0xc007684000, 0xc, 0x10}, {0x7364f27, 0x7}, 0xc0000b3c00, {0x7ca2618?, 0xc0074f4180}, 0x0, {0x0, ...})\n\ttest/e2e/network/dns_common.go:455 +0x1c5\nk8s.io/kubernetes/test/e2e/network.assertFilesExist(...)\n\ttest/e2e/network/dns_common.go:449\nk8s.io/kubernetes/test/e2e/network.validateDNSResults(0xc000a92840, 0xc0000b3c00, {0xc007684000, 0xc, 0x10})\n\ttest/e2e/network/dns_common.go:512 +0x452\nk8s.io/kubernetes/test/e2e/network.glob..func2.3()\n\ttest/e2e/network/dns.go:109 +0x513"} ( Your test failed. Ginkgo panics to prevent subsequent assertions from running. Normally Ginkgo rescues this panic so you shouldn't see it. But, if you make an assertion in a goroutine, Ginkgo can't capture the panic. To circumvent this, you should call defer GinkgoRecover() at the top of the goroutine that caused this panic. ) goroutine 4489 [running]: k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/runtime.logPanic({0x6ea2600?, 0xc006fcc180}) vendor/k8s.io/apimachinery/pkg/util/runtime/runtime.go:75 +0x99 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/runtime.HandleCrash({0x0, 0x0, 0xc0000c42c0?}) vendor/k8s.io/apimachinery/pkg/util/runtime/runtime.go:49 +0x75 panic({0x6ea2600, 0xc006fcc180}) /usr/local/go/src/runtime/panic.go:884 +0x212 k8s.io/kubernetes/test/e2e/framework/ginkgowrapper.Fail.func1() test/e2e/framework/ginkgowrapper/wrapper.go:73 +0x7d panic({0x6ea4820, 0xc0007f6540}) /usr/local/go/src/runtime/panic.go:884 +0x212 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2.Fail({0xc006c90280, 0x13b}, {0xc006e543a8?, 0xc006e543b8?, 0x0?}) vendor/github.com/onsi/ginkgo/v2/core_dsl.go:335 +0x225 k8s.io/kubernetes/test/e2e/framework/ginkgowrapper.Fail({0xc006c90280, 0x13b}, {0xc006e54488?, 0x735bf2c?, 0xc006e544b0?}) test/e2e/framework/ginkgowrapper/wrapper.go:77 +0x197 k8s.io/kubernetes/test/e2e/framework.Failf({0x74144d0?, 0x2d?}, {0xc006e546d8?, 0x0?, 0x0?}) test/e2e/framework/log.go:51 +0x12c k8s.io/kubernetes/test/e2e/network.assertFilesContain.func1() test/e2e/network/dns_common.go:472 +0x845 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.ConditionFunc.WithContext.func1({0x18, 0xc001450000}) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:222 +0x1b k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext({0x7c66948?, 0xc000080048?}, 0xc006e548d0?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:235 +0x57 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.poll({0x7c66948, 0xc000080048}, 0x10?, 0x2ef0845?, 0x60?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:582 +0x38 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediateWithContext({0x7c66948, 0xc000080048}, 0x6504b40?, 0xc006e54960?, 0x2568967?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:528 +0x4a k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediate(0x0?, 0x69b9e00?, 0x7c15ca0?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:514 +0x50 k8s.io/kubernetes/test/e2e/network.assertFilesContain({0xc007684000, 0xc, 0x10}, {0x7364f27, 0x7}, 0xc0000b3c00, {0x7ca2618?, 0xc0074f4180}, 0x0, {0x0, ...}) test/e2e/network/dns_common.go:455 +0x1c5 k8s.io/kubernetes/test/e2e/network.assertFilesExist(...) test/e2e/network/dns_common.go:449 k8s.io/kubernetes/test/e2e/network.validateDNSResults(0xc000a92840, 0xc0000b3c00, {0xc007684000, 0xc, 0x10}) test/e2e/network/dns_common.go:512 +0x452 k8s.io/kubernetes/test/e2e/network.glob..func2.3() test/e2e/network/dns.go:109 +0x513 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func2() vendor/github.com/onsi/ginkgo/v2/internal/suite.go:605 +0x8d created by k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode vendor/github.com/onsi/ginkgo/v2/internal/suite.go:593 +0x60c {"msg":"FAILED [sig-network] DNS should resolve DNS of partial qualified names for the cluster [LinuxOnly]","completed":21,"skipped":220,"failed":1,"failures":["[sig-network] DNS should resolve DNS of partial qualified names for the cluster [LinuxOnly]"]} [BeforeEach] [sig-network] DNS test/e2e/framework/framework.go:186 �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m12/07/22 17:03:30.729�[0m Dec 7 17:03:30.729: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP:�[0m Building a namespace api object, basename dns �[38;5;243m12/07/22 17:03:30.73�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m12/07/22 17:03:30.82�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m12/07/22 17:03:30.872�[0m [It] should resolve DNS of partial qualified names for the cluster [LinuxOnly] test/e2e/network/dns.go:92 �[1mSTEP:�[0m Running these commands on wheezy: for i in `seq 1 600`; do check="$$(dig +notcp +noall +answer +search kubernetes.default A)" && test -n "$$check" && echo OK > /results/wheezy_udp@kubernetes.default;check="$$(dig +tcp +noall +answer +search kubernetes.default A)" && test -n "$$check" && echo OK > /results/wheezy_tcp@kubernetes.default;check="$$(dig +notcp +noall +answer +search kubernetes.default.svc A)" && test -n "$$check" && echo OK > /results/wheezy_udp@kubernetes.default.svc;check="$$(dig +tcp +noall +answer +search kubernetes.default.svc A)" && test -n "$$check" && echo OK > /results/wheezy_tcp@kubernetes.default.svc;test -n "$$(getent hosts dns-querier-1.dns-test-service.dns-7212.svc.cluster.local)" && echo OK > /results/wheezy_hosts@dns-querier-1.dns-test-service.dns-7212.svc.cluster.local;test -n "$$(getent hosts dns-querier-1)" && echo OK > /results/wheezy_hosts@dns-querier-1;sleep 1; done �[38;5;243m12/07/22 17:03:30.925�[0m �[1mSTEP:�[0m Running these commands on jessie: for i in `seq 1 600`; do check="$$(dig +notcp +noall +answer +search kubernetes.default A)" && test -n "$$check" && echo OK > /results/jessie_udp@kubernetes.default;check="$$(dig +tcp +noall +answer +search kubernetes.default A)" && test -n "$$check" && echo OK > /results/jessie_tcp@kubernetes.default;check="$$(dig +notcp +noall +answer +search kubernetes.default.svc A)" && test -n "$$check" && echo OK > /results/jessie_udp@kubernetes.default.svc;check="$$(dig +tcp +noall +answer +search kubernetes.default.svc A)" && test -n "$$check" && echo OK > /results/jessie_tcp@kubernetes.default.svc;test -n "$$(getent hosts dns-querier-1.dns-test-service.dns-7212.svc.cluster.local)" && echo OK > /results/jessie_hosts@dns-querier-1.dns-test-service.dns-7212.svc.cluster.local;test -n "$$(getent hosts dns-querier-1)" && echo OK > /results/jessie_hosts@dns-querier-1;sleep 1; done �[38;5;243m12/07/22 17:03:30.925�[0m �[1mSTEP:�[0m creating a pod to probe DNS �[38;5;243m12/07/22 17:03:30.925�[0m �[1mSTEP:�[0m submitting the pod to kubernetes �[38;5;243m12/07/22 17:03:30.925�[0m Dec 7 17:03:30.961: INFO: Waiting up to 15m0s for pod "dns-test-7dcd435d-a897-40d9-ac88-6dfd0284f78b" in namespace "dns-7212" to be "running" Dec 7 17:03:30.997: INFO: Pod "dns-test-7dcd435d-a897-40d9-ac88-6dfd0284f78b": Phase="Pending", Reason="", readiness=false. Elapsed: 36.442177ms Dec 7 17:03:33.029: INFO: Pod "dns-test-7dcd435d-a897-40d9-ac88-6dfd0284f78b": Phase="Pending", Reason="", readiness=false. Elapsed: 2.068648131s Dec 7 17:03:35.027: INFO: Pod "dns-test-7dcd435d-a897-40d9-ac88-6dfd0284f78b": Phase="Running", Reason="", readiness=true. Elapsed: 4.066717787s Dec 7 17:03:35.027: INFO: Pod "dns-test-7dcd435d-a897-40d9-ac88-6dfd0284f78b" satisfied condition "running" �[1mSTEP:�[0m retrieving the pod �[38;5;243m12/07/22 17:03:35.027�[0m �[1mSTEP:�[0m looking for the results for each expected name from probers �[38;5;243m12/07/22 17:03:35.055�[0m Dec 7 17:04:05.087: INFO: Unable to read wheezy_udp@kubernetes.default from pod dns-7212/dns-test-7dcd435d-a897-40d9-ac88-6dfd0284f78b: the server is currently unable to handle the request (get pods dns-test-7dcd435d-a897-40d9-ac88-6dfd0284f78b) Dec 7 17:04:35.118: INFO: Unable to read wheezy_tcp@kubernetes.default from pod dns-7212/dns-test-7dcd435d-a897-40d9-ac88-6dfd0284f78b: the server is currently unable to handle the request (get pods dns-test-7dcd435d-a897-40d9-ac88-6dfd0284f78b) Dec 7 17:05:05.147: INFO: Unable to read wheezy_udp@kubernetes.default.svc from pod dns-7212/dns-test-7dcd435d-a897-40d9-ac88-6dfd0284f78b: the server is currently unable to handle the request (get pods dns-test-7dcd435d-a897-40d9-ac88-6dfd0284f78b) Dec 7 17:05:35.188: INFO: Unable to read wheezy_tcp@kubernetes.default.svc from pod dns-7212/dns-test-7dcd435d-a897-40d9-ac88-6dfd0284f78b: the server is currently unable to handle the request (get pods dns-test-7dcd435d-a897-40d9-ac88-6dfd0284f78b) Dec 7 17:06:05.239: INFO: Unable to read wheezy_hosts@dns-querier-1.dns-test-service.dns-7212.svc.cluster.local from pod dns-7212/dns-test-7dcd435d-a897-40d9-ac88-6dfd0284f78b: the server is currently unable to handle the request (get pods dns-test-7dcd435d-a897-40d9-ac88-6dfd0284f78b) Dec 7 17:06:35.270: INFO: Unable to read wheezy_hosts@dns-querier-1 from pod dns-7212/dns-test-7dcd435d-a897-40d9-ac88-6dfd0284f78b: the server is currently unable to handle the request (get pods dns-test-7dcd435d-a897-40d9-ac88-6dfd0284f78b) Dec 7 17:07:05.305: INFO: Unable to read jessie_udp@kubernetes.default from pod dns-7212/dns-test-7dcd435d-a897-40d9-ac88-6dfd0284f78b: the server is currently unable to handle the request (get pods dns-test-7dcd435d-a897-40d9-ac88-6dfd0284f78b) Dec 7 17:07:35.340: INFO: Unable to read jessie_tcp@kubernetes.default from pod dns-7212/dns-test-7dcd435d-a897-40d9-ac88-6dfd0284f78b: the server is currently unable to handle the request (get pods dns-test-7dcd435d-a897-40d9-ac88-6dfd0284f78b) Dec 7 17:08:05.369: INFO: Unable to read jessie_udp@kubernetes.default.svc from pod dns-7212/dns-test-7dcd435d-a897-40d9-ac88-6dfd0284f78b: the server is currently unable to handle the request (get pods dns-test-7dcd435d-a897-40d9-ac88-6dfd0284f78b) Dec 7 17:08:35.056: FAIL: Unable to read jessie_tcp@kubernetes.default.svc from pod dns-7212/dns-test-7dcd435d-a897-40d9-ac88-6dfd0284f78b: Get "https://34.145.193.77/api/v1/namespaces/dns-7212/pods/dns-test-7dcd435d-a897-40d9-ac88-6dfd0284f78b/proxy/results/jessie_tcp@kubernetes.default.svc": context deadline exceeded Full Stack Trace k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.ConditionFunc.WithContext.func1({0x18, 0xc001450000}) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:222 +0x1b k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext({0x7c66948?, 0xc000080048?}, 0xc006e548d0?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:235 +0x57 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.poll({0x7c66948, 0xc000080048}, 0x10?, 0x2ef0845?, 0x60?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:582 +0x38 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediateWithContext({0x7c66948, 0xc000080048}, 0x6504b40?, 0xc006e54960?, 0x2568967?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:528 +0x4a k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediate(0x0?, 0x69b9e00?, 0x7c15ca0?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:514 +0x50 k8s.io/kubernetes/test/e2e/network.assertFilesContain({0xc007684000, 0xc, 0x10}, {0x7364f27, 0x7}, 0xc0000b3c00, {0x7ca2618?, 0xc0074f4180}, 0x0, {0x0, ...}) test/e2e/network/dns_common.go:455 +0x1c5 k8s.io/kubernetes/test/e2e/network.assertFilesExist(...) test/e2e/network/dns_common.go:449 k8s.io/kubernetes/test/e2e/network.validateDNSResults(0xc000a92840, 0xc0000b3c00, {0xc007684000, 0xc, 0x10}) test/e2e/network/dns_common.go:512 +0x452 k8s.io/kubernetes/test/e2e/network.glob..func2.3() test/e2e/network/dns.go:109 +0x513 E1207 17:08:35.056594 6852 runtime.go:79] Observed a panic: ginkgowrapper.FailurePanic{Message:"Dec 7 17:08:35.056: Unable to read jessie_tcp@kubernetes.default.svc from pod dns-7212/dns-test-7dcd435d-a897-40d9-ac88-6dfd0284f78b: Get \"https://34.145.193.77/api/v1/namespaces/dns-7212/pods/dns-test-7dcd435d-a897-40d9-ac88-6dfd0284f78b/proxy/results/jessie_tcp@kubernetes.default.svc\": context deadline exceeded", Filename:"vendor/k8s.io/apimachinery/pkg/util/wait/wait.go", Line:222, FullStackTrace:"k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.ConditionFunc.WithContext.func1({0x18, 0xc001450000})\n\tvendor/k8s.io/apimachinery/pkg/util/wait/wait.go:222 +0x1b\nk8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext({0x7c66948?, 0xc000080048?}, 0xc006e548d0?)\n\tvendor/k8s.io/apimachinery/pkg/util/wait/wait.go:235 +0x57\nk8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.poll({0x7c66948, 0xc000080048}, 0x10?, 0x2ef0845?, 0x60?)\n\tvendor/k8s.io/apimachinery/pkg/util/wait/wait.go:582 +0x38\nk8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediateWithContext({0x7c66948, 0xc000080048}, 0x6504b40?, 0xc006e54960?, 0x2568967?)\n\tvendor/k8s.io/apimachinery/pkg/util/wait/wait.go:528 +0x4a\nk8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediate(0x0?, 0x69b9e00?, 0x7c15ca0?)\n\tvendor/k8s.io/apimachinery/pkg/util/wait/wait.go:514 +0x50\nk8s.io/kubernetes/test/e2e/network.assertFilesContain({0xc007684000, 0xc, 0x10}, {0x7364f27, 0x7}, 0xc0000b3c00, {0x7ca2618?, 0xc0074f4180}, 0x0, {0x0, ...})\n\ttest/e2e/network/dns_common.go:455 +0x1c5\nk8s.io/kubernetes/test/e2e/network.assertFilesExist(...)\n\ttest/e2e/network/dns_common.go:449\nk8s.io/kubernetes/test/e2e/network.validateDNSResults(0xc000a92840, 0xc0000b3c00, {0xc007684000, 0xc, 0x10})\n\ttest/e2e/network/dns_common.go:512 +0x452\nk8s.io/kubernetes/test/e2e/network.glob..func2.3()\n\ttest/e2e/network/dns.go:109 +0x513"} ( Your test failed. Ginkgo panics to prevent subsequent assertions from running. Normally Ginkgo rescues this panic so you shouldn't see it. But, if you make an assertion in a goroutine, Ginkgo can't capture the panic. To circumvent this, you should call defer GinkgoRecover() at the top of the goroutine that caused this panic. ) goroutine 4489 [running]: k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/runtime.logPanic({0x6ea2600?, 0xc006fcc180}) vendor/k8s.io/apimachinery/pkg/util/runtime/runtime.go:75 +0x99 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/runtime.HandleCrash({0x0, 0x0, 0xc0000c42c0?}) vendor/k8s.io/apimachinery/pkg/util/runtime/runtime.go:49 +0x75 panic({0x6ea2600, 0xc006fcc180}) /usr/local/go/src/runtime/panic.go:884 +0x212 k8s.io/kubernetes/test/e2e/framework/ginkgowrapper.Fail.func1() test/e2e/framework/ginkgowrapper/wrapper.go:73 +0x7d panic({0x6ea4820, 0xc0007f6540}) /usr/local/go/src/runtime/panic.go:884 +0x212 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2.Fail({0xc006c90280, 0x13b}, {0xc006e543a8?, 0xc006e543b8?, 0x0?}) vendor/github.com/onsi/ginkgo/v2/core_dsl.go:335 +0x225 k8s.io/kubernetes/test/e2e/framework/ginkgowrapper.Fail({0xc006c90280, 0x13b}, {0xc006e54488?, 0x735bf2c?, 0xc006e544b0?}) test/e2e/framework/ginkgowrapper/wrapper.go:77 +0x197 k8s.io/kubernetes/test/e2e/framework.Failf({0x74144d0?, 0x2d?}, {0xc006e546d8?, 0x0?, 0x0?}) test/e2e/framework/log.go:51 +0x12c k8s.io/kubernetes/test/e2e/network.assertFilesContain.func1() test/e2e/network/dns_common.go:472 +0x845 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.ConditionFunc.WithContext.func1({0x18, 0xc001450000}) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:222 +0x1b k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext({0x7c66948?, 0xc000080048?}, 0xc006e548d0?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:235 +0x57 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.poll({0x7c66948, 0xc000080048}, 0x10?, 0x2ef0845?, 0x60?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:582 +0x38 k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediateWithContext({0x7c66948, 0xc000080048}, 0x6504b40?, 0xc006e54960?, 0x2568967?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:528 +0x4a k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediate(0x0?, 0x69b9e00?, 0x7c15ca0?) vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:514 +0x50 k8s.io/kubernetes/test/e2e/network.assertFilesContain({0xc007684000, 0xc, 0x10}, {0x7364f27, 0x7}, 0xc0000b3c00, {0x7ca2618?, 0xc0074f4180}, 0x0, {0x0, ...}) test/e2e/network/dns_common.go:455 +0x1c5 k8s.io/kubernetes/test/e2e/network.assertFilesExist(...) test/e2e/network/dns_common.go:449 k8s.io/kubernetes/test/e2e/network.validateDNSResults(0xc000a92840, 0xc0000b3c00, {0xc007684000, 0xc, 0x10}) test/e2e/network/dns_common.go:512 +0x452 k8s.io/kubernetes/test/e2e/network.glob..func2.3() test/e2e/network/dns.go:109 +0x513 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func2() vendor/github.com/onsi/ginkgo/v2/internal/suite.go:605 +0x8d created by k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode vendor/github.com/onsi/ginkgo/v2/internal/suite.go:593 +0x60c �[1mSTEP:�[0m deleting the pod �[38;5;243m12/07/22 17:08:35.056�[0m [AfterEach] [sig-network] DNS test/e2e/framework/framework.go:187 �[1mSTEP:�[0m Collecting events from namespace "dns-7212". �[38;5;243m12/07/22 17:08:35.101�[0m �[1mSTEP:�[0m Found 13 events. �[38;5;243m12/07/22 17:08:35.132�[0m Dec 7 17:08:35.132: INFO: At 2022-12-07 17:03:30 +0000 UTC - event for dns-test-7dcd435d-a897-40d9-ac88-6dfd0284f78b: {default-scheduler } Scheduled: Successfully assigned dns-7212/dns-test-7dcd435d-a897-40d9-ac88-6dfd0284f78b to nodes-us-east4-a-nfxp Dec 7 17:08:35.132: INFO: At 2022-12-07 17:03:31 +0000 UTC - event for dns-test-7dcd435d-a897-40d9-ac88-6dfd0284f78b: {kubelet nodes-us-east4-a-nfxp} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.40" already present on machine Dec 7 17:08:35.132: INFO: At 2022-12-07 17:03:31 +0000 UTC - event for dns-test-7dcd435d-a897-40d9-ac88-6dfd0284f78b: {kubelet nodes-us-east4-a-nfxp} Created: Created container webserver Dec 7 17:08:35.132: INFO: At 2022-12-07 17:03:31 +0000 UTC - event for dns-test-7dcd435d-a897-40d9-ac88-6dfd0284f78b: {kubelet nodes-us-east4-a-nfxp} Started: Started container webserver Dec 7 17:08:35.132: INFO: At 2022-12-07 17:03:31 +0000 UTC - event for dns-test-7dcd435d-a897-40d9-ac88-6dfd0284f78b: {kubelet nodes-us-east4-a-nfxp} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.40" already present on machine Dec 7 17:08:35.132: INFO: At 2022-12-07 17:03:32 +0000 UTC - event for dns-test-7dcd435d-a897-40d9-ac88-6dfd0284f78b: {kubelet nodes-us-east4-a-nfxp} Created: Created container querier Dec 7 17:08:35.132: INFO: At 2022-12-07 17:03:32 +0000 UTC - event for dns-test-7dcd435d-a897-40d9-ac88-6dfd0284f78b: {kubelet nodes-us-east4-a-nfxp} Started: Started container querier Dec 7 17:08:35.132: INFO: At 2022-12-07 17:03:32 +0000 UTC - event for dns-test-7dcd435d-a897-40d9-ac88-6dfd0284f78b: {kubelet nodes-us-east4-a-nfxp} Pulled: Container image "registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5" already present on machine Dec 7 17:08:35.132: INFO: At 2022-12-07 17:03:32 +0000 UTC - event for dns-test-7dcd435d-a897-40d9-ac88-6dfd0284f78b: {kubelet nodes-us-east4-a-nfxp} Created: Created container jessie-querier Dec 7 17:08:35.132: INFO: At 2022-12-07 17:03:32 +0000 UTC - event for dns-test-7dcd435d-a897-40d9-ac88-6dfd0284f78b: {kubelet nodes-us-east4-a-nfxp} Started: Started container jessie-querier Dec 7 17:08:35.132: INFO: At 2022-12-07 17:08:35 +0000 UTC - event for dns-test-7dcd435d-a897-40d9-ac88-6dfd0284f78b: {kubelet nodes-us-east4-a-nfxp} Killing: Stopping container webserver Dec 7 17:08:35.132: INFO: At 2022-12-07 17:08:35 +0000 UTC - event for dns-test-7dcd435d-a897-40d9-ac88-6dfd0284f78b: {kubelet nodes-us-east4-a-nfxp} Killing: Stopping container jessie-querier Dec 7 17:08:35.132: INFO: At 2022-12-07 17:08:35 +0000 UTC - event for dns-test-7dcd435d-a897-40d9-ac88-6dfd0284f78b: {kubelet nodes-us-east4-a-nfxp} Killing: Stopping container querier Dec 7 17:08:35.159: INFO: POD NODE PHASE GRACE CONDITIONS Dec 7 17:08:35.159: INFO: Dec 7 17:08:35.195: INFO: Logging node info for node control-plane-us-east4-a-vd91 Dec 7 17:08:35.234: INFO: Node Info: &Node{ObjectMeta:{control-plane-us-east4-a-vd91 74d54d8e-e0bc-4c7d-bf3c-5b66ce025930 36258 0 2022-12-07 16:47:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-standard-2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east4 failure-domain.beta.kubernetes.io/zone:us-east4-a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:control-plane-us-east4-a-vd91 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node-role.kubernetes.io/node: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:e2-standard-2 topology.gke.io/zone:us-east4-a topology.kubernetes.io/region:us-east4 topology.kubernetes.io/zone:us-east4-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/instances/control-plane-us-east4-a-vd91"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.5/32 projectcalico.org/IPv4IPIPTunnelAddr:100.101.18.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-12-07 16:47:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2022-12-07 16:48:18 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {calico-node Update v1 2022-12-07 16:48:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}}}}} status} {cloud-controller-manager Update v1 2022-12-07 16:48:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2022-12-07 16:48:34 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:48:39 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:48:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-12-07 17:04:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:gce://gce-gci-upg-lat-1-3-ctl-skew/us-east4-a/control-plane-us-east4-a-vd91,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8332767232 0} {<nil>} 8137468Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8227909632 0} {<nil>} 8035068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-07 16:48:39 +0000 UTC,LastTransitionTime:2022-12-07 16:48:39 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-07 17:04:17 +0000 UTC,LastTransitionTime:2022-12-07 16:47:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-07 17:04:17 +0000 UTC,LastTransitionTime:2022-12-07 16:47:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-07 17:04:17 +0000 UTC,LastTransitionTime:2022-12-07 16:47:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-07 17:04:17 +0000 UTC,LastTransitionTime:2022-12-07 16:48:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.5,},NodeAddress{Type:ExternalIP,Address:35.245.23.229,},NodeAddress{Type:Hostname,Address:control-plane-us-east4-a-vd91,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e32750d839dd77bbe79d8a1be267141a,SystemUUID:e32750d8-39dd-77bb-e79d-8a1be267141a,BootID:572b6367-72b8-4ea4-b559-5c84c54662ce,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gcr.io/k8s-staging-etcdadm/etcd-manager@sha256:f3a63853502cb3956fa708fea524be3b333036ebc1cd1dadd81abd9f1fe61043 gcr.io/k8s-staging-etcdadm/etcd-manager:v3.0.20220831-21-g12041b4c],SizeBytes:231516108,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.25.4],SizeBytes:129085904,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.25.4],SizeBytes:118436153,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.4],SizeBytes:63279305,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.25.4],SizeBytes:51921208,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-alpha.2],SizeBytes:42203406,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-alpha.2],SizeBytes:41463710,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:2b6acd7f677f76ffe12ecf3ea7df92eb9b1bdb07336d1ac2a54c7631fb753f7e docker.io/calico/kube-controllers:v3.24.5],SizeBytes:31137169,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2 registry.k8s.io/sig-storage/csi-provisioner:v2.1.0],SizeBytes:21205045,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:50c3cfd458fc8e0bf3c8c521eac39172009382fc66dc5044a330d137c6ed0b09 registry.k8s.io/sig-storage/csi-attacher:v3.1.0],SizeBytes:20103959,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a registry.k8s.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:9af9bf28430b00a0cedeb2ec29acadce45e6afcecd8bdf31c793c624cfa75fa7 registry.k8s.io/sig-storage/csi-snapshotter:v3.0.3],SizeBytes:19500777,},ContainerImage{Names:[docker.io/k8scloudprovidergcp/cloud-controller-manager@sha256:881fd1095937638040723973ade90e6700f1c831a78fb585a3227c4d021b0df9 docker.io/k8scloudprovidergcp/cloud-controller-manager:latest],SizeBytes:18702875,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-alpha.2],SizeBytes:4954573,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 7 17:08:35.235: INFO: Logging kubelet events for node control-plane-us-east4-a-vd91 Dec 7 17:08:35.271: INFO: Logging pods the kubelet thinks is on node control-plane-us-east4-a-vd91 Dec 7 17:08:35.337: INFO: csi-gce-pd-node-z9fsn started at 2022-12-07 16:48:06 +0000 UTC (0+2 container statuses recorded) Dec 7 17:08:35.337: INFO: Container csi-driver-registrar ready: true, restart count 0 Dec 7 17:08:35.337: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 17:08:35.337: INFO: kops-controller-mnn6f started at 2022-12-07 16:48:18 +0000 UTC (0+1 container statuses recorded) Dec 7 17:08:35.337: INFO: Container kops-controller ready: true, restart count 0 Dec 7 17:08:35.337: INFO: cloud-controller-manager-xd6xh started at 2022-12-07 16:48:18 +0000 UTC (0+1 container statuses recorded) Dec 7 17:08:35.337: INFO: Container cloud-controller-manager ready: true, restart count 0 Dec 7 17:08:35.337: INFO: kube-proxy-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+1 container statuses recorded) Dec 7 17:08:35.337: INFO: Container kube-proxy ready: true, restart count 0 Dec 7 17:08:35.337: INFO: calico-kube-controllers-7bc879d8d6-t4vrx started at 2022-12-07 16:48:39 +0000 UTC (0+1 container statuses recorded) Dec 7 17:08:35.337: INFO: Container calico-kube-controllers ready: true, restart count 0 Dec 7 17:08:35.337: INFO: calico-node-zgvgx started at 2022-12-07 16:48:06 +0000 UTC (3+1 container statuses recorded) Dec 7 17:08:35.337: INFO: Init container upgrade-ipam ready: true, restart count 0 Dec 7 17:08:35.337: INFO: Init container install-cni ready: true, restart count 0 Dec 7 17:08:35.337: INFO: Init container mount-bpffs ready: true, restart count 0 Dec 7 17:08:35.337: INFO: Container calico-node ready: true, restart count 0 Dec 7 17:08:35.337: INFO: etcd-manager-main-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+1 container statuses recorded) Dec 7 17:08:35.337: INFO: Container etcd-manager ready: true, restart count 0 Dec 7 17:08:35.337: INFO: kube-apiserver-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+2 container statuses recorded) Dec 7 17:08:35.337: INFO: Container healthcheck ready: true, restart count 0 Dec 7 17:08:35.337: INFO: Container kube-apiserver ready: true, restart count 1 Dec 7 17:08:35.337: INFO: csi-gce-pd-controller-689c9f4444-b5qql started at 2022-12-07 16:48:18 +0000 UTC (0+5 container statuses recorded) Dec 7 17:08:35.337: INFO: Container csi-attacher ready: true, restart count 0 Dec 7 17:08:35.337: INFO: Container csi-provisioner ready: true, restart count 0 Dec 7 17:08:35.337: INFO: Container csi-resizer ready: true, restart count 0 Dec 7 17:08:35.337: INFO: Container csi-snapshotter ready: true, restart count 0 Dec 7 17:08:35.337: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 17:08:35.337: INFO: kube-scheduler-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+1 container statuses recorded) Dec 7 17:08:35.337: INFO: Container kube-scheduler ready: true, restart count 0 Dec 7 17:08:35.337: INFO: kube-controller-manager-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+1 container statuses recorded) Dec 7 17:08:35.337: INFO: Container kube-controller-manager ready: true, restart count 2 Dec 7 17:08:35.337: INFO: dns-controller-8946976bb-6t8hj started at 2022-12-07 16:48:19 +0000 UTC (0+1 container statuses recorded) Dec 7 17:08:35.337: INFO: Container dns-controller ready: true, restart count 0 Dec 7 17:08:35.337: INFO: etcd-manager-events-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+1 container statuses recorded) Dec 7 17:08:35.337: INFO: Container etcd-manager ready: true, restart count 0 Dec 7 17:08:35.563: INFO: Latency metrics for node control-plane-us-east4-a-vd91 Dec 7 17:08:35.563: INFO: Logging node info for node nodes-us-east4-a-5680 Dec 7 17:08:35.598: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east4-a-5680 b9473b45-598f-43c3-aafc-dc872ade1274 49588 0 2022-12-07 16:49:31 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east4 failure-domain.beta.kubernetes.io/zone:us-east4-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east4-a-5680 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east4-a topology.hostpath.csi/node:nodes-us-east4-a-5680 topology.kubernetes.io/region:us-east4 topology.kubernetes.io/zone:us-east4-a] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-5034":"nodes-us-east4-a-5680","pd.csi.storage.gke.io":"projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/instances/nodes-us-east4-a-5680"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.3/32 projectcalico.org/IPv4IPIPTunnelAddr:100.119.115.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2022-12-07 16:49:31 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2022-12-07 16:49:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2022-12-07 16:49:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:49:41 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:49:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {calico-node Update v1 2022-12-07 16:49:59 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2022-12-07 17:08:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {kube-controller-manager Update v1 2022-12-07 17:08:35 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:gce://gce-gci-upg-lat-1-3-ctl-skew/us-east4-a/nodes-us-east4-a-5680,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-07 16:49:58 +0000 UTC,LastTransitionTime:2022-12-07 16:49:58 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-07 17:08:16 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-07 17:08:16 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-07 17:08:16 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-07 17:08:16 +0000 UTC,LastTransitionTime:2022-12-07 16:49:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.3,},NodeAddress{Type:ExternalIP,Address:34.86.83.231,},NodeAddress{Type:Hostname,Address:nodes-us-east4-a-5680,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:5676434e0327952eef9a8130969e32db,SystemUUID:5676434e-0327-952e-ef9a-8130969e32db,BootID:f4cd280b-a7ea-43c2-b78f-d43fab064010,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.4],SizeBytes:63279305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:51155161,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 registry.k8s.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-5034^c7350d68-7651-11ed-907f-fa5ce46b05fc,DevicePath:,},},Config:nil,},} Dec 7 17:08:35.598: INFO: Logging kubelet events for node nodes-us-east4-a-5680 Dec 7 17:08:35.628: INFO: Logging pods the kubelet thinks is on node nodes-us-east4-a-5680 Dec 7 17:08:35.676: INFO: pod-configmaps-c65473bb-5f91-4ac2-a15f-3dac92c9abca started at 2022-12-07 17:08:30 +0000 UTC (0+1 container statuses recorded) Dec 7 17:08:35.676: INFO: Container env-test ready: false, restart count 0 Dec 7 17:08:35.676: INFO: csi-mockplugin-0 started at 2022-12-07 17:08:22 +0000 UTC (0+3 container statuses recorded) Dec 7 17:08:35.676: INFO: Container csi-provisioner ready: true, restart count 0 Dec 7 17:08:35.676: INFO: Container driver-registrar ready: true, restart count 0 Dec 7 17:08:35.676: INFO: Container mock ready: true, restart count 0 Dec 7 17:08:35.676: INFO: pvc-volume-tester-dnzbm started at <nil> (0+0 container statuses recorded) Dec 7 17:08:35.676: INFO: pod-8b0a7d94-ac78-4b59-803c-de7c600a41e7 started at 2022-12-07 17:08:23 +0000 UTC (0+1 container statuses recorded) Dec 7 17:08:35.676: INFO: Container write-pod ready: true, restart count 0 Dec 7 17:08:35.676: INFO: csi-mockplugin-resizer-0 started at 2022-12-07 17:08:22 +0000 UTC (0+1 container statuses recorded) Dec 7 17:08:35.676: INFO: Container csi-resizer ready: true, restart count 0 Dec 7 17:08:35.676: INFO: netserver-0 started at 2022-12-07 17:08:32 +0000 UTC (0+1 container statuses recorded) Dec 7 17:08:35.676: INFO: Container webserver ready: false, restart count 0 Dec 7 17:08:35.676: INFO: calico-node-wvpd9 started at 2022-12-07 16:49:34 +0000 UTC (3+1 container statuses recorded) Dec 7 17:08:35.676: INFO: Init container upgrade-ipam ready: true, restart count 0 Dec 7 17:08:35.676: INFO: Init container install-cni ready: true, restart count 0 Dec 7 17:08:35.676: INFO: Init container mount-bpffs ready: true, restart count 0 Dec 7 17:08:35.676: INFO: Container calico-node ready: true, restart count 0 Dec 7 17:08:35.676: INFO: hostexec-nodes-us-east4-a-5680-g78bd started at 2022-12-07 17:08:32 +0000 UTC (0+1 container statuses recorded) Dec 7 17:08:35.676: INFO: Container agnhost-container ready: false, restart count 0 Dec 7 17:08:35.676: INFO: hostexec-nodes-us-east4-a-5680-qd9jn started at 2022-12-07 17:08:10 +0000 UTC (0+1 container statuses recorded) Dec 7 17:08:35.676: INFO: Container agnhost-container ready: true, restart count 0 Dec 7 17:08:35.676: INFO: kube-proxy-nodes-us-east4-a-5680 started at 2022-12-07 16:49:34 +0000 UTC (0+1 container statuses recorded) Dec 7 17:08:35.676: INFO: Container kube-proxy ready: true, restart count 0 Dec 7 17:08:35.676: INFO: netserver-0 started at 2022-12-07 17:08:30 +0000 UTC (0+1 container statuses recorded) Dec 7 17:08:35.676: INFO: Container webserver ready: false, restart count 0 Dec 7 17:08:35.676: INFO: test-rolling-update-with-lb-8cc597cbd-9m9bw started at 2022-12-07 17:07:54 +0000 UTC (0+1 container statuses recorded) Dec 7 17:08:35.676: INFO: Container agnhost ready: true, restart count 0 Dec 7 17:08:35.676: INFO: csi-mockplugin-attacher-0 started at 2022-12-07 17:08:22 +0000 UTC (0+1 container statuses recorded) Dec 7 17:08:35.676: INFO: Container csi-attacher ready: true, restart count 0 Dec 7 17:08:35.676: INFO: csi-gce-pd-node-9n22s started at 2022-12-07 16:49:34 +0000 UTC (0+2 container statuses recorded) Dec 7 17:08:35.676: INFO: Container csi-driver-registrar ready: true, restart count 0 Dec 7 17:08:35.676: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 17:08:36.278: INFO: Latency metrics for node nodes-us-east4-a-5680 Dec 7 17:08:36.278: INFO: Logging node info for node nodes-us-east4-a-nfxp Dec 7 17:08:36.305: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east4-a-nfxp 958029bf-d66a-424c-a80d-b1d485df133b 49561 0 2022-12-07 16:49:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east4 failure-domain.beta.kubernetes.io/zone:us-east4-a io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east4-a-nfxp kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east4-a topology.hostpath.csi/node:nodes-us-east4-a-nfxp topology.kubernetes.io/region:us-east4 topology.kubernetes.io/zone:us-east4-a] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-7906":"nodes-us-east4-a-nfxp","pd.csi.storage.gke.io":"projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/instances/nodes-us-east4-a-nfxp"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.6/32 projectcalico.org/IPv4IPIPTunnelAddr:100.113.109.192 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2022-12-07 16:49:28 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2022-12-07 16:49:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2022-12-07 16:49:29 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:49:41 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:49:48 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {calico-node Update v1 2022-12-07 16:49:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2022-12-07 17:08:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:gce://gce-gci-upg-lat-1-3-ctl-skew/us-east4-a/nodes-us-east4-a-nfxp,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-07 16:49:53 +0000 UTC,LastTransitionTime:2022-12-07 16:49:53 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-07 17:08:34 +0000 UTC,LastTransitionTime:2022-12-07 16:49:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-07 17:08:34 +0000 UTC,LastTransitionTime:2022-12-07 16:49:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-07 17:08:34 +0000 UTC,LastTransitionTime:2022-12-07 16:49:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-07 17:08:34 +0000 UTC,LastTransitionTime:2022-12-07 16:49:48 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.6,},NodeAddress{Type:ExternalIP,Address:34.145.242.1,},NodeAddress{Type:Hostname,Address:nodes-us-east4-a-nfxp,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:796e3b73d867da488abd70a5df2fe10f,SystemUUID:796e3b73-d867-da48-8abd-70a5df2fe10f,BootID:2b784aad-5897-4bb4-bb49-6bae545d9488,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:b83c1d70989e1fe87583607bf5aee1ee34e52773d4755b95f5cf5a451962f3a4 registry.k8s.io/etcd:3.5.5-0],SizeBytes:102417044,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.4],SizeBytes:63279305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:51155161,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:f9c93b92b6ff750b41a93c4e4fe0bfe384597aeb841e2539d5444815c55b2d8f registry.k8s.io/e2e-test-images/sample-apiserver:1.17.5],SizeBytes:24316368,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:aa60f453d64dfb3c3fd9e7306f988c36c6352c4f2d956aa90467f2808091effa registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.5],SizeBytes:15209420,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:38e6b091d238094f081efad3e2b362e6480b2156f5f4fba6ea46835ecdcd47e2 registry.k8s.io/build-image/distroless-iptables:v0.1.1],SizeBytes:7634231,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:7000509,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 7 17:08:36.305: INFO: Logging kubelet events for node nodes-us-east4-a-nfxp Dec 7 17:08:36.338: INFO: Logging pods the kubelet thinks is on node nodes-us-east4-a-nfxp Dec 7 17:08:36.376: INFO: netserver-1 started at 2022-12-07 17:08:30 +0000 UTC (0+1 container statuses recorded) Dec 7 17:08:36.376: INFO: Container webserver ready: false, restart count 0 Dec 7 17:08:36.376: INFO: webserver-pod started at 2022-12-07 17:06:48 +0000 UTC (0+1 container statuses recorded) Dec 7 17:08:36.376: INFO: Container agnhost ready: false, restart count 0 Dec 7 17:08:36.376: INFO: netserver-1 started at 2022-12-07 17:08:32 +0000 UTC (0+1 container statuses recorded) Dec 7 17:08:36.376: INFO: Container webserver ready: false, restart count 0 Dec 7 17:08:36.376: INFO: kube-proxy-nodes-us-east4-a-nfxp started at 2022-12-07 16:49:29 +0000 UTC (0+1 container statuses recorded) Dec 7 17:08:36.376: INFO: Container kube-proxy ready: true, restart count 0 Dec 7 17:08:36.376: INFO: my-hostname-private-9e75431e-621c-4eb3-8da2-e3518e05bc2a-gmw8c started at 2022-12-07 17:07:37 +0000 UTC (0+1 container statuses recorded) Dec 7 17:08:36.376: INFO: Container my-hostname-private-9e75431e-621c-4eb3-8da2-e3518e05bc2a ready: true, restart count 0 Dec 7 17:08:36.376: INFO: csi-hostpathplugin-0 started at 2022-12-07 17:08:13 +0000 UTC (0+7 container statuses recorded) Dec 7 17:08:36.376: INFO: Container csi-attacher ready: true, restart count 0 Dec 7 17:08:36.376: INFO: Container csi-provisioner ready: true, restart count 0 Dec 7 17:08:36.376: INFO: Container csi-resizer ready: true, restart count 0 Dec 7 17:08:36.376: INFO: Container csi-snapshotter ready: true, restart count 0 Dec 7 17:08:36.376: INFO: Container hostpath ready: true, restart count 0 Dec 7 17:08:36.376: INFO: Container liveness-probe ready: true, restart count 0 Dec 7 17:08:36.376: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 7 17:08:36.376: INFO: csi-gce-pd-node-vcz5x started at 2022-12-07 16:49:29 +0000 UTC (0+2 container statuses recorded) Dec 7 17:08:36.376: INFO: Container csi-driver-registrar ready: true, restart count 0 Dec 7 17:08:36.376: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 17:08:36.376: INFO: calico-node-f2cxs started at 2022-12-07 16:49:29 +0000 UTC (3+1 container statuses recorded) Dec 7 17:08:36.376: INFO: Init container upgrade-ipam ready: true, restart count 0 Dec 7 17:08:36.376: INFO: Init container install-cni ready: true, restart count 0 Dec 7 17:08:36.376: INFO: Init container mount-bpffs ready: true, restart count 0 Dec 7 17:08:36.376: INFO: Container calico-node ready: true, restart count 0 Dec 7 17:08:36.376: INFO: dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4 started at 2022-12-07 16:53:00 +0000 UTC (0+3 container statuses recorded) Dec 7 17:08:36.376: INFO: Container jessie-querier ready: true, restart count 1 Dec 7 17:08:36.376: INFO: Container querier ready: true, restart count 1 Dec 7 17:08:36.376: INFO: Container webserver ready: true, restart count 0 Dec 7 17:08:36.376: INFO: rs-f8brw started at 2022-12-07 17:06:53 +0000 UTC (0+1 container statuses recorded) Dec 7 17:08:36.376: INFO: Container donothing ready: false, restart count 0 Dec 7 17:08:36.376: INFO: agnhost started at 2022-12-07 17:08:04 +0000 UTC (0+1 container statuses recorded) Dec 7 17:08:36.376: INFO: Container agnhost ready: true, restart count 0 Dec 7 17:08:36.376: INFO: coredns-677fff9cfb-rv6b9 started at 2022-12-07 16:49:48 +0000 UTC (0+1 container statuses recorded) Dec 7 17:08:36.376: INFO: Container coredns ready: true, restart count 0 Dec 7 17:08:36.376: INFO: concurrent-27840548-sv8db started at 2022-12-07 17:08:00 +0000 UTC (0+1 container statuses recorded) Dec 7 17:08:36.376: INFO: Container c ready: true, restart count 0 Dec 7 17:08:36.376: INFO: coredns-autoscaler-db7b97744-2cf6q started at 2022-12-07 16:49:48 +0000 UTC (0+1 container statuses recorded) Dec 7 17:08:36.376: INFO: Container autoscaler ready: true, restart count 0 Dec 7 17:08:36.376: INFO: agnhost started at 2022-12-07 17:04:12 +0000 UTC (0+1 container statuses recorded) Dec 7 17:08:36.376: INFO: Container agnhost ready: true, restart count 0 Dec 7 17:08:36.376: INFO: update-demo-nautilus-qpkjm started at 2022-12-07 17:04:13 +0000 UTC (0+1 container statuses recorded) Dec 7 17:08:36.376: INFO: Container update-demo ready: true, restart count 0 Dec 7 17:08:36.651: INFO: Latency metrics for node nodes-us-east4-a-nfxp Dec 7 17:08:36.651: INFO: Logging node info for node nodes-us-east4-a-v6tj Dec 7 17:08:36.774: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east4-a-v6tj 7ccb4554-dd50-4efe-9be3-d3667475ec25 49339 0 2022-12-07 16:49:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east4 failure-domain.beta.kubernetes.io/zone:us-east4-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east4-a-v6tj kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east4-a topology.hostpath.csi/node:nodes-us-east4-a-v6tj topology.kubernetes.io/region:us-east4 topology.kubernetes.io/zone:us-east4-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/instances/nodes-us-east4-a-v6tj"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.2/32 projectcalico.org/IPv4IPIPTunnelAddr:100.123.60.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2022-12-07 16:49:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2022-12-07 16:49:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2022-12-07 16:49:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:49:49 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:49:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {calico-node Update v1 2022-12-07 16:50:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2022-12-07 17:08:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:gce://gce-gci-upg-lat-1-3-ctl-skew/us-east4-a/nodes-us-east4-a-v6tj,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111196160 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006338560 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-07 16:49:59 +0000 UTC,LastTransitionTime:2022-12-07 16:49:59 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-07 17:08:22 +0000 UTC,LastTransitionTime:2022-12-07 16:49:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-07 17:08:22 +0000 UTC,LastTransitionTime:2022-12-07 16:49:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-07 17:08:22 +0000 UTC,LastTransitionTime:2022-12-07 16:49:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-07 17:08:22 +0000 UTC,LastTransitionTime:2022-12-07 16:49:55 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.2,},NodeAddress{Type:ExternalIP,Address:35.245.137.186,},NodeAddress{Type:Hostname,Address:nodes-us-east4-a-v6tj,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a77ca3c48fb1245cde75a6429c818c0a,SystemUUID:a77ca3c4-8fb1-245c-de75-a6429c818c0a,BootID:65d4f8a4-acd4-4bf8-8839-6a047fad3abd,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:b83c1d70989e1fe87583607bf5aee1ee34e52773d4755b95f5cf5a451962f3a4 registry.k8s.io/etcd:3.5.5-0],SizeBytes:102417044,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.4],SizeBytes:63279305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:51155161,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 registry.k8s.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:7000509,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 7 17:08:36.775: INFO: Logging kubelet events for node nodes-us-east4-a-v6tj Dec 7 17:08:36.826: INFO: Logging pods the kubelet thinks is on node nodes-us-east4-a-v6tj Dec 7 17:08:36.900: INFO: calico-node-j442m started at 2022-12-07 16:49:37 +0000 UTC (3+1 container statuses recorded) Dec 7 17:08:36.900: INFO: Init container upgrade-ipam ready: true, restart count 0 Dec 7 17:08:36.900: INFO: Init container install-cni ready: true, restart count 0 Dec 7 17:08:36.900: INFO: Init container mount-bpffs ready: true, restart count 0 Dec 7 17:08:36.900: INFO: Container calico-node ready: true, restart count 0 Dec 7 17:08:36.900: INFO: test-rolling-update-with-lb-8cc597cbd-m9pdj started at 2022-12-07 17:07:47 +0000 UTC (0+1 container statuses recorded) Dec 7 17:08:36.900: INFO: Container agnhost ready: true, restart count 0 Dec 7 17:08:36.900: INFO: netserver-2 started at 2022-12-07 17:08:30 +0000 UTC (0+1 container statuses recorded) Dec 7 17:08:36.900: INFO: Container webserver ready: false, restart count 0 Dec 7 17:08:36.900: INFO: csi-gce-pd-node-n8bdx started at 2022-12-07 16:49:37 +0000 UTC (0+2 container statuses recorded) Dec 7 17:08:36.900: INFO: Container csi-driver-registrar ready: true, restart count 0 Dec 7 17:08:36.900: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 17:08:36.900: INFO: webserver-pod started at 2022-12-07 17:05:48 +0000 UTC (0+1 container statuses recorded) Dec 7 17:08:36.900: INFO: Container agnhost ready: false, restart count 0 Dec 7 17:08:36.900: INFO: hostexec-nodes-us-east4-a-v6tj-7qz48 started at 2022-12-07 17:08:25 +0000 UTC (0+1 container statuses recorded) Dec 7 17:08:36.900: INFO: Container agnhost-container ready: true, restart count 0 Dec 7 17:08:36.900: INFO: pod-secrets-68de91e1-d0f4-4d3e-b76a-839db1d49cd6 started at 2022-12-07 17:07:41 +0000 UTC (0+3 container statuses recorded) Dec 7 17:08:36.900: INFO: Container creates-volume-test ready: true, restart count 0 Dec 7 17:08:36.900: INFO: Container dels-volume-test ready: true, restart count 0 Dec 7 17:08:36.900: INFO: Container upds-volume-test ready: true, restart count 0 Dec 7 17:08:36.900: INFO: kube-proxy-nodes-us-east4-a-v6tj started at 2022-12-07 16:49:37 +0000 UTC (0+1 container statuses recorded) Dec 7 17:08:36.900: INFO: Container kube-proxy ready: true, restart count 0 Dec 7 17:08:36.900: INFO: csi-mockplugin-0 started at 2022-12-07 17:08:31 +0000 UTC (0+4 container statuses recorded) Dec 7 17:08:36.900: INFO: Container busybox ready: true, restart count 0 Dec 7 17:08:36.900: INFO: Container csi-provisioner ready: true, restart count 0 Dec 7 17:08:36.900: INFO: Container driver-registrar ready: true, restart count 0 Dec 7 17:08:36.900: INFO: Container mock ready: true, restart count 0 Dec 7 17:08:36.900: INFO: netserver-2 started at 2022-12-07 17:08:32 +0000 UTC (0+1 container statuses recorded) Dec 7 17:08:36.900: INFO: Container webserver ready: false, restart count 0 Dec 7 17:08:37.349: INFO: Latency metrics for node nodes-us-east4-a-v6tj Dec 7 17:08:37.349: INFO: Logging node info for node nodes-us-east4-a-zc10 Dec 7 17:08:37.381: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east4-a-zc10 c6cc41ef-a044-4188-9cdf-9af619e808de 45573 0 2022-12-07 16:49:31 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east4 failure-domain.beta.kubernetes.io/zone:us-east4-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east4-a-zc10 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east4-a topology.hostpath.csi/node:nodes-us-east4-a-zc10 topology.kubernetes.io/region:us-east4 topology.kubernetes.io/zone:us-east4-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/instances/nodes-us-east4-a-zc10"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.4/32 projectcalico.org/IPv4IPIPTunnelAddr:100.113.50.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-12-07 16:49:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:49:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2022-12-07 16:49:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:49:41 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:49:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {calico-node Update v1 2022-12-07 16:49:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2022-12-07 17:07:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:gce://gce-gci-upg-lat-1-3-ctl-skew/us-east4-a/nodes-us-east4-a-zc10,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111196160 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006338560 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-07 16:49:56 +0000 UTC,LastTransitionTime:2022-12-07 16:49:56 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-07 17:06:54 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-07 17:06:54 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-07 17:06:54 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-07 17:06:54 +0000 UTC,LastTransitionTime:2022-12-07 16:49:52 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.4,},NodeAddress{Type:ExternalIP,Address:35.188.253.28,},NodeAddress{Type:Hostname,Address:nodes-us-east4-a-zc10,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f5ea7883cc54b5706859a5f8fc4d24dd,SystemUUID:f5ea7883-cc54-b570-6859-a5f8fc4d24dd,BootID:6c425a3b-23de-41f0-9815-f6a0465861ce,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.4],SizeBytes:63279305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:51155161,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:7000509,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 7 17:08:37.382: INFO: Logging kubelet events for node nodes-us-east4-a-zc10 Dec 7 17:08:37.428: INFO: Logging pods the kubelet thinks is on node nodes-us-east4-a-zc10 Dec 7 17:08:37.468: INFO: test-rolling-update-with-lb-8cc597cbd-qzd58 started at 2022-12-07 17:07:43 +0000 UTC (0+1 container statuses recorded) Dec 7 17:08:37.468: INFO: Container agnhost ready: true, restart count 0 Dec 7 17:08:37.468: INFO: netserver-3 started at 2022-12-07 17:08:32 +0000 UTC (0+1 container statuses recorded) Dec 7 17:08:37.468: INFO: Container webserver ready: false, restart count 0 Dec 7 17:08:37.468: INFO: busybox-7731bfbd-bcdf-4213-a094-03a154519eef started at 2022-12-07 17:07:59 +0000 UTC (0+1 container statuses recorded) Dec 7 17:08:37.468: INFO: Container busybox ready: true, restart count 0 Dec 7 17:08:37.468: INFO: csi-gce-pd-node-vtqz7 started at 2022-12-07 16:49:35 +0000 UTC (0+2 container statuses recorded) Dec 7 17:08:37.468: INFO: Container csi-driver-registrar ready: true, restart count 0 Dec 7 17:08:37.468: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 17:08:37.468: INFO: coredns-677fff9cfb-4b88c started at 2022-12-07 16:50:04 +0000 UTC (0+1 container statuses recorded) Dec 7 17:08:37.468: INFO: Container coredns ready: true, restart count 0 Dec 7 17:08:37.468: INFO: netserver-3 started at 2022-12-07 17:08:30 +0000 UTC (0+1 container statuses recorded) Dec 7 17:08:37.468: INFO: Container webserver ready: false, restart count 0 Dec 7 17:08:37.468: INFO: pod-ephm-test-configmap-g5f7 started at 2022-12-07 17:07:13 +0000 UTC (0+1 container statuses recorded) Dec 7 17:08:37.468: INFO: Container test-container-subpath-configmap-g5f7 ready: false, restart count 0 Dec 7 17:08:37.468: INFO: pod-ephm-test-secret-tm6m started at 2022-12-07 17:07:09 +0000 UTC (0+1 container statuses recorded) Dec 7 17:08:37.468: INFO: Container test-container-subpath-secret-tm6m ready: false, restart count 0 Dec 7 17:08:37.468: INFO: liveness-0ec6faa2-e338-4ac1-95f2-623f0e274df1 started at 2022-12-07 17:06:13 +0000 UTC (0+1 container statuses recorded) Dec 7 17:08:37.468: INFO: Container agnhost-container ready: true, restart count 0 Dec 7 17:08:37.468: INFO: update-demo-nautilus-n6zs4 started at 2022-12-07 17:03:49 +0000 UTC (0+1 container statuses recorded) Dec 7 17:08:37.468: INFO: Container update-demo ready: true, restart count 0 Dec 7 17:08:37.468: INFO: kube-proxy-nodes-us-east4-a-zc10 started at 2022-12-07 16:49:35 +0000 UTC (0+1 container statuses recorded) Dec 7 17:08:37.468: INFO: Container kube-proxy ready: true, restart count 0 Dec 7 17:08:37.468: INFO: calico-node-g8zkr started at 2022-12-07 16:49:35 +0000 UTC (3+1 container statuses recorded) Dec 7 17:08:37.468: INFO: Init container upgrade-ipam ready: true, restart count 0 Dec 7 17:08:37.468: INFO: Init container install-cni ready: true, restart count 0 Dec 7 17:08:37.468: INFO: Init container mount-bpffs ready: true, restart count 0 Dec 7 17:08:37.468: INFO: Container calico-node ready: true, restart count 0 Dec 7 17:08:37.663: INFO: Latency metrics for node nodes-us-east4-a-zc10 Dec 7 17:08:37.663: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP:�[0m Destroying namespace "dns-7212" for this suite. �[38;5;243m12/07/22 17:08:37.697�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-network\]\sProxy\sversion\sv1\sA\sset\sof\svalid\sresponses\sare\sreturned\sfor\sboth\spod\sand\sservice\sProxy\s\[Conformance\]$'
test/e2e/network/proxy.go:451 k8s.io/kubernetes/test/e2e/network.glob..func24.1.5() test/e2e/network/proxy.go:451 +0xd88from junit_01.xml
{"msg":"FAILED [sig-network] Proxy version v1 A set of valid responses are returned for both pod and service Proxy [Conformance]","completed":31,"skipped":164,"failed":1,"failures":["[sig-network] Proxy version v1 A set of valid responses are returned for both pod and service Proxy [Conformance]"]} [BeforeEach] version v1 test/e2e/framework/framework.go:186 �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m12/07/22 17:08:03.964�[0m Dec 7 17:08:03.964: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP:�[0m Building a namespace api object, basename proxy �[38;5;243m12/07/22 17:08:03.965�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m12/07/22 17:08:04.057�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m12/07/22 17:08:04.11�[0m [It] A set of valid responses are returned for both pod and service Proxy [Conformance] test/e2e/network/proxy.go:380 Dec 7 17:08:04.162: INFO: Creating pod... Dec 7 17:08:04.199: INFO: Waiting up to 5m0s for pod "agnhost" in namespace "proxy-199" to be "running" Dec 7 17:08:04.231: INFO: Pod "agnhost": Phase="Pending", Reason="", readiness=false. Elapsed: 32.415415ms Dec 7 17:08:06.260: INFO: Pod "agnhost": Phase="Running", Reason="", readiness=true. Elapsed: 2.060945052s Dec 7 17:08:06.260: INFO: Pod "agnhost" satisfied condition "running" Dec 7 17:08:06.260: INFO: Creating service... Dec 7 17:08:06.301: INFO: Starting http.Client for https://34.145.193.77/api/v1/namespaces/proxy-199/pods/agnhost/proxy?method=DELETE Dec 7 17:08:36.329: INFO: http.Client request:DELETE | StatusCode:503 | Response: | Method: Dec 7 17:09:06.371: INFO: http.Client request:DELETE | StatusCode:503 | Response: | Method: Dec 7 17:09:36.407: INFO: http.Client request:DELETE | StatusCode:503 | Response: | Method: Dec 7 17:10:06.436: INFO: http.Client request:DELETE | StatusCode:503 | Response: | Method: Dec 7 17:10:06.436: INFO: Unexpected error: Pod didn't start within time out period. timed out waiting for the condition: <*errors.errorString | 0xc0002358b0>: { s: "timed out waiting for the condition", } Dec 7 17:10:06.436: FAIL: Pod didn't start within time out period. timed out waiting for the condition: timed out waiting for the condition Full Stack Trace k8s.io/kubernetes/test/e2e/network.glob..func24.1.5() test/e2e/network/proxy.go:451 +0xd88 [AfterEach] version v1 test/e2e/framework/framework.go:187 �[1mSTEP:�[0m Collecting events from namespace "proxy-199". �[38;5;243m12/07/22 17:10:06.436�[0m �[1mSTEP:�[0m Found 4 events. �[38;5;243m12/07/22 17:10:06.465�[0m Dec 7 17:10:06.465: INFO: At 2022-12-07 17:08:04 +0000 UTC - event for agnhost: {default-scheduler } Scheduled: Successfully assigned proxy-199/agnhost to nodes-us-east4-a-nfxp Dec 7 17:10:06.465: INFO: At 2022-12-07 17:08:04 +0000 UTC - event for agnhost: {kubelet nodes-us-east4-a-nfxp} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.40" already present on machine Dec 7 17:10:06.465: INFO: At 2022-12-07 17:08:04 +0000 UTC - event for agnhost: {kubelet nodes-us-east4-a-nfxp} Created: Created container agnhost Dec 7 17:10:06.465: INFO: At 2022-12-07 17:08:05 +0000 UTC - event for agnhost: {kubelet nodes-us-east4-a-nfxp} Started: Started container agnhost Dec 7 17:10:06.503: INFO: POD NODE PHASE GRACE CONDITIONS Dec 7 17:10:06.503: INFO: agnhost nodes-us-east4-a-nfxp Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-07 17:08:04 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-12-07 17:08:05 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-12-07 17:08:05 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-07 17:08:04 +0000 UTC }] Dec 7 17:10:06.503: INFO: Dec 7 17:10:06.581: INFO: Logging node info for node control-plane-us-east4-a-vd91 Dec 7 17:10:06.608: INFO: Node Info: &Node{ObjectMeta:{control-plane-us-east4-a-vd91 74d54d8e-e0bc-4c7d-bf3c-5b66ce025930 51325 0 2022-12-07 16:47:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-standard-2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east4 failure-domain.beta.kubernetes.io/zone:us-east4-a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:control-plane-us-east4-a-vd91 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node-role.kubernetes.io/node: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:e2-standard-2 topology.gke.io/zone:us-east4-a topology.kubernetes.io/region:us-east4 topology.kubernetes.io/zone:us-east4-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/instances/control-plane-us-east4-a-vd91"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.5/32 projectcalico.org/IPv4IPIPTunnelAddr:100.101.18.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-12-07 16:47:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2022-12-07 16:48:18 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {calico-node Update v1 2022-12-07 16:48:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}}}}} status} {cloud-controller-manager Update v1 2022-12-07 16:48:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2022-12-07 16:48:34 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:48:39 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:48:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-12-07 17:09:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:gce://gce-gci-upg-lat-1-3-ctl-skew/us-east4-a/control-plane-us-east4-a-vd91,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8332767232 0} {<nil>} 8137468Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8227909632 0} {<nil>} 8035068Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-07 16:48:39 +0000 UTC,LastTransitionTime:2022-12-07 16:48:39 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-07 17:09:22 +0000 UTC,LastTransitionTime:2022-12-07 16:47:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-07 17:09:22 +0000 UTC,LastTransitionTime:2022-12-07 16:47:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-07 17:09:22 +0000 UTC,LastTransitionTime:2022-12-07 16:47:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-07 17:09:22 +0000 UTC,LastTransitionTime:2022-12-07 16:48:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.5,},NodeAddress{Type:ExternalIP,Address:35.245.23.229,},NodeAddress{Type:Hostname,Address:control-plane-us-east4-a-vd91,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e32750d839dd77bbe79d8a1be267141a,SystemUUID:e32750d8-39dd-77bb-e79d-8a1be267141a,BootID:572b6367-72b8-4ea4-b559-5c84c54662ce,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gcr.io/k8s-staging-etcdadm/etcd-manager@sha256:f3a63853502cb3956fa708fea524be3b333036ebc1cd1dadd81abd9f1fe61043 gcr.io/k8s-staging-etcdadm/etcd-manager:v3.0.20220831-21-g12041b4c],SizeBytes:231516108,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.25.4],SizeBytes:129085904,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.25.4],SizeBytes:118436153,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.4],SizeBytes:63279305,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.25.4],SizeBytes:51921208,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-alpha.2],SizeBytes:42203406,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-alpha.2],SizeBytes:41463710,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:2b6acd7f677f76ffe12ecf3ea7df92eb9b1bdb07336d1ac2a54c7631fb753f7e docker.io/calico/kube-controllers:v3.24.5],SizeBytes:31137169,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2 registry.k8s.io/sig-storage/csi-provisioner:v2.1.0],SizeBytes:21205045,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:50c3cfd458fc8e0bf3c8c521eac39172009382fc66dc5044a330d137c6ed0b09 registry.k8s.io/sig-storage/csi-attacher:v3.1.0],SizeBytes:20103959,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a registry.k8s.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:9af9bf28430b00a0cedeb2ec29acadce45e6afcecd8bdf31c793c624cfa75fa7 registry.k8s.io/sig-storage/csi-snapshotter:v3.0.3],SizeBytes:19500777,},ContainerImage{Names:[docker.io/k8scloudprovidergcp/cloud-controller-manager@sha256:881fd1095937638040723973ade90e6700f1c831a78fb585a3227c4d021b0df9 docker.io/k8scloudprovidergcp/cloud-controller-manager:latest],SizeBytes:18702875,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-alpha.2],SizeBytes:4954573,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 7 17:10:06.608: INFO: Logging kubelet events for node control-plane-us-east4-a-vd91 Dec 7 17:10:06.647: INFO: Logging pods the kubelet thinks is on node control-plane-us-east4-a-vd91 Dec 7 17:10:06.711: INFO: kube-scheduler-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:06.711: INFO: Container kube-scheduler ready: true, restart count 0 Dec 7 17:10:06.711: INFO: etcd-manager-main-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:06.711: INFO: Container etcd-manager ready: true, restart count 0 Dec 7 17:10:06.711: INFO: kube-apiserver-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+2 container statuses recorded) Dec 7 17:10:06.711: INFO: Container healthcheck ready: true, restart count 0 Dec 7 17:10:06.711: INFO: Container kube-apiserver ready: true, restart count 1 Dec 7 17:10:06.711: INFO: csi-gce-pd-controller-689c9f4444-b5qql started at 2022-12-07 16:48:18 +0000 UTC (0+5 container statuses recorded) Dec 7 17:10:06.711: INFO: Container csi-attacher ready: true, restart count 0 Dec 7 17:10:06.711: INFO: Container csi-provisioner ready: true, restart count 0 Dec 7 17:10:06.711: INFO: Container csi-resizer ready: true, restart count 0 Dec 7 17:10:06.711: INFO: Container csi-snapshotter ready: true, restart count 0 Dec 7 17:10:06.711: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 17:10:06.711: INFO: etcd-manager-events-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:06.711: INFO: Container etcd-manager ready: true, restart count 0 Dec 7 17:10:06.711: INFO: kube-controller-manager-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:06.711: INFO: Container kube-controller-manager ready: true, restart count 2 Dec 7 17:10:06.711: INFO: dns-controller-8946976bb-6t8hj started at 2022-12-07 16:48:19 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:06.711: INFO: Container dns-controller ready: true, restart count 0 Dec 7 17:10:06.711: INFO: kube-proxy-control-plane-us-east4-a-vd91 started at 2022-12-07 16:47:00 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:06.711: INFO: Container kube-proxy ready: true, restart count 0 Dec 7 17:10:06.711: INFO: csi-gce-pd-node-z9fsn started at 2022-12-07 16:48:06 +0000 UTC (0+2 container statuses recorded) Dec 7 17:10:06.711: INFO: Container csi-driver-registrar ready: true, restart count 0 Dec 7 17:10:06.711: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 17:10:06.711: INFO: kops-controller-mnn6f started at 2022-12-07 16:48:18 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:06.711: INFO: Container kops-controller ready: true, restart count 0 Dec 7 17:10:06.711: INFO: cloud-controller-manager-xd6xh started at 2022-12-07 16:48:18 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:06.711: INFO: Container cloud-controller-manager ready: true, restart count 0 Dec 7 17:10:06.711: INFO: calico-node-zgvgx started at 2022-12-07 16:48:06 +0000 UTC (3+1 container statuses recorded) Dec 7 17:10:06.711: INFO: Init container upgrade-ipam ready: true, restart count 0 Dec 7 17:10:06.711: INFO: Init container install-cni ready: true, restart count 0 Dec 7 17:10:06.711: INFO: Init container mount-bpffs ready: true, restart count 0 Dec 7 17:10:06.711: INFO: Container calico-node ready: true, restart count 0 Dec 7 17:10:06.711: INFO: calico-kube-controllers-7bc879d8d6-t4vrx started at 2022-12-07 16:48:39 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:06.711: INFO: Container calico-kube-controllers ready: true, restart count 0 Dec 7 17:10:06.936: INFO: Latency metrics for node control-plane-us-east4-a-vd91 Dec 7 17:10:06.936: INFO: Logging node info for node nodes-us-east4-a-5680 Dec 7 17:10:06.964: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east4-a-5680 b9473b45-598f-43c3-aafc-dc872ade1274 52762 0 2022-12-07 16:49:31 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east4 failure-domain.beta.kubernetes.io/zone:us-east4-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east4-a-5680 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east4-a topology.hostpath.csi/node:nodes-us-east4-a-5680 topology.kubernetes.io/region:us-east4 topology.kubernetes.io/zone:us-east4-a] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-5034":"nodes-us-east4-a-5680","pd.csi.storage.gke.io":"projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/instances/nodes-us-east4-a-5680"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.3/32 projectcalico.org/IPv4IPIPTunnelAddr:100.119.115.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2022-12-07 16:49:31 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2022-12-07 16:49:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2022-12-07 16:49:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:49:41 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:49:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {calico-node Update v1 2022-12-07 16:49:59 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2022-12-07 17:09:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:gce://gce-gci-upg-lat-1-3-ctl-skew/us-east4-a/nodes-us-east4-a-5680,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-07 16:49:58 +0000 UTC,LastTransitionTime:2022-12-07 16:49:58 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-07 17:09:58 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-07 17:09:58 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-07 17:09:58 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-07 17:09:58 +0000 UTC,LastTransitionTime:2022-12-07 16:49:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.3,},NodeAddress{Type:ExternalIP,Address:34.86.83.231,},NodeAddress{Type:Hostname,Address:nodes-us-east4-a-5680,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:5676434e0327952eef9a8130969e32db,SystemUUID:5676434e-0327-952e-ef9a-8130969e32db,BootID:f4cd280b-a7ea-43c2-b78f-d43fab064010,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.4],SizeBytes:63279305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:51155161,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 registry.k8s.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 7 17:10:06.964: INFO: Logging kubelet events for node nodes-us-east4-a-5680 Dec 7 17:10:07.007: INFO: Logging pods the kubelet thinks is on node nodes-us-east4-a-5680 Dec 7 17:10:07.046: INFO: inline-volume-qdfzg started at 2022-12-07 17:08:47 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:07.046: INFO: Container volume-tester ready: false, restart count 0 Dec 7 17:10:07.046: INFO: calico-node-wvpd9 started at 2022-12-07 16:49:34 +0000 UTC (3+1 container statuses recorded) Dec 7 17:10:07.046: INFO: Init container upgrade-ipam ready: true, restart count 0 Dec 7 17:10:07.046: INFO: Init container install-cni ready: true, restart count 0 Dec 7 17:10:07.046: INFO: Init container mount-bpffs ready: true, restart count 0 Dec 7 17:10:07.046: INFO: Container calico-node ready: true, restart count 0 Dec 7 17:10:07.046: INFO: pod-subpath-test-preprovisionedpv-6bb9 started at 2022-12-07 17:10:01 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:07.046: INFO: Container test-container-subpath-preprovisionedpv-6bb9 ready: false, restart count 0 Dec 7 17:10:07.046: INFO: adopt-release-wtxr5 started at 2022-12-07 17:09:19 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:07.046: INFO: Container c ready: true, restart count 0 Dec 7 17:10:07.046: INFO: service-headless-toggled-wbx45 started at 2022-12-07 17:09:18 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:07.046: INFO: Container service-headless-toggled ready: true, restart count 0 Dec 7 17:10:07.046: INFO: kube-proxy-nodes-us-east4-a-5680 started at 2022-12-07 16:49:34 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:07.046: INFO: Container kube-proxy ready: true, restart count 0 Dec 7 17:10:07.046: INFO: execpodkljth started at 2022-12-07 17:09:57 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:07.046: INFO: Container agnhost-container ready: true, restart count 0 Dec 7 17:10:07.046: INFO: service-headless-bhtl2 started at 2022-12-07 17:09:12 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:07.046: INFO: Container service-headless ready: true, restart count 0 Dec 7 17:10:07.046: INFO: csi-mockplugin-attacher-0 started at 2022-12-07 17:08:22 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:07.046: INFO: Container csi-attacher ready: true, restart count 0 Dec 7 17:10:07.046: INFO: csi-gce-pd-node-9n22s started at 2022-12-07 16:49:34 +0000 UTC (0+2 container statuses recorded) Dec 7 17:10:07.046: INFO: Container csi-driver-registrar ready: true, restart count 0 Dec 7 17:10:07.046: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 17:10:07.046: INFO: adopt-release-h58rh started at 2022-12-07 17:09:19 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:07.046: INFO: Container c ready: true, restart count 0 Dec 7 17:10:07.046: INFO: hostexec-nodes-us-east4-a-5680-dlvcq started at 2022-12-07 17:09:42 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:07.046: INFO: Container agnhost-container ready: true, restart count 0 Dec 7 17:10:07.046: INFO: csi-mockplugin-0 started at 2022-12-07 17:08:22 +0000 UTC (0+3 container statuses recorded) Dec 7 17:10:07.046: INFO: Container csi-provisioner ready: true, restart count 0 Dec 7 17:10:07.046: INFO: Container driver-registrar ready: true, restart count 0 Dec 7 17:10:07.046: INFO: Container mock ready: true, restart count 0 Dec 7 17:10:07.046: INFO: csi-mockplugin-resizer-0 started at 2022-12-07 17:08:22 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:07.046: INFO: Container csi-resizer ready: true, restart count 0 Dec 7 17:10:07.046: INFO: netserver-0 started at 2022-12-07 17:09:33 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:07.046: INFO: Container webserver ready: true, restart count 0 Dec 7 17:10:07.046: INFO: deployment-749564ff97-jxzk2 started at 2022-12-07 17:09:41 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:07.046: INFO: Container nginx ready: false, restart count 0 Dec 7 17:10:07.251: INFO: Latency metrics for node nodes-us-east4-a-5680 Dec 7 17:10:07.251: INFO: Logging node info for node nodes-us-east4-a-nfxp Dec 7 17:10:07.278: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east4-a-nfxp 958029bf-d66a-424c-a80d-b1d485df133b 49893 0 2022-12-07 16:49:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east4 failure-domain.beta.kubernetes.io/zone:us-east4-a io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east4-a-nfxp kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east4-a topology.hostpath.csi/node:nodes-us-east4-a-nfxp topology.kubernetes.io/region:us-east4 topology.kubernetes.io/zone:us-east4-a] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-206":"nodes-us-east4-a-nfxp","pd.csi.storage.gke.io":"projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/instances/nodes-us-east4-a-nfxp"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.6/32 projectcalico.org/IPv4IPIPTunnelAddr:100.113.109.192 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2022-12-07 16:49:28 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2022-12-07 16:49:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2022-12-07 16:49:29 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:49:41 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:49:48 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {calico-node Update v1 2022-12-07 16:49:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2022-12-07 17:08:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:gce://gce-gci-upg-lat-1-3-ctl-skew/us-east4-a/nodes-us-east4-a-nfxp,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-07 16:49:53 +0000 UTC,LastTransitionTime:2022-12-07 16:49:53 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-07 17:08:34 +0000 UTC,LastTransitionTime:2022-12-07 16:49:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-07 17:08:34 +0000 UTC,LastTransitionTime:2022-12-07 16:49:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-07 17:08:34 +0000 UTC,LastTransitionTime:2022-12-07 16:49:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-07 17:08:34 +0000 UTC,LastTransitionTime:2022-12-07 16:49:48 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.6,},NodeAddress{Type:ExternalIP,Address:34.145.242.1,},NodeAddress{Type:Hostname,Address:nodes-us-east4-a-nfxp,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:796e3b73d867da488abd70a5df2fe10f,SystemUUID:796e3b73-d867-da48-8abd-70a5df2fe10f,BootID:2b784aad-5897-4bb4-bb49-6bae545d9488,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:b83c1d70989e1fe87583607bf5aee1ee34e52773d4755b95f5cf5a451962f3a4 registry.k8s.io/etcd:3.5.5-0],SizeBytes:102417044,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.4],SizeBytes:63279305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:51155161,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:f9c93b92b6ff750b41a93c4e4fe0bfe384597aeb841e2539d5444815c55b2d8f registry.k8s.io/e2e-test-images/sample-apiserver:1.17.5],SizeBytes:24316368,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:aa60f453d64dfb3c3fd9e7306f988c36c6352c4f2d956aa90467f2808091effa registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.5],SizeBytes:15209420,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:38e6b091d238094f081efad3e2b362e6480b2156f5f4fba6ea46835ecdcd47e2 registry.k8s.io/build-image/distroless-iptables:v0.1.1],SizeBytes:7634231,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:7000509,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 7 17:10:07.279: INFO: Logging kubelet events for node nodes-us-east4-a-nfxp Dec 7 17:10:07.321: INFO: Logging pods the kubelet thinks is on node nodes-us-east4-a-nfxp Dec 7 17:10:07.363: INFO: kube-proxy-nodes-us-east4-a-nfxp started at 2022-12-07 16:49:29 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:07.363: INFO: Container kube-proxy ready: true, restart count 0 Dec 7 17:10:07.363: INFO: my-hostname-private-9e75431e-621c-4eb3-8da2-e3518e05bc2a-gmw8c started at 2022-12-07 17:07:37 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:07.363: INFO: Container my-hostname-private-9e75431e-621c-4eb3-8da2-e3518e05bc2a ready: true, restart count 0 Dec 7 17:10:07.363: INFO: csi-gce-pd-node-vcz5x started at 2022-12-07 16:49:29 +0000 UTC (0+2 container statuses recorded) Dec 7 17:10:07.363: INFO: Container csi-driver-registrar ready: true, restart count 0 Dec 7 17:10:07.363: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 17:10:07.363: INFO: service-headless-qpmc4 started at 2022-12-07 17:09:12 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:07.363: INFO: Container service-headless ready: true, restart count 0 Dec 7 17:10:07.363: INFO: netserver-1 started at 2022-12-07 17:09:33 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:07.363: INFO: Container webserver ready: true, restart count 0 Dec 7 17:10:07.363: INFO: calico-node-f2cxs started at 2022-12-07 16:49:29 +0000 UTC (3+1 container statuses recorded) Dec 7 17:10:07.363: INFO: Init container upgrade-ipam ready: true, restart count 0 Dec 7 17:10:07.363: INFO: Init container install-cni ready: true, restart count 0 Dec 7 17:10:07.363: INFO: Init container mount-bpffs ready: true, restart count 0 Dec 7 17:10:07.363: INFO: Container calico-node ready: true, restart count 0 Dec 7 17:10:07.363: INFO: dns-test-2856f095-86dd-4849-9477-4a6e8c786cb4 started at 2022-12-07 16:53:00 +0000 UTC (0+3 container statuses recorded) Dec 7 17:10:07.363: INFO: Container jessie-querier ready: true, restart count 1 Dec 7 17:10:07.363: INFO: Container querier ready: true, restart count 1 Dec 7 17:10:07.363: INFO: Container webserver ready: true, restart count 0 Dec 7 17:10:07.363: INFO: hostexec-nodes-us-east4-a-nfxp-27h8c started at 2022-12-07 17:10:04 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:07.363: INFO: Container agnhost-container ready: true, restart count 0 Dec 7 17:10:07.363: INFO: csi-mockplugin-0 started at 2022-12-07 17:08:39 +0000 UTC (0+3 container statuses recorded) Dec 7 17:10:07.363: INFO: Container csi-provisioner ready: true, restart count 0 Dec 7 17:10:07.363: INFO: Container driver-registrar ready: true, restart count 0 Dec 7 17:10:07.363: INFO: Container mock ready: true, restart count 0 Dec 7 17:10:07.363: INFO: pvc-volume-tester-4qt5z started at 2022-12-07 17:08:44 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:07.363: INFO: Container volume-tester ready: true, restart count 0 Dec 7 17:10:07.363: INFO: agnhost started at 2022-12-07 17:08:04 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:07.363: INFO: Container agnhost ready: true, restart count 0 Dec 7 17:10:07.363: INFO: coredns-677fff9cfb-rv6b9 started at 2022-12-07 16:49:48 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:07.363: INFO: Container coredns ready: true, restart count 0 Dec 7 17:10:07.363: INFO: coredns-autoscaler-db7b97744-2cf6q started at 2022-12-07 16:49:48 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:07.363: INFO: Container autoscaler ready: true, restart count 0 Dec 7 17:10:07.363: INFO: csi-mockplugin-attacher-0 started at 2022-12-07 17:08:39 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:07.363: INFO: Container csi-attacher ready: true, restart count 0 Dec 7 17:10:07.363: INFO: agnhost started at 2022-12-07 17:04:12 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:07.363: INFO: Container agnhost ready: true, restart count 0 Dec 7 17:10:07.363: INFO: hostexec-nodes-us-east4-a-nfxp-zjlmp started at 2022-12-07 17:09:48 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:07.363: INFO: Container agnhost-container ready: true, restart count 0 Dec 7 17:10:07.363: INFO: webserver-pod started at 2022-12-07 17:06:48 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:07.363: INFO: Container agnhost ready: false, restart count 0 Dec 7 17:10:07.580: INFO: Latency metrics for node nodes-us-east4-a-nfxp Dec 7 17:10:07.580: INFO: Logging node info for node nodes-us-east4-a-v6tj Dec 7 17:10:07.609: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east4-a-v6tj 7ccb4554-dd50-4efe-9be3-d3667475ec25 53015 0 2022-12-07 16:49:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east4 failure-domain.beta.kubernetes.io/zone:us-east4-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east4-a-v6tj kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east4-a topology.hostpath.csi/node:nodes-us-east4-a-v6tj topology.kubernetes.io/region:us-east4 topology.kubernetes.io/zone:us-east4-a] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-1803":"nodes-us-east4-a-v6tj","csi-mock-csi-mock-volumes-1041":"nodes-us-east4-a-v6tj","pd.csi.storage.gke.io":"projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/instances/nodes-us-east4-a-v6tj"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.2/32 projectcalico.org/IPv4IPIPTunnelAddr:100.123.60.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2022-12-07 16:49:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2022-12-07 16:49:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2022-12-07 16:49:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:49:49 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:49:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {calico-node Update v1 2022-12-07 16:50:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2022-12-07 17:10:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:gce://gce-gci-upg-lat-1-3-ctl-skew/us-east4-a/nodes-us-east4-a-v6tj,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111196160 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006338560 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-07 16:49:59 +0000 UTC,LastTransitionTime:2022-12-07 16:49:59 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-07 17:10:04 +0000 UTC,LastTransitionTime:2022-12-07 16:49:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-07 17:10:04 +0000 UTC,LastTransitionTime:2022-12-07 16:49:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-07 17:10:04 +0000 UTC,LastTransitionTime:2022-12-07 16:49:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-07 17:10:04 +0000 UTC,LastTransitionTime:2022-12-07 16:49:55 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.2,},NodeAddress{Type:ExternalIP,Address:35.245.137.186,},NodeAddress{Type:Hostname,Address:nodes-us-east4-a-v6tj,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a77ca3c48fb1245cde75a6429c818c0a,SystemUUID:a77ca3c4-8fb1-245c-de75-a6429c818c0a,BootID:65d4f8a4-acd4-4bf8-8839-6a047fad3abd,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:b83c1d70989e1fe87583607bf5aee1ee34e52773d4755b95f5cf5a451962f3a4 registry.k8s.io/etcd:3.5.5-0],SizeBytes:102417044,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.4],SizeBytes:63279305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:51155161,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb registry.k8s.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 registry.k8s.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:7000509,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 7 17:10:07.609: INFO: Logging kubelet events for node nodes-us-east4-a-v6tj Dec 7 17:10:07.639: INFO: Logging pods the kubelet thinks is on node nodes-us-east4-a-v6tj Dec 7 17:10:07.687: INFO: calico-node-j442m started at 2022-12-07 16:49:37 +0000 UTC (3+1 container statuses recorded) Dec 7 17:10:07.687: INFO: Init container upgrade-ipam ready: true, restart count 0 Dec 7 17:10:07.687: INFO: Init container install-cni ready: true, restart count 0 Dec 7 17:10:07.687: INFO: Init container mount-bpffs ready: true, restart count 0 Dec 7 17:10:07.687: INFO: Container calico-node ready: true, restart count 0 Dec 7 17:10:07.687: INFO: netserver-2 started at 2022-12-07 17:09:33 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:07.687: INFO: Container webserver ready: true, restart count 0 Dec 7 17:10:07.687: INFO: verify-service-up-exec-pod-2ptsz started at 2022-12-07 17:09:59 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:07.687: INFO: Container agnhost-container ready: true, restart count 0 Dec 7 17:10:07.687: INFO: csi-hostpathplugin-0 started at 2022-12-07 17:10:02 +0000 UTC (0+7 container statuses recorded) Dec 7 17:10:07.687: INFO: Container csi-attacher ready: true, restart count 0 Dec 7 17:10:07.687: INFO: Container csi-provisioner ready: true, restart count 0 Dec 7 17:10:07.687: INFO: Container csi-resizer ready: true, restart count 0 Dec 7 17:10:07.687: INFO: Container csi-snapshotter ready: true, restart count 0 Dec 7 17:10:07.687: INFO: Container hostpath ready: true, restart count 0 Dec 7 17:10:07.687: INFO: Container liveness-probe ready: true, restart count 0 Dec 7 17:10:07.687: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 7 17:10:07.687: INFO: deployment-97c6466db-8j54p started at 2022-12-07 17:09:41 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:07.687: INFO: Container nginx ready: false, restart count 0 Dec 7 17:10:07.687: INFO: csi-gce-pd-node-n8bdx started at 2022-12-07 16:49:37 +0000 UTC (0+2 container statuses recorded) Dec 7 17:10:07.687: INFO: Container csi-driver-registrar ready: true, restart count 0 Dec 7 17:10:07.687: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 17:10:07.687: INFO: webserver-pod started at 2022-12-07 17:05:48 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:07.687: INFO: Container agnhost ready: false, restart count 0 Dec 7 17:10:07.687: INFO: service-headless-nq94h started at 2022-12-07 17:09:12 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:07.687: INFO: Container service-headless ready: true, restart count 0 Dec 7 17:10:07.687: INFO: csi-mockplugin-attacher-0 started at 2022-12-07 17:09:35 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:07.687: INFO: Container csi-attacher ready: true, restart count 0 Dec 7 17:10:07.687: INFO: deployment-749564ff97-hqtsk started at 2022-12-07 17:09:41 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:07.687: INFO: Container nginx ready: false, restart count 0 Dec 7 17:10:07.687: INFO: pod1 started at 2022-12-07 17:10:01 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:07.687: INFO: Container agnhost-container ready: true, restart count 0 Dec 7 17:10:07.687: INFO: inline-volume-tester-kkxcz started at 2022-12-07 17:10:02 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:07.687: INFO: Container csi-volume-tester ready: false, restart count 0 Dec 7 17:10:07.687: INFO: service-headless-toggled-222pm started at 2022-12-07 17:09:18 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:07.687: INFO: Container service-headless-toggled ready: true, restart count 0 Dec 7 17:10:07.687: INFO: kube-proxy-nodes-us-east4-a-v6tj started at 2022-12-07 16:49:37 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:07.687: INFO: Container kube-proxy ready: true, restart count 0 Dec 7 17:10:07.687: INFO: csi-mockplugin-0 started at 2022-12-07 17:08:31 +0000 UTC (0+4 container statuses recorded) Dec 7 17:10:07.687: INFO: Container busybox ready: true, restart count 0 Dec 7 17:10:07.687: INFO: Container csi-provisioner ready: false, restart count 1 Dec 7 17:10:07.687: INFO: Container driver-registrar ready: true, restart count 0 Dec 7 17:10:07.687: INFO: Container mock ready: true, restart count 0 Dec 7 17:10:07.687: INFO: csi-mockplugin-0 started at 2022-12-07 17:09:35 +0000 UTC (0+3 container statuses recorded) Dec 7 17:10:07.687: INFO: Container csi-provisioner ready: true, restart count 0 Dec 7 17:10:07.687: INFO: Container driver-registrar ready: true, restart count 0 Dec 7 17:10:07.687: INFO: Container mock ready: true, restart count 0 Dec 7 17:10:07.910: INFO: Latency metrics for node nodes-us-east4-a-v6tj Dec 7 17:10:07.910: INFO: Logging node info for node nodes-us-east4-a-zc10 Dec 7 17:10:07.939: INFO: Node Info: &Node{ObjectMeta:{nodes-us-east4-a-zc10 c6cc41ef-a044-4188-9cdf-9af619e808de 52063 0 2022-12-07 16:49:31 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-east4 failure-domain.beta.kubernetes.io/zone:us-east4-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-east4-a-zc10 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-east4-a topology.hostpath.csi/node:nodes-us-east4-a-zc10 topology.kubernetes.io/region:us-east4 topology.kubernetes.io/zone:us-east4-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/gce-gci-upg-lat-1-3-ctl-skew/zones/us-east4-a/instances/nodes-us-east4-a-zc10"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.4/32 projectcalico.org/IPv4IPIPTunnelAddr:100.113.50.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-12-07 16:49:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:49:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2022-12-07 16:49:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2022-12-07 16:49:41 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-12-07 16:49:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {calico-node Update v1 2022-12-07 16:49:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2022-12-07 17:09:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:gce://gce-gci-upg-lat-1-3-ctl-skew/us-east4-a/nodes-us-east4-a-zc10,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111196160 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006338560 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-12-07 16:49:56 +0000 UTC,LastTransitionTime:2022-12-07 16:49:56 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-07 17:09:28 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-07 17:09:28 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-07 17:09:28 +0000 UTC,LastTransitionTime:2022-12-07 16:49:31 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-07 17:09:28 +0000 UTC,LastTransitionTime:2022-12-07 16:49:52 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.4,},NodeAddress{Type:ExternalIP,Address:35.188.253.28,},NodeAddress{Type:Hostname,Address:nodes-us-east4-a-zc10,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f5ea7883cc54b5706859a5f8fc4d24dd,SystemUUID:f5ea7883-cc54-b570-6859-a5f8fc4d24dd,BootID:6c425a3b-23de-41f0-9815-f6a0465861ce,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.10,KubeletVersion:v1.25.4,KubeProxyVersion:v1.25.4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.25.4],SizeBytes:63279305,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:af7e3857d87770ddb40f5ea4f89b5a2709504ab1ee31f9ea4ab5823c045f2146 registry.k8s.io/e2e-test-images/agnhost:2.40],SizeBytes:51155161,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c registry.k8s.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 registry.k8s.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 registry.k8s.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa registry.k8s.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:89e900a160a986a1a7a4eba7f5259e510398fa87ca9b8a729e7dec59e04c7709 registry.k8s.io/sig-storage/csi-snapshotter:v5.0.1],SizeBytes:22163966,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a registry.k8s.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 registry.k8s.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:4fd21f36075b44d1a423dfb262ad79202ce54e95f5cbc4622a6c1c38ab287ad6 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.0],SizeBytes:9132637,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f registry.k8s.io/e2e-test-images/nginx:1.15-2],SizeBytes:7000509,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 registry.k8s.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 7 17:10:07.940: INFO: Logging kubelet events for node nodes-us-east4-a-zc10 Dec 7 17:10:07.970: INFO: Logging pods the kubelet thinks is on node nodes-us-east4-a-zc10 Dec 7 17:10:08.018: INFO: hostexec-nodes-us-east4-a-zc10-9mk2d started at 2022-12-07 17:09:54 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:08.018: INFO: Container agnhost-container ready: true, restart count 0 Dec 7 17:10:08.018: INFO: execpod962tq started at 2022-12-07 17:10:07 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:08.018: INFO: Container agnhost-container ready: false, restart count 0 Dec 7 17:10:08.018: INFO: liveness-0ec6faa2-e338-4ac1-95f2-623f0e274df1 started at 2022-12-07 17:06:13 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:08.018: INFO: Container agnhost-container ready: true, restart count 0 Dec 7 17:10:08.018: INFO: netserver-3 started at 2022-12-07 17:09:33 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:08.018: INFO: Container webserver ready: true, restart count 0 Dec 7 17:10:08.018: INFO: deployment-749564ff97-kh5fs started at 2022-12-07 17:09:41 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:08.018: INFO: Container nginx ready: false, restart count 0 Dec 7 17:10:08.018: INFO: kube-proxy-nodes-us-east4-a-zc10 started at 2022-12-07 16:49:35 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:08.018: INFO: Container kube-proxy ready: true, restart count 0 Dec 7 17:10:08.018: INFO: calico-node-g8zkr started at 2022-12-07 16:49:35 +0000 UTC (3+1 container statuses recorded) Dec 7 17:10:08.018: INFO: Init container upgrade-ipam ready: true, restart count 0 Dec 7 17:10:08.018: INFO: Init container install-cni ready: true, restart count 0 Dec 7 17:10:08.018: INFO: Init container mount-bpffs ready: true, restart count 0 Dec 7 17:10:08.018: INFO: Container calico-node ready: true, restart count 0 Dec 7 17:10:08.018: INFO: send-events-eda64968-5254-4632-9e8d-6a0d0d941533 started at 2022-12-07 17:09:52 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:08.018: INFO: Container p ready: true, restart count 0 Dec 7 17:10:08.018: INFO: pod-subpath-test-inlinevolume-5kk6 started at 2022-12-07 17:09:58 +0000 UTC (1+1 container statuses recorded) Dec 7 17:10:08.018: INFO: Init container init-volume-inlinevolume-5kk6 ready: true, restart count 0 Dec 7 17:10:08.018: INFO: Container test-container-subpath-inlinevolume-5kk6 ready: true, restart count 0 Dec 7 17:10:08.018: INFO: host-test-container-pod started at 2022-12-07 17:09:56 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:08.018: INFO: Container agnhost-container ready: true, restart count 0 Dec 7 17:10:08.018: INFO: pod-subpath-test-preprovisionedpv-r62s started at 2022-12-07 17:10:07 +0000 UTC (2+1 container statuses recorded) Dec 7 17:10:08.018: INFO: Init container init-volume-preprovisionedpv-r62s ready: false, restart count 0 Dec 7 17:10:08.018: INFO: Init container test-init-volume-preprovisionedpv-r62s ready: false, restart count 0 Dec 7 17:10:08.018: INFO: Container test-container-subpath-preprovisionedpv-r62s ready: false, restart count 0 Dec 7 17:10:08.018: INFO: csi-gce-pd-node-vtqz7 started at 2022-12-07 16:49:35 +0000 UTC (0+2 container statuses recorded) Dec 7 17:10:08.018: INFO: Container csi-driver-registrar ready: true, restart count 0 Dec 7 17:10:08.018: INFO: Container gce-pd-driver ready: true, restart count 0 Dec 7 17:10:08.018: INFO: coredns-677fff9cfb-4b88c started at 2022-12-07 16:50:04 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:08.018: INFO: Container coredns ready: true, restart count 0 Dec 7 17:10:08.018: INFO: test-container-pod started at 2022-12-07 17:09:56 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:08.018: INFO: Container webserver ready: true, restart count 0 Dec 7 17:10:08.018: INFO: service-headless-toggled-pdhdf started at 2022-12-07 17:09:18 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:08.018: INFO: Container service-headless-toggled ready: true, restart count 0 Dec 7 17:10:08.018: INFO: funny-ip-58fds started at 2022-12-07 17:09:47 +0000 UTC (0+1 container statuses recorded) Dec 7 17:10:08.018: INFO: Container funny-ip ready: true, restart count 0 Dec 7 17:10:08.018: INFO: verify-service-down-host-exec-pod started at <nil> (0+0 container statuses recorded) Dec 7 17:10:08.195: INFO: Latency metrics for node nodes-us-east4-a-zc10 Dec 7 17:10:08.195: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP:�[0m Destroying namespace "proxy-199" for this suite. �[38;5;243m12/07/22 17:10:08.224�[0m
Filter through log files | View test history on testgrid
exit status 255
from junit_runner.xml
Filter through log files | View test history on testgrid
Kubernetes e2e suite [It] [sig-api-machinery] API priority and fairness should ensure that requests can be classified by adding FlowSchema and PriorityLevelConfiguration
Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] listing mutating webhooks should work [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] listing validating webhooks should work [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] patching/updating a mutating webhook should work [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] patching/updating a validating webhook should work [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should be able to deny attaching pod [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should be able to deny custom resource creation, update and deletion [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should deny crd creation [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should honor timeout [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should include webhook resources in discovery documents [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should mutate configmap [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should mutate custom resource with different stored version [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should mutate custom resource with pruning [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should mutate pod and apply defaults after mutation [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should not be able to mutate or prevent deletion of webhook configuration objects [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should unconditionally reject operations on fail closed webhook [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin] should be able to convert a non homogeneous list of CRs [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin] should be able to convert from CR v1 to CR v2 [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourceDefinition Watch [Privileged:ClusterAdmin] CustomResourceDefinition Watch watch on custom resource definition objects [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin] Simple CustomResourceDefinition creating/deleting custom resource definition objects works [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin] Simple CustomResourceDefinition getting/updating/patching custom resource definition status sub-resource works [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin] Simple CustomResourceDefinition listing custom resource definition objects works [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin] custom resource defaulting for requests and from storage works [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin] should include custom resource definition resources in discovery documents [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] removes definition from spec when one version gets changed to not be served [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] updates the published spec when one version gets renamed [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] works for CRD preserving unknown fields at the schema root [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] works for CRD preserving unknown fields in an embedded object [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] works for CRD with validation schema [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] works for CRD without validation schema [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] works for multiple CRDs of different groups [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] works for multiple CRDs of same group and version but different kinds [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] works for multiple CRDs of same group but different versions [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourceValidationRules [Privileged:ClusterAdmin] MUST NOT fail validation for create of a custom resource that satisfies the x-kubernetes-validations rules
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourceValidationRules [Privileged:ClusterAdmin] MUST fail create of a custom resource definition that contains a x-kubernetes-validations rule that refers to a property that do not exist
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourceValidationRules [Privileged:ClusterAdmin] MUST fail create of a custom resource definition that contains an x-kubernetes-validations rule that contains a syntax error
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourceValidationRules [Privileged:ClusterAdmin] MUST fail create of a custom resource definition that contains an x-kubernetes-validations rule that exceeds the estimated cost limit
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourceValidationRules [Privileged:ClusterAdmin] MUST fail create of a custom resource that exceeds the runtime cost limit for x-kubernetes-validations rule execution
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourceValidationRules [Privileged:ClusterAdmin] MUST fail update of a custom resource that does not satisfy a x-kubernetes-validations transition rule
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourceValidationRules [Privileged:ClusterAdmin] MUST fail validation for create of a custom resource that does not satisfy the x-kubernetes-validations rules
Kubernetes e2e suite [It] [sig-api-machinery] Discovery Custom resource should have storage version hash
Kubernetes e2e suite [It] [sig-api-machinery] Discovery should accurately determine present and missing resources
Kubernetes e2e suite [It] [sig-api-machinery] Discovery should validate PreferredVersion for each APIGroup [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Garbage collector should delete RS created by deployment when not orphaning [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Garbage collector should delete jobs and pods created by cronjob
Kubernetes e2e suite [It] [sig-api-machinery] Garbage collector should delete pods created by rc when not orphaning [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Garbage collector should keep the rc around until all its pods are deleted if the deleteOptions says so [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Garbage collector should not be blocked by dependency circle [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Garbage collector should not delete dependents that have both valid owner and owner that's waiting for dependents to be deleted [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Garbage collector should orphan RS created by deployment when deleteOptions.PropagationPolicy is Orphan [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Garbage collector should orphan pods created by rc if delete options say so [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Garbage collector should orphan pods created by rc if deleteOptions.OrphanDependents is nil
Kubernetes e2e suite [It] [sig-api-machinery] Garbage collector should support cascading deletion of custom resources
Kubernetes e2e suite [It] [sig-api-machinery] Garbage collector should support orphan deletion of custom resources
Kubernetes e2e suite [It] [sig-api-machinery] Generated clientset should create pods, set the deletionTimestamp and deletionGracePeriodSeconds of the pod
Kubernetes e2e suite [It] [sig-api-machinery] Generated clientset should create v1 cronJobs, delete cronJobs, watch cronJobs
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota should be able to update and delete ResourceQuota. [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a configMap. [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a custom resource.
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a persistent volume claim
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a persistent volume claim with a storage class
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a pod. [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a replica set. [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a replication controller. [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a secret. [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a service. [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota should create a ResourceQuota and ensure its status is promptly calculated. [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota should manage the lifecycle of a ResourceQuota [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota should verify ResourceQuota with best effort scope. [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota should verify ResourceQuota with cross namespace pod affinity scope using scope-selectors.
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota should verify ResourceQuota with terminating scopes. [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Server request timeout default timeout should be used if the specified timeout in the request URL is 0s
Kubernetes e2e suite [It] [sig-api-machinery] Server request timeout should return HTTP status code 400 if the user specifies an invalid timeout in the request URL
Kubernetes e2e suite [It] [sig-api-machinery] Server request timeout the request should be served with a default timeout if the specified timeout in the request URL exceeds maximum allowed
Kubernetes e2e suite [It] [sig-api-machinery] ServerSideApply should create an applied object if it does not already exist
Kubernetes e2e suite [It] [sig-api-machinery] ServerSideApply should give up ownership of a field if forced applied by a controller
Kubernetes e2e suite [It] [sig-api-machinery] ServerSideApply should ignore conflict errors if force apply is used
Kubernetes e2e suite [It] [sig-api-machinery] ServerSideApply should not remove a field if an owner unsets the field but other managers still have ownership of the field
Kubernetes e2e suite [It] [sig-api-machinery] ServerSideApply should remove a field if it is owned but removed in the apply request
Kubernetes e2e suite [It] [sig-api-machinery] ServerSideApply should work for CRDs
Kubernetes e2e suite [It] [sig-api-machinery] ServerSideApply should work for subresources
Kubernetes e2e suite [It] [sig-api-machinery] Servers with support for API chunking should return chunks of results for list calls
Kubernetes e2e suite [It] [sig-api-machinery] Servers with support for Table transformation should return a 406 for a backend which does not implement metadata [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Servers with support for Table transformation should return chunks of table results for list calls
Kubernetes e2e suite [It] [sig-api-machinery] Servers with support for Table transformation should return generic metadata details across all namespaces for nodes
Kubernetes e2e suite [It] [sig-api-machinery] Servers with support for Table transformation should return pod details
Kubernetes e2e suite [It] [sig-api-machinery] Watchers should be able to restart watching from the last resource version observed by the previous watch [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Watchers should be able to start watching from a specific resource version [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Watchers should observe add, update, and delete watch notifications on configmaps [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Watchers should observe an object deletion if it stops meeting the requirements of the selector [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Watchers should receive events on concurrent watches in same order [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] client-go should negotiate watch and report errors with accept "application/json"
Kubernetes e2e suite [It] [sig-api-machinery] client-go should negotiate watch and report errors with accept "application/json,application/vnd.kubernetes.protobuf"
Kubernetes e2e suite [It] [sig-api-machinery] client-go should negotiate watch and report errors with accept "application/vnd.kubernetes.protobuf"
Kubernetes e2e suite [It] [sig-api-machinery] client-go should negotiate watch and report errors with accept "application/vnd.kubernetes.protobuf,application/json"
Kubernetes e2e suite [It] [sig-api-machinery] health handlers should contain necessary checks
Kubernetes e2e suite [It] [sig-api-machinery] server version should find the server version [Conformance]
Kubernetes e2e suite [It] [sig-apps] CronJob should be able to schedule after more than 100 missed schedule
Kubernetes e2e suite [It] [sig-apps] CronJob should delete failed finished jobs with limit of one job
Kubernetes e2e suite [It] [sig-apps] CronJob should delete successful finished jobs with limit of one successful job
Kubernetes e2e suite [It] [sig-apps] CronJob should not emit unexpected warnings
Kubernetes e2e suite [It] [sig-apps] CronJob should remove from active list jobs that have been deleted
Kubernetes e2e suite [It] [sig-apps] CronJob should replace jobs when ReplaceConcurrent [Conformance]
Kubernetes e2e suite [It] [sig-apps] CronJob should schedule multiple jobs concurrently [Conformance]
Kubernetes e2e suite [It] [sig-apps] CronJob should support CronJob API operations [Conformance]
Kubernetes e2e suite [It] [sig-apps] CronJob should support timezone
Kubernetes e2e suite [It] [sig-apps] Deployment Deployment should have a working scale subresource [Conformance]
Kubernetes e2e suite [It] [sig-apps] Deployment RecreateDeployment should delete old pods and create new ones [Conformance]
Kubernetes e2e suite [It] [sig-apps] Deployment RollingUpdateDeployment should delete old pods and create new ones [Conformance]
Kubernetes e2e suite [It] [sig-apps] Deployment deployment reaping should cascade to its replica sets and pods
Kubernetes e2e suite [It] [sig-apps] Deployment deployment should delete old replica sets [Conformance]
Kubernetes e2e suite [It] [sig-apps] Deployment deployment should support proportional scaling [Conformance]
Kubernetes e2e suite [It] [sig-apps] Deployment deployment should support rollover [Conformance]
Kubernetes e2e suite [It] [sig-apps] Deployment iterative rollouts should eventually progress
Kubernetes e2e suite [It] [sig-apps] Deployment should not disrupt a cloud load-balancer's connectivity during rollout
Kubernetes e2e suite [It] [sig-apps] Deployment should run the lifecycle of a Deployment [Conformance]
Kubernetes e2e suite [It] [sig-apps] Deployment should validate Deployment Status endpoints [Conformance]
Kubernetes e2e suite [It] [sig-apps] Deployment test Deployment ReplicaSet orphaning and adoption regarding controllerRef
Kubernetes e2e suite [It] [sig-apps] DisruptionController Listing PodDisruptionBudgets for all namespaces should list and delete a collection of PodDisruptionBudgets [Conformance]
Kubernetes e2e suite [It] [sig-apps] DisruptionController evictions: enough pods, absolute => should allow an eviction
Kubernetes e2e suite [It] [sig-apps] DisruptionController evictions: enough pods, replicaSet, percentage => should allow an eviction
Kubernetes e2e suite [It] [sig-apps] DisruptionController evictions: maxUnavailable allow single eviction, percentage => should allow an eviction
Kubernetes e2e suite [It] [sig-apps] DisruptionController evictions: no PDB => should allow an eviction
Kubernetes e2e suite [It] [sig-apps] DisruptionController evictions: too few pods, absolute => should not allow an eviction
Kubernetes e2e suite [It] [sig-apps] DisruptionController should block an eviction until the PDB is updated to allow it [Conformance]
Kubernetes e2e suite [It] [sig-apps] DisruptionController should create a PodDisruptionBudget [Conformance]
Kubernetes e2e suite [It] [sig-apps] DisruptionController should observe PodDisruptionBudget status updated [Conformance]
Kubernetes e2e suite [It] [sig-apps] DisruptionController should observe that the PodDisruptionBudget status is not updated for unmanaged pods
Kubernetes e2e suite [It] [sig-apps] DisruptionController should update/patch PodDisruptionBudget status [Conformance]
Kubernetes e2e suite [It] [sig-apps] Job should adopt matching orphans and release non-matching pods [Conformance]
Kubernetes e2e suite [It] [sig-apps] Job should apply changes to a job status [Conformance]
Kubernetes e2e suite [It] [sig-apps] Job should create pods for an Indexed job with completion indexes and specified hostname [Conformance]
Kubernetes e2e suite [It] [sig-apps] Job should delete a job [Conformance]
Kubernetes e2e suite [It] [sig-apps] Job should delete pods when suspended
Kubernetes e2e suite [It] [sig-apps] Job should fail to exceed backoffLimit
Kubernetes e2e suite [It] [sig-apps] Job should fail when exceeds active deadline
Kubernetes e2e suite [It] [sig-apps] Job should manage the lifecycle of a job [Conformance]
Kubernetes e2e suite [It] [sig-apps] Job should not create pods when created in suspend state
Kubernetes e2e suite [It] [sig-apps] Job should remove pods when job is deleted
Kubernetes e2e suite [It] [sig-apps] Job should run a job to completion when tasks sometimes fail and are locally restarted [Conformance]
Kubernetes e2e suite [It] [sig-apps] Job should run a job to completion when tasks sometimes fail and are not locally restarted
Kubernetes e2e suite [It] [sig-apps] Job should run a job to completion when tasks succeed
Kubernetes e2e suite [It] [sig-apps] ReplicaSet Replace and Patch tests [Conformance]
Kubernetes e2e suite [It] [sig-apps] ReplicaSet Replicaset should have a working scale subresource [Conformance]
Kubernetes e2e suite [It] [sig-apps] ReplicaSet should adopt matching pods on creation and release no longer matching pods [Conformance]
Kubernetes e2e suite [It] [sig-apps] ReplicaSet should list and delete a collection of ReplicaSets [Conformance]
Kubernetes e2e suite [It] [sig-apps] ReplicaSet should serve a basic image on each replica with a public image [Conformance]
Kubernetes e2e suite [It] [sig-apps] ReplicaSet should surface a failure condition on a common issue like exceeded quota
Kubernetes e2e suite [It] [sig-apps] ReplicaSet should validate Replicaset Status endpoints [Conformance]
Kubernetes e2e suite [It] [sig-apps] ReplicationController should adopt matching pods on creation [Conformance]
Kubernetes e2e suite [It] [sig-apps] ReplicationController should release no longer matching pods [Conformance]
Kubernetes e2e suite [It] [sig-apps] ReplicationController should serve a basic image on each replica with a private image
Kubernetes e2e suite [It] [sig-apps] ReplicationController should serve a basic image on each replica with a public image [Conformance]
Kubernetes e2e suite [It] [sig-apps] ReplicationController should surface a failure condition on a common issue like exceeded quota [Conformance]
Kubernetes e2e suite [It] [sig-apps] ReplicationController should test the lifecycle of a ReplicationController [Conformance]
Kubernetes e2e suite [It] [sig-apps] StatefulSet AvailableReplicas should get updated accordingly when MinReadySeconds is enabled
Kubernetes e2e suite [It] [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] Should recreate evicted statefulset [Conformance]
Kubernetes e2e suite [It] [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] should adopt matching orphans and release non-matching pods
Kubernetes e2e suite [It] [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] should have a working scale subresource [Conformance]
Kubernetes e2e suite [It] [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] should implement legacy replacement when the update strategy is OnDelete
Kubernetes e2e suite [It] [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] should list, patch and delete a collection of StatefulSets [Conformance]
Kubernetes e2e suite [It] [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] should not deadlock when a pod's predecessor fails
Kubernetes e2e suite [It] [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] should perform canary updates and phased rolling updates of template modifications [Conformance]
Kubernetes e2e suite [It] [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] should perform rolling updates and roll backs of template modifications [Conformance]
Kubernetes e2e suite [It] [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] should perform rolling updates and roll backs of template modifications with PVCs
Kubernetes e2e suite [It] [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] should provide basic identity
Kubernetes e2e suite [It] [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] should validate Statefulset Status endpoints [Conformance]
Kubernetes e2e suite [It] [sig-apps] StatefulSet MinReadySeconds should be honored when enabled
Kubernetes e2e suite [It] [sig-apps] TTLAfterFinished job should be deleted once it finishes after TTL seconds
Kubernetes e2e suite [It] [sig-architecture] Conformance Tests should have at least two untainted nodes [Conformance]
Kubernetes e2e suite [It] [sig-auth] Certificates API [Privileged:ClusterAdmin] should support CSR API operations [Conformance]
Kubernetes e2e suite [It] [sig-auth] Certificates API [Privileged:ClusterAdmin] should support building a client with a CSR
Kubernetes e2e suite [It] [sig-auth] ServiceAccounts ServiceAccountIssuerDiscovery should support OIDC discovery of service account issuer [Conformance]
Kubernetes e2e suite [It] [sig-auth] ServiceAccounts no secret-based service account token should be auto-generated
Kubernetes e2e suite [It] [sig-auth] ServiceAccounts should allow opting out of API token automount [Conformance]
Kubernetes e2e suite [It] [sig-auth] ServiceAccounts should guarantee kube-root-ca.crt exist in any namespace [Conformance]
Kubernetes e2e suite [It] [sig-auth] ServiceAccounts should mount an API token into pods [Conformance]
Kubernetes e2e suite [It] [sig-auth] ServiceAccounts should mount projected service account token [Conformance]
Kubernetes e2e suite [It] [sig-auth] ServiceAccounts should run through the lifecycle of a ServiceAccount [Conformance]
Kubernetes e2e suite [It] [sig-auth] ServiceAccounts should set ownership and permission when RunAsUser or FsGroup is present [LinuxOnly] [NodeFeature:FSGroup]
Kubernetes e2e suite [It] [sig-cli] Kubectl Port forwarding With a server listening on 0.0.0.0 should support forwarding over websockets
Kubernetes e2e suite [It] [sig-cli] Kubectl Port forwarding With a server listening on 0.0.0.0 that expects NO client request should support a client that connects, sends DATA, and disconnects
Kubernetes e2e suite [It] [sig-cli] Kubectl Port forwarding With a server listening on 0.0.0.0 that expects a client request should support a client that connects, sends DATA, and disconnects
Kubernetes e2e suite [It] [sig-cli] Kubectl Port forwarding With a server listening on 0.0.0.0 that expects a client request should support a client that connects, sends NO DATA, and disconnects
Kubernetes e2e suite [It] [sig-cli] Kubectl Port forwarding With a server listening on localhost should support forwarding over websockets
Kubernetes e2e suite [It] [sig-cli] Kubectl Port forwarding With a server listening on localhost that expects NO client request should support a client that connects, sends DATA, and disconnects
Kubernetes e2e suite [It] [sig-cli] Kubectl Port forwarding With a server listening on localhost that expects a client request should support a client that connects, sends DATA, and disconnects
Kubernetes e2e suite [It] [sig-cli] Kubectl Port forwarding With a server listening on localhost that expects a client request should support a client that connects, sends NO DATA, and disconnects
Kubernetes e2e suite [It] [sig-cli] Kubectl client Guestbook application should create and stop a working application [Conformance]
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl api-versions should check if v1 is in available api versions [Conformance]
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl apply apply set/view last-applied
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl apply should apply a new configuration to an existing RC
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl apply should reuse port when apply to an existing SVC
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl cluster-info dump should check if cluster-info dump succeeds
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl cluster-info should check if Kubernetes control plane services is included in cluster-info [Conformance]
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl copy should copy a file from a running Pod
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl create quota should create a quota with scopes
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl create quota should create a quota without scopes
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl create quota should reject quota with invalid scopes
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl describe should check if kubectl describe prints relevant information for cronjob
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl describe should check if kubectl describe prints relevant information for rc and pods [Conformance]
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl diff should check if kubectl diff finds a difference for Deployments [Conformance]
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl expose should create services for rc [Conformance]
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl get componentstatuses should get componentstatuses
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl label should update the label on a resource [Conformance]
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl logs should be able to retrieve and filter logs [Conformance]
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl patch should add annotations for pods in rc [Conformance]
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl replace should update a single-container pod's image [Conformance]
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl run pod should create a pod from an image when restart is Never [Conformance]
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl server-side dry-run should check if kubectl can dry-run update Pods [Conformance]
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl validation should create/apply a CR with unknown fields for CRD with no validation schema
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl validation should create/apply a valid CR for CRD with validation schema
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl validation should create/apply an invalid/valid CR with arbitrary-extra properties for CRD with partially-specified validation schema
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl validation should detect unknown metadata fields in both the root and embedded object of a CR
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl validation should detect unknown metadata fields of a typed object
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl version should check is all data is printed [Conformance]
Kubernetes e2e suite [It] [sig-cli] Kubectl client Proxy server should support --unix-socket=/path [Conformance]
Kubernetes e2e suite [It] [sig-cli] Kubectl client Proxy server should support proxy with --port 0 [Conformance]
Kubernetes e2e suite [It] [sig-cli] Kubectl client Simple pod should contain last line of the log
Kubernetes e2e suite [It] [sig-cli] Kubectl client Simple pod should handle in-cluster config
Kubernetes e2e suite [It] [sig-cli] Kubectl client Simple pod should return command exit codes execing into a container with a failing command
Kubernetes e2e suite [It] [sig-cli] Kubectl client Simple pod should return command exit codes execing into a container with a successful command
Kubernetes e2e suite [It] [sig-cli] Kubectl client Simple pod should return command exit codes running a failing command
Kubernetes e2e suite [It] [sig-cli] Kubectl client Simple pod should return command exit codes running a successful command
Kubernetes e2e suite [It] [sig-cli] Kubectl client Simple pod should support exec
Kubernetes e2e suite [It] [sig-cli] Kubectl client Simple pod should support exec through an HTTP proxy
Kubernetes e2e suite [It] [sig-cli] Kubectl client Simple pod should support exec through kubectl proxy
Kubernetes e2e suite [It] [sig-cli] Kubectl client Simple pod should support exec using resource/name
Kubernetes e2e suite [It] [sig-cli] Kubectl client Simple pod should support inline execution and attach
Kubernetes e2e suite [It] [sig-cli] Kubectl client Simple pod should support port-forward
Kubernetes e2e suite [It] [sig-cli] Kubectl client Update Demo should create and stop a replication controller [Conformance]
Kubernetes e2e suite [It] [sig-cli] Kubectl client kubectl wait should ignore not found error with --for=delete
Kubernetes e2e suite [It] [