ci-cri-containerd-e2e-cos-gce-proto #1595702499661058048 Results

Test Failures

Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] patching/updating a mutating webhook should work [Conformance] 48s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\spatching\/updating\sa\smutating\swebhook\sshould\swork\s\[Conformance\]$'

test/e2e/apimachinery/webhook.go:826
k8s.io/kubernetes/test/e2e/apimachinery.deployWebhookAndService(0xc00108de00, {0xc0051f80f0, 0x2c}, 0xc004fbc140, 0x20fb, 0x20fc)
	test/e2e/apimachinery/webhook.go:826 +0xed2
k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.1()
	test/e2e/apimachinery/webhook.go:102 +0x226
There were additional failures detected after the initial failure:
[FAILED]
Nov 24 09:07:54.319: failed to list events in namespace "webhook-8908": Get "https://35.233.217.30/api/v1/namespaces/webhook-8908/events": dial tcp 35.233.217.30:443: connect: connection refused
In [DeferCleanup (Each)] at: test/e2e/framework/debug/dump.go:44
----------
[FAILED]
Nov 24 09:07:54.398: Couldn't delete ns: "webhook-8908": Delete "https://35.233.217.30/api/v1/namespaces/webhook-8908": dial tcp 35.233.217.30:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://35.233.217.30/api/v1/namespaces/webhook-8908", Err:(*net.OpError)(0xc004fbcdc0)}),Couldn't delete ns: "webhook-8908-markers": Delete "https://35.233.217.30/api/v1/namespaces/webhook-8908-markers": dial tcp 35.233.217.30:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://35.233.217.30/api/v1/namespaces/webhook-8908-markers", Err:(*net.OpError)(0xc003fc78b0)})
In [DeferCleanup (Each)] at: test/e2e/framework/framework.go:370

				[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  set up framework | framework.go:178
STEP: Creating a kubernetes client 11/24/22 09:07:05.974
Nov 24 09:07:05.974: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Building a namespace api object, basename webhook 11/24/22 09:07:05.976
STEP: Waiting for a default service account to be provisioned in namespace 11/24/22 09:07:06.277
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 11/24/22 09:07:06.387
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  test/e2e/framework/metrics/init/init.go:31
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  test/e2e/apimachinery/webhook.go:90
STEP: Setting up server cert 11/24/22 09:07:06.792
STEP: Create role binding to let webhook read extension-apiserver-authentication 11/24/22 09:07:07.176
Nov 24 09:07:07.324: INFO: role binding webhook-auth-reader already exists
STEP: Deploying the webhook pod 11/24/22 09:07:07.324
STEP: Wait for the deployment to be ready 11/24/22 09:07:07.547
Nov 24 09:07:07.763: INFO: deployment "sample-webhook-deployment" doesn't have the required revision set
Nov 24 09:07:10.043: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 24 09:07:12.098: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 24 09:07:14.118: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 24 09:07:16.129: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 24 09:07:18.225: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 24 09:07:20.093: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 24 09:07:22.211: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 24 09:07:24.153: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 24 09:07:26.198: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 24 09:07:28.212: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 24 09:07:30.131: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 24 09:07:32.158: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 24 09:07:34.111: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 24 09:07:36.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 24 09:07:38.393: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 24 09:07:40.118: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 24 09:07:42.130: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 24 09:07:44.124: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 24 09:07:46.150: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 24 09:07:48.137: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 24 09:07:50.144: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 24 09:07:52.110: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 7, 7, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 24 09:07:54.083: INFO: Unexpected error: waiting for the deployment status valid%!(EXTRA string=registry.k8s.io/e2e-test-images/agnhost:2.43, string=sample-webhook-deployment, string=webhook-8908): 
    <*errors.errorString | 0xc00377b370>: {
        s: "error waiting for deployment \"sample-webhook-deployment\" status to match expectation: Get \"https://35.233.217.30/apis/apps/v1/namespaces/webhook-8908/deployments/sample-webhook-deployment\": dial tcp 35.233.217.30:443: connect: connection refused",
    }
Nov 24 09:07:54.083: FAIL: waiting for the deployment status valid%!(EXTRA string=registry.k8s.io/e2e-test-images/agnhost:2.43, string=sample-webhook-deployment, string=webhook-8908): error waiting for deployment "sample-webhook-deployment" status to match expectation: Get "https://35.233.217.30/apis/apps/v1/namespaces/webhook-8908/deployments/sample-webhook-deployment": dial tcp 35.233.217.30:443: connect: connection refused

Full Stack Trace
k8s.io/kubernetes/test/e2e/apimachinery.deployWebhookAndService(0xc00108de00, {0xc0051f80f0, 0x2c}, 0xc004fbc140, 0x20fb, 0x20fc)
	test/e2e/apimachinery/webhook.go:826 +0xed2
k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.1()
	test/e2e/apimachinery/webhook.go:102 +0x226
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  test/e2e/framework/node/init/init.go:32
Nov 24 09:07:54.083: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  test/e2e/apimachinery/webhook.go:105
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  dump namespaces | framework.go:196
STEP: dump namespace information after failure 11/24/22 09:07:54.279
STEP: Collecting events from namespace "webhook-8908". 11/24/22 09:07:54.279
Nov 24 09:07:54.319: INFO: Unexpected error: failed to list events in namespace "webhook-8908": 
    <*url.Error | 0xc00275d770>: {
        Op: "Get",
        URL: "https://35.233.217.30/api/v1/namespaces/webhook-8908/events",
        Err: <*net.OpError | 0xc003fc74a0>{
            Op: "dial",
            Net: "tcp",
            Source: nil,
            Addr: <*net.TCPAddr | 0xc003cc8c00>{
                IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 35, 233, 217, 30],
                Port: 443,
                Zone: "",
            },
            Err: <*os.SyscallError | 0xc0053272c0>{
                Syscall: "connect",
                Err: <syscall.Errno>0x6f,
            },
        },
    }
Nov 24 09:07:54.319: FAIL: failed to list events in namespace "webhook-8908": Get "https://35.233.217.30/api/v1/namespaces/webhook-8908/events": dial tcp 35.233.217.30:443: connect: connection refused

Full Stack Trace
k8s.io/kubernetes/test/e2e/framework/debug.dumpEventsInNamespace(0xc0017525c0, {0xc0051fc500, 0xc})
	test/e2e/framework/debug/dump.go:44 +0x191
k8s.io/kubernetes/test/e2e/framework/debug.DumpAllNamespaceInfo({0x801de88, 0xc003ec1ba0}, {0xc0051fc500, 0xc})
	test/e2e/framework/debug/dump.go:62 +0x8d
k8s.io/kubernetes/test/e2e/framework/debug/init.init.0.func1.1(0xc001752650?, {0xc0051fc500?, 0x7fa7740?})
	test/e2e/framework/debug/init/init.go:34 +0x32
k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo.func1()
	test/e2e/framework/framework.go:274 +0x6d
k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo(0xc00108de00)
	test/e2e/framework/framework.go:271 +0x179
reflect.Value.call({0x6627cc0?, 0xc003eda6e0?, 0xc0035bffb0?}, {0x75b6e72, 0x4}, {0xae73300, 0x0, 0xc004466d88?})
	/usr/local/go/src/reflect/value.go:584 +0x8c5
reflect.Value.Call({0x6627cc0?, 0xc003eda6e0?, 0x29449fc?}, {0xae73300?, 0xc0035bff80?, 0xc0053171a0?})
	/usr/local/go/src/reflect/value.go:368 +0xbc
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  tear down framework | framework.go:193
STEP: Destroying namespace "webhook-8908" for this suite. 11/24/22 09:07:54.319
STEP: Destroying namespace "webhook-8908-markers" for this suite. 11/24/22 09:07:54.359
Nov 24 09:07:54.398: FAIL: Couldn't delete ns: "webhook-8908": Delete "https://35.233.217.30/api/v1/namespaces/webhook-8908": dial tcp 35.233.217.30:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://35.233.217.30/api/v1/namespaces/webhook-8908", Err:(*net.OpError)(0xc004fbcdc0)}),Couldn't delete ns: "webhook-8908-markers": Delete "https://35.233.217.30/api/v1/namespaces/webhook-8908-markers": dial tcp 35.233.217.30:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://35.233.217.30/api/v1/namespaces/webhook-8908-markers", Err:(*net.OpError)(0xc003fc78b0)})

Full Stack Trace
k8s.io/kubernetes/test/e2e/framework.(*Framework).AfterEach.func1()
	test/e2e/framework/framework.go:370 +0x4fe
k8s.io/kubernetes/test/e2e/framework.(*Framework).AfterEach(0xc00108de00)
	test/e2e/framework/framework.go:383 +0x1ca
reflect.Value.call({0x6627cc0?, 0xc003eda660?, 0xc0008e6fb0?}, {0x75b6e72, 0x4}, {0xae73300, 0x0, 0x0?})
	/usr/local/go/src/reflect/value.go:584 +0x8c5
reflect.Value.Call({0x6627cc0?, 0xc003eda660?, 0x0?}, {0xae73300?, 0x5?, 0xc003ea90b0?})
	/usr/local/go/src/reflect/value.go:368 +0xbc

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should be able to deny attaching pod [Conformance] 19s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\sshould\sbe\sable\sto\sdeny\sattaching\spod\s\[Conformance\]$'

test/e2e/apimachinery/webhook.go:826
k8s.io/kubernetes/test/e2e/apimachinery.deployWebhookAndService(0xc000f77e00, {0xc003366e40, 0x2c}, 0xc003312c30, 0x20fb, 0x20fc)
	test/e2e/apimachinery/webhook.go:826 +0xed2
k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.1()
	test/e2e/apimachinery/webhook.go:102 +0x226
There were additional failures detected after the initial failure:
[FAILED]
Nov 24 09:04:54.090: failed to list events in namespace "webhook-567": Get "https://35.233.217.30/api/v1/namespaces/webhook-567/events": dial tcp 35.233.217.30:443: connect: connection refused
In [DeferCleanup (Each)] at: test/e2e/framework/debug/dump.go:44
----------
[FAILED]
Nov 24 09:04:54.169: Couldn't delete ns: "webhook-567": Delete "https://35.233.217.30/api/v1/namespaces/webhook-567": dial tcp 35.233.217.30:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://35.233.217.30/api/v1/namespaces/webhook-567", Err:(*net.OpError)(0xc002e8b400)}),Couldn't delete ns: "webhook-567-markers": Delete "https://35.233.217.30/api/v1/namespaces/webhook-567-markers": dial tcp 35.233.217.30:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://35.233.217.30/api/v1/namespaces/webhook-567-markers", Err:(*net.OpError)(0xc0035e4ff0)})
In [DeferCleanup (Each)] at: test/e2e/framework/framework.go:370

				[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  set up framework | framework.go:178
STEP: Creating a kubernetes client 11/24/22 09:04:34.813
Nov 24 09:04:34.813: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Building a namespace api object, basename webhook 11/24/22 09:04:34.814
STEP: Waiting for a default service account to be provisioned in namespace 11/24/22 09:04:34.942
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 11/24/22 09:04:35.023
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  test/e2e/framework/metrics/init/init.go:31
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  test/e2e/apimachinery/webhook.go:90
STEP: Setting up server cert 11/24/22 09:04:35.198
STEP: Create role binding to let webhook read extension-apiserver-authentication 11/24/22 09:04:35.536
Nov 24 09:04:35.583: INFO: role binding webhook-auth-reader already exists
STEP: Deploying the webhook pod 11/24/22 09:04:35.583
STEP: Wait for the deployment to be ready 11/24/22 09:04:35.676
Nov 24 09:04:35.814: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 24, 9, 4, 35, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 4, 35, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 24, 9, 4, 35, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 4, 35, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 24 09:04:37.856: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 24, 9, 4, 35, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 4, 35, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 24, 9, 4, 35, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 4, 35, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 24 09:04:39.905: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 24, 9, 4, 38, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 4, 35, 0, time.Local), Reason:"NewReplicaSetAvailable", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" has successfully progressed."}, v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 24, 9, 4, 38, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 4, 38, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}}, CollisionCount:(*int32)(nil)}
Nov 24 09:04:42.098: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 24, 9, 4, 38, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 4, 35, 0, time.Local), Reason:"NewReplicaSetAvailable", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" has successfully progressed."}, v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 24, 9, 4, 38, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 4, 38, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}}, CollisionCount:(*int32)(nil)}
Nov 24 09:04:43.912: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 24, 9, 4, 38, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 4, 35, 0, time.Local), Reason:"NewReplicaSetAvailable", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" has successfully progressed."}, v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 24, 9, 4, 38, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 4, 38, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}}, CollisionCount:(*int32)(nil)}
Nov 24 09:04:45.871: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 24, 9, 4, 38, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 4, 35, 0, time.Local), Reason:"NewReplicaSetAvailable", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" has successfully progressed."}, v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 24, 9, 4, 38, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 4, 38, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}}, CollisionCount:(*int32)(nil)}
Nov 24 09:04:47.962: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 24, 9, 4, 38, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 4, 35, 0, time.Local), Reason:"NewReplicaSetAvailable", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" has successfully progressed."}, v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 24, 9, 4, 38, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 4, 38, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}}, CollisionCount:(*int32)(nil)}
Nov 24 09:04:50.056: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 24, 9, 4, 38, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 4, 35, 0, time.Local), Reason:"NewReplicaSetAvailable", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" has successfully progressed."}, v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 24, 9, 4, 38, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 4, 38, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}}, CollisionCount:(*int32)(nil)}
Nov 24 09:04:51.889: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 24, 9, 4, 38, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 4, 35, 0, time.Local), Reason:"NewReplicaSetAvailable", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" has successfully progressed."}, v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 24, 9, 4, 38, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 4, 38, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}}, CollisionCount:(*int32)(nil)}
Nov 24 09:04:53.854: INFO: Unexpected error: waiting for the deployment status valid%!(EXTRA string=registry.k8s.io/e2e-test-images/agnhost:2.43, string=sample-webhook-deployment, string=webhook-567): 
    <*errors.errorString | 0xc000fa2f10>: {
        s: "error waiting for deployment \"sample-webhook-deployment\" status to match expectation: Get \"https://35.233.217.30/apis/apps/v1/namespaces/webhook-567/deployments/sample-webhook-deployment\": dial tcp 35.233.217.30:443: connect: connection refused",
    }
Nov 24 09:04:53.854: FAIL: waiting for the deployment status valid%!(EXTRA string=registry.k8s.io/e2e-test-images/agnhost:2.43, string=sample-webhook-deployment, string=webhook-567): error waiting for deployment "sample-webhook-deployment" status to match expectation: Get "https://35.233.217.30/apis/apps/v1/namespaces/webhook-567/deployments/sample-webhook-deployment": dial tcp 35.233.217.30:443: connect: connection refused

Full Stack Trace
k8s.io/kubernetes/test/e2e/apimachinery.deployWebhookAndService(0xc000f77e00, {0xc003366e40, 0x2c}, 0xc003312c30, 0x20fb, 0x20fc)
	test/e2e/apimachinery/webhook.go:826 +0xed2
k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.1()
	test/e2e/apimachinery/webhook.go:102 +0x226
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  test/e2e/framework/node/init/init.go:32
Nov 24 09:04:53.855: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  test/e2e/apimachinery/webhook.go:105
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  dump namespaces | framework.go:196
STEP: dump namespace information after failure 11/24/22 09:04:54.05
STEP: Collecting events from namespace "webhook-567". 11/24/22 09:04:54.05
Nov 24 09:04:54.090: INFO: Unexpected error: failed to list events in namespace "webhook-567": 
    <*url.Error | 0xc0036636b0>: {
        Op: "Get",
        URL: "https://35.233.217.30/api/v1/namespaces/webhook-567/events",
        Err: <*net.OpError | 0xc0035e4cd0>{
            Op: "dial",
            Net: "tcp",
            Source: nil,
            Addr: <*net.TCPAddr | 0xc003fd5770>{
                IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 35, 233, 217, 30],
                Port: 443,
                Zone: "",
            },
            Err: <*os.SyscallError | 0xc004012020>{
                Syscall: "connect",
                Err: <syscall.Errno>0x6f,
            },
        },
    }
Nov 24 09:04:54.090: FAIL: failed to list events in namespace "webhook-567": Get "https://35.233.217.30/api/v1/namespaces/webhook-567/events": dial tcp 35.233.217.30:443: connect: connection refused

Full Stack Trace
k8s.io/kubernetes/test/e2e/framework/debug.dumpEventsInNamespace(0xc000de25c0, {0xc004e53270, 0xb})
	test/e2e/framework/debug/dump.go:44 +0x191
k8s.io/kubernetes/test/e2e/framework/debug.DumpAllNamespaceInfo({0x801de88, 0xc002127380}, {0xc004e53270, 0xb})
	test/e2e/framework/debug/dump.go:62 +0x8d
k8s.io/kubernetes/test/e2e/framework/debug/init.init.0.func1.1(0xc000de2650?, {0xc004e53270?, 0x7fa7740?})
	test/e2e/framework/debug/init/init.go:34 +0x32
k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo.func1()
	test/e2e/framework/framework.go:274 +0x6d
k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo(0xc000f77e00)
	test/e2e/framework/framework.go:271 +0x179
reflect.Value.call({0x6627cc0?, 0xc000fe21c0?, 0xc003ad9fb0?}, {0x75b6e72, 0x4}, {0xae73300, 0x0, 0xc00097a228?})
	/usr/local/go/src/reflect/value.go:584 +0x8c5
reflect.Value.Call({0x6627cc0?, 0xc000fe21c0?, 0x29449fc?}, {0xae73300?, 0xc003ad9f80?, 0x2a6d786?})
	/usr/local/go/src/reflect/value.go:368 +0xbc
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  tear down framework | framework.go:193
STEP: Destroying namespace "webhook-567" for this suite. 11/24/22 09:04:54.09
STEP: Destroying namespace "webhook-567-markers" for this suite. 11/24/22 09:04:54.129
Nov 24 09:04:54.169: FAIL: Couldn't delete ns: "webhook-567": Delete "https://35.233.217.30/api/v1/namespaces/webhook-567": dial tcp 35.233.217.30:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://35.233.217.30/api/v1/namespaces/webhook-567", Err:(*net.OpError)(0xc002e8b400)}),Couldn't delete ns: "webhook-567-markers": Delete "https://35.233.217.30/api/v1/namespaces/webhook-567-markers": dial tcp 35.233.217.30:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://35.233.217.30/api/v1/namespaces/webhook-567-markers", Err:(*net.OpError)(0xc0035e4ff0)})

Full Stack Trace
k8s.io/kubernetes/test/e2e/framework.(*Framework).AfterEach.func1()
	test/e2e/framework/framework.go:370 +0x4fe
k8s.io/kubernetes/test/e2e/framework.(*Framework).AfterEach(0xc000f77e00)
	test/e2e/framework/framework.go:383 +0x1ca
reflect.Value.call({0x6627cc0?, 0xc000fe2080?, 0xc003adbfb0?}, {0x75b6e72, 0x4}, {0xae73300, 0x0, 0x0?})
	/usr/local/go/src/reflect/value.go:584 +0x8c5
reflect.Value.Call({0x6627cc0?, 0xc000fe2080?, 0x0?}, {0xae73300?, 0x5?, 0xc004e61368?})
	/usr/local/go/src/reflect/value.go:368 +0xbc

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should be able to deny custom resource creation, update and deletion [Conformance] 52s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\sshould\sbe\sable\sto\sdeny\scustom\sresource\screation\,\supdate\sand\sdeletion\s\[Conformance\]$'

test/e2e/apimachinery/webhook.go:853
k8s.io/kubernetes/test/e2e/apimachinery.deployWebhookAndService(0xc0009fbe00, {0xc0049ffec0, 0x2c}, 0xc003c9e320, 0x20fb, 0x20fc)
	test/e2e/apimachinery/webhook.go:853 +0x13da
k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.1()
	test/e2e/apimachinery/webhook.go:102 +0x226
				[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  set up framework | framework.go:178
STEP: Creating a kubernetes client 11/24/22 09:06:30.107
Nov 24 09:06:30.107: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Building a namespace api object, basename webhook 11/24/22 09:06:30.109
STEP: Waiting for a default service account to be provisioned in namespace 11/24/22 09:06:30.306
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 11/24/22 09:06:30.389
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  test/e2e/framework/metrics/init/init.go:31
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  test/e2e/apimachinery/webhook.go:90
STEP: Setting up server cert 11/24/22 09:06:30.945
STEP: Create role binding to let webhook read extension-apiserver-authentication 11/24/22 09:06:31.418
Nov 24 09:06:31.827: INFO: role binding webhook-auth-reader already exists
STEP: Deploying the webhook pod 11/24/22 09:06:31.827
STEP: Wait for the deployment to be ready 11/24/22 09:06:32.173
Nov 24 09:06:32.738: INFO: deployment "sample-webhook-deployment" doesn't have the required revision set
Nov 24 09:06:35.099: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 24, 9, 6, 32, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 6, 32, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 24, 9, 6, 33, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 6, 32, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 24 09:06:37.188: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 24, 9, 6, 32, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 6, 32, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 24, 9, 6, 33, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 6, 32, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 24 09:06:39.479: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 24, 9, 6, 32, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 6, 32, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 24, 9, 6, 33, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 6, 32, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 24 09:06:41.250: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 24, 9, 6, 32, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 6, 32, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 24, 9, 6, 33, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 6, 32, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
STEP: Deploying the webhook service 11/24/22 09:06:43.233
STEP: Verifying the service has paired with the endpoint 11/24/22 09:06:43.389
Nov 24 09:06:44.389: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
Nov 24 09:06:45.390: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
Nov 24 09:06:46.390: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
Nov 24 09:06:47.389: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
Nov 24 09:06:48.390: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
Nov 24 09:06:49.389: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
Nov 24 09:06:50.390: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
Nov 24 09:06:51.389: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
Nov 24 09:06:52.390: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
Nov 24 09:06:53.389: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
Nov 24 09:06:54.390: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
Nov 24 09:06:55.389: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
Nov 24 09:06:56.390: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
Nov 24 09:06:57.390: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
Nov 24 09:06:58.389: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
Nov 24 09:06:59.390: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
Nov 24 09:07:00.390: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
Nov 24 09:07:01.390: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
Nov 24 09:07:02.390: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
Nov 24 09:07:03.389: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
Nov 24 09:07:04.390: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
Nov 24 09:07:05.389: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
Nov 24 09:07:06.392: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
Nov 24 09:07:07.390: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
Nov 24 09:07:08.389: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
Nov 24 09:07:09.389: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
Nov 24 09:07:10.390: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
Nov 24 09:07:11.390: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
Nov 24 09:07:12.390: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
Nov 24 09:07:13.389: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
Nov 24 09:07:13.483: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
Nov 24 09:07:13.603: INFO: Unexpected error: waiting for service webhook-3694/e2e-test-webhook have 1 endpoint: 
    <*errors.errorString | 0xc000243a20>: {
        s: "timed out waiting for the condition",
    }
Nov 24 09:07:13.604: FAIL: waiting for service webhook-3694/e2e-test-webhook have 1 endpoint: timed out waiting for the condition

Full Stack Trace
k8s.io/kubernetes/test/e2e/apimachinery.deployWebhookAndService(0xc0009fbe00, {0xc0049ffec0, 0x2c}, 0xc003c9e320, 0x20fb, 0x20fc)
	test/e2e/apimachinery/webhook.go:853 +0x13da
k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.1()
	test/e2e/apimachinery/webhook.go:102 +0x226
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  test/e2e/framework/node/init/init.go:32
Nov 24 09:07:13.604: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  test/e2e/apimachinery/webhook.go:105
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  dump namespaces | framework.go:196
STEP: dump namespace information after failure 11/24/22 09:07:14.13
STEP: Collecting events from namespace "webhook-3694". 11/24/22 09:07:14.13
STEP: Found 12 events. 11/24/22 09:07:14.227
Nov 24 09:07:14.227: INFO: At 2022-11-24 09:06:32 +0000 UTC - event for sample-webhook-deployment: {deployment-controller } ScalingReplicaSet: Scaled up replica set sample-webhook-deployment-865554f4d9 to 1
Nov 24 09:07:14.227: INFO: At 2022-11-24 09:06:32 +0000 UTC - event for sample-webhook-deployment-865554f4d9: {replicaset-controller } SuccessfulCreate: Created pod: sample-webhook-deployment-865554f4d9-sfm5l
Nov 24 09:07:14.227: INFO: At 2022-11-24 09:06:32 +0000 UTC - event for sample-webhook-deployment-865554f4d9-sfm5l: {default-scheduler } Scheduled: Successfully assigned webhook-3694/sample-webhook-deployment-865554f4d9-sfm5l to bootstrap-e2e-minion-group-0xkq
Nov 24 09:07:14.227: INFO: At 2022-11-24 09:06:34 +0000 UTC - event for sample-webhook-deployment-865554f4d9-sfm5l: {kubelet bootstrap-e2e-minion-group-0xkq} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine
Nov 24 09:07:14.227: INFO: At 2022-11-24 09:06:34 +0000 UTC - event for sample-webhook-deployment-865554f4d9-sfm5l: {kubelet bootstrap-e2e-minion-group-0xkq} Created: Created container sample-webhook
Nov 24 09:07:14.227: INFO: At 2022-11-24 09:06:34 +0000 UTC - event for sample-webhook-deployment-865554f4d9-sfm5l: {kubelet bootstrap-e2e-minion-group-0xkq} Started: Started container sample-webhook
Nov 24 09:07:14.227: INFO: At 2022-11-24 09:06:35 +0000 UTC - event for sample-webhook-deployment-865554f4d9-sfm5l: {kubelet bootstrap-e2e-minion-group-0xkq} Killing: Stopping container sample-webhook
Nov 24 09:07:14.227: INFO: At 2022-11-24 09:06:36 +0000 UTC - event for sample-webhook-deployment-865554f4d9-sfm5l: {kubelet bootstrap-e2e-minion-group-0xkq} Unhealthy: Readiness probe failed: Get "https://10.64.0.107:8444/readyz": dial tcp 10.64.0.107:8444: connect: connection refused
Nov 24 09:07:14.227: INFO: At 2022-11-24 09:06:36 +0000 UTC - event for sample-webhook-deployment-865554f4d9-sfm5l: {kubelet bootstrap-e2e-minion-group-0xkq} SandboxChanged: Pod sandbox changed, it will be killed and re-created.
Nov 24 09:07:14.227: INFO: At 2022-11-24 09:06:40 +0000 UTC - event for sample-webhook-deployment-865554f4d9-sfm5l: {kubelet bootstrap-e2e-minion-group-0xkq} Unhealthy: Readiness probe failed: Get "https://10.64.0.109:8444/readyz": dial tcp 10.64.0.109:8444: connect: connection refused
Nov 24 09:07:14.227: INFO: At 2022-11-24 09:06:41 +0000 UTC - event for sample-webhook-deployment-865554f4d9-sfm5l: {kubelet bootstrap-e2e-minion-group-0xkq} BackOff: Back-off restarting failed container sample-webhook in pod sample-webhook-deployment-865554f4d9-sfm5l_webhook-3694(6aa876f1-8eb3-4558-aa0e-fa52ae89f548)
Nov 24 09:07:14.227: INFO: At 2022-11-24 09:06:57 +0000 UTC - event for sample-webhook-deployment-865554f4d9-sfm5l: {kubelet bootstrap-e2e-minion-group-0xkq} Unhealthy: Readiness probe failed: Get "https://10.64.0.113:8444/readyz": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
Nov 24 09:07:14.281: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Nov 24 09:07:14.281: INFO: 
Nov 24 09:07:14.349: INFO: 
Logging node info for node bootstrap-e2e-master
Nov 24 09:07:14.483: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master    57b53f45-775d-4de5-a4ff-420df60cf61e 4439 0 2022-11-24 09:00:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-24 09:00:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-11-24 09:00:50 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-11-24 09:00:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-11-24 09:06:32 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-serial-1-6/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3858374656 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3596230656 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-24 09:00:50 +0000 UTC,LastTransitionTime:2022-11-24 09:00:50 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-24 09:06:32 +0000 UTC,LastTransitionTime:2022-11-24 09:00:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-24 09:06:32 +0000 UTC,LastTransitionTime:2022-11-24 09:00:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-24 09:06:32 +0000 UTC,LastTransitionTime:2022-11-24 09:00:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-24 09:06:32 +0000 UTC,LastTransitionTime:2022-11-24 09:00:54 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:35.233.217.30,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-jkns-gce-serial-1-6.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-jkns-gce-serial-1-6.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:2380dd218709b39effceaa3da78bc7d6,SystemUUID:2380dd21-8709-b39e-ffce-aa3da78bc7d6,BootID:8a5acb5e-406f-47f0-bc85-bed589236d7d,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.44+45279654db87f4,KubeProxyVersion:v1.27.0-alpha.0.44+45279654db87f4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:135160275,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:124989753,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:57659704,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:2c111f004bec24888d8cfa2a812a38fb8341350abac67dcd0ac64e709dfe389c registry.k8s.io/kas-network-proxy/proxy-server:v0.0.33],SizeBytes:22020129,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 24 09:07:14.483: INFO: 
Logging kubelet events for node bootstrap-e2e-master
Nov 24 09:07:14.601: INFO: 
Logging pods the kubelet thinks is on node bootstrap-e2e-master
Nov 24 09:07:14.720: INFO: kube-apiserver-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:14.720: INFO: 	Container kube-apiserver ready: true, restart count 1
Nov 24 09:07:14.720: INFO: kube-controller-manager-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:14.720: INFO: 	Container kube-controller-manager ready: true, restart count 3
Nov 24 09:07:14.720: INFO: kube-scheduler-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:14.720: INFO: 	Container kube-scheduler ready: false, restart count 2
Nov 24 09:07:14.720: INFO: metadata-proxy-v0.1-dgq6b started at 2022-11-24 09:01:06 +0000 UTC (0+2 container statuses recorded)
Nov 24 09:07:14.720: INFO: 	Container metadata-proxy ready: true, restart count 0
Nov 24 09:07:14.720: INFO: 	Container prometheus-to-sd-exporter ready: true, restart count 0
Nov 24 09:07:14.720: INFO: etcd-server-events-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:14.720: INFO: 	Container etcd-container ready: true, restart count 3
Nov 24 09:07:14.720: INFO: etcd-server-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:14.720: INFO: 	Container etcd-container ready: true, restart count 0
Nov 24 09:07:14.720: INFO: konnectivity-server-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:14.720: INFO: 	Container konnectivity-server-container ready: true, restart count 0
Nov 24 09:07:14.720: INFO: kube-addon-manager-bootstrap-e2e-master started at 2022-11-24 09:00:06 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:14.720: INFO: 	Container kube-addon-manager ready: true, restart count 0
Nov 24 09:07:14.720: INFO: l7-lb-controller-bootstrap-e2e-master started at 2022-11-24 09:00:07 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:14.720: INFO: 	Container l7-lb-controller ready: true, restart count 4
Nov 24 09:07:15.048: INFO: 
Latency metrics for node bootstrap-e2e-master
Nov 24 09:07:15.048: INFO: 
Logging node info for node bootstrap-e2e-minion-group-0xkq
Nov 24 09:07:15.117: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-0xkq    34eb6b8a-d427-45c3-aa67-9f7aa0a1f8a1 4146 0 2022-11-24 09:00:32 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-0xkq kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-0xkq topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-8812":"bootstrap-e2e-minion-group-0xkq"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-11-24 09:00:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}}}} } {kubelet Update v1 2022-11-24 09:00:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-24 09:00:50 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2022-11-24 09:05:37 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-24 09:06:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-serial-1-6/us-west1-b/bootstrap-e2e-minion-group-0xkq,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-24 09:05:37 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-24 09:05:37 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-24 09:05:37 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-24 09:05:37 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-24 09:05:37 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-24 09:05:37 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-24 09:05:37 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-24 09:00:50 +0000 UTC,LastTransitionTime:2022-11-24 09:00:50 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-24 09:05:30 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-24 09:05:30 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-24 09:05:30 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-24 09:05:30 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:34.145.99.248,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-0xkq.c.k8s-jkns-gce-serial-1-6.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-0xkq.c.k8s-jkns-gce-serial-1-6.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:23bcd2ca790827437c5cec98facdba94,SystemUUID:23bcd2ca-7908-2743-7c5c-ec98facdba94,BootID:84f5ff41-fbc9-4fdb-966f-19346788bdab,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.44+45279654db87f4,KubeProxyVersion:v1.27.0-alpha.0.44+45279654db87f4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:67201224,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/debian-base@sha256:ebda8587ec0f49eb88ee3a608ef018484908cbc5aa32556a0d78356088c185d4 registry.k8s.io/debian-base:v2.0.0],SizeBytes:21093264,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 24 09:07:15.117: INFO: 
Logging kubelet events for node bootstrap-e2e-minion-group-0xkq
Nov 24 09:07:15.181: INFO: 
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-0xkq
Nov 24 09:07:15.334: INFO: dns-test-e8302dd6-bdab-4d3d-9d21-f7c959b77229 started at 2022-11-24 09:06:28 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:07:15.334: INFO: 	Container jessie-querier ready: true, restart count 1
Nov 24 09:07:15.334: INFO: 	Container querier ready: true, restart count 1
Nov 24 09:07:15.334: INFO: 	Container webserver ready: true, restart count 1
Nov 24 09:07:15.334: INFO: hostexec-bootstrap-e2e-minion-group-0xkq-6hrgb started at 2022-11-24 09:06:27 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:15.334: INFO: 	Container agnhost-container ready: false, restart count 2
Nov 24 09:07:15.334: INFO: sample-webhook-deployment-865554f4d9-qhln9 started at 2022-11-24 09:04:35 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:15.334: INFO: 	Container sample-webhook ready: true, restart count 4
Nov 24 09:07:15.334: INFO: pod-exec-websocket-cead3064-22b6-443d-92b2-4d30159a31ae started at 2022-11-24 09:06:28 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:15.334: INFO: 	Container main ready: true, restart count 1
Nov 24 09:07:15.334: INFO: agnhost-host-aliases07dd0013-880a-43df-b65a-dd3cc866b1c6 started at 2022-11-24 09:04:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:15.334: INFO: 	Container agnhost-container ready: false, restart count 0
Nov 24 09:07:15.334: INFO: httpd-deployment-6859889f88-cjjj8 started at 2022-11-24 09:04:51 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:15.334: INFO: 	Container httpd ready: true, restart count 2
Nov 24 09:07:15.334: INFO: hostexec-bootstrap-e2e-minion-group-0xkq-gs72q started at 2022-11-24 09:06:42 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:15.334: INFO: 	Container agnhost-container ready: true, restart count 1
Nov 24 09:07:15.334: INFO: metadata-proxy-v0.1-jg8bk started at 2022-11-24 09:00:33 +0000 UTC (0+2 container statuses recorded)
Nov 24 09:07:15.334: INFO: 	Container metadata-proxy ready: true, restart count 0
Nov 24 09:07:15.334: INFO: 	Container prometheus-to-sd-exporter ready: true, restart count 0
Nov 24 09:07:15.334: INFO: busybox-readonly-true-0c7fd3e6-417c-4909-a077-6624310b4dfb started at 2022-11-24 09:04:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:15.334: INFO: 	Container busybox-readonly-true-0c7fd3e6-417c-4909-a077-6624310b4dfb ready: false, restart count 0
Nov 24 09:07:15.334: INFO: busybox-e4175cec-5a98-457b-8d7a-fc687790f79e started at 2022-11-24 09:04:11 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:15.334: INFO: 	Container busybox ready: false, restart count 3
Nov 24 09:07:15.334: INFO: webserver-pod started at 2022-11-24 09:03:45 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:15.334: INFO: 	Container agnhost ready: false, restart count 0
Nov 24 09:07:15.334: INFO: pod-always-succeed1ac1248a-f95d-4ec8-add5-00fdfc91f740 started at 2022-11-24 09:04:11 +0000 UTC (1+1 container statuses recorded)
Nov 24 09:07:15.334: INFO: 	Init container foo ready: true, restart count 0
Nov 24 09:07:15.334: INFO: 	Container bar ready: false, restart count 0
Nov 24 09:07:15.334: INFO: netserver-0 started at 2022-11-24 09:04:49 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:15.334: INFO: 	Container webserver ready: false, restart count 4
Nov 24 09:07:15.334: INFO: pod-projected-configmaps-8d25746a-f0af-4a47-9309-b7d6c1547608 started at 2022-11-24 09:06:45 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:07:15.334: INFO: 	Container createcm-volume-test ready: false, restart count 0
Nov 24 09:07:15.334: INFO: 	Container delcm-volume-test ready: false, restart count 0
Nov 24 09:07:15.334: INFO: 	Container updcm-volume-test ready: false, restart count 0
Nov 24 09:07:15.334: INFO: csi-mockplugin-0 started at 2022-11-24 09:02:44 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:07:15.334: INFO: 	Container csi-provisioner ready: true, restart count 3
Nov 24 09:07:15.334: INFO: 	Container driver-registrar ready: true, restart count 3
Nov 24 09:07:15.334: INFO: 	Container mock ready: true, restart count 3
Nov 24 09:07:15.334: INFO: hostexec-bootstrap-e2e-minion-group-0xkq-pqnxr started at 2022-11-24 09:06:47 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:15.334: INFO: 	Container agnhost-container ready: true, restart count 0
Nov 24 09:07:15.334: INFO: coredns-6d97d5ddb-q22hn started at 2022-11-24 09:00:58 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:15.334: INFO: 	Container coredns ready: false, restart count 4
Nov 24 09:07:15.334: INFO: test-pod-3 started at 2022-11-24 09:02:41 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:15.334: INFO: 	Container token-test ready: true, restart count 0
Nov 24 09:07:15.334: INFO: netserver-0 started at 2022-11-24 09:04:04 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:15.334: INFO: 	Container webserver ready: false, restart count 4
Nov 24 09:07:15.334: INFO: kube-proxy-bootstrap-e2e-minion-group-0xkq started at 2022-11-24 09:00:32 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:15.334: INFO: 	Container kube-proxy ready: false, restart count 4
Nov 24 09:07:15.334: INFO: konnectivity-agent-nxcws started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:15.334: INFO: 	Container konnectivity-agent ready: false, restart count 3
Nov 24 09:07:15.334: INFO: sample-webhook-deployment-865554f4d9-pngsn started at 2022-11-24 09:04:04 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:15.334: INFO: 	Container sample-webhook ready: false, restart count 4
Nov 24 09:07:15.689: INFO: 
Latency metrics for node bootstrap-e2e-minion-group-0xkq
Nov 24 09:07:15.689: INFO: 
Logging node info for node bootstrap-e2e-minion-group-6m4q
Nov 24 09:07:15.752: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-6m4q    be4476db-4c35-4ea4-96f6-e1f0e7c12742 5330 0 2022-11-24 09:00:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-6m4q kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-6m4q topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-7570":"bootstrap-e2e-minion-group-6m4q"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-24 09:00:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-24 09:00:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-11-24 09:03:07 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {node-problem-detector Update v1 2022-11-24 09:05:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-24 09:07:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-serial-1-6/us-west1-b/bootstrap-e2e-minion-group-6m4q,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-24 09:05:40 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-24 09:05:40 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-24 09:05:40 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-24 09:05:40 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-24 09:05:40 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-24 09:05:40 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-24 09:05:40 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-24 09:00:50 +0000 UTC,LastTransitionTime:2022-11-24 09:00:50 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-24 09:07:05 +0000 UTC,LastTransitionTime:2022-11-24 09:00:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-24 09:07:05 +0000 UTC,LastTransitionTime:2022-11-24 09:00:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-24 09:07:05 +0000 UTC,LastTransitionTime:2022-11-24 09:00:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-24 09:07:05 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:35.247.58.118,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-6m4q.c.k8s-jkns-gce-serial-1-6.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-6m4q.c.k8s-jkns-gce-serial-1-6.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:7b2cc9e909d10f7df61b26e8aece9707,SystemUUID:7b2cc9e9-09d1-0f7d-f61b-26e8aece9707,BootID:64607970-cc6d-408c-9269-dff979065832,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.44+45279654db87f4,KubeProxyVersion:v1.27.0-alpha.0.44+45279654db87f4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:67201224,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 registry.k8s.io/sig-storage/snapshot-controller:v6.1.0],SizeBytes:22620891,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-volume-2730^cf01fd4e-6bd6-11ed-883e-2a0722949c55],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-volume-2730^cf01fd4e-6bd6-11ed-883e-2a0722949c55,DevicePath:,},},Config:nil,},}
Nov 24 09:07:15.753: INFO: 
Logging kubelet events for node bootstrap-e2e-minion-group-6m4q
Nov 24 09:07:15.845: INFO: 
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-6m4q
Nov 24 09:07:16.080: INFO: pod-0 started at 2022-11-24 09:04:46 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:16.080: INFO: 	Container donothing ready: true, restart count 2
Nov 24 09:07:16.080: INFO: exceed-active-deadline-4qtbs started at 2022-11-24 09:06:42 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:16.080: INFO: 	Container c ready: true, restart count 0
Nov 24 09:07:16.080: INFO: kube-proxy-bootstrap-e2e-minion-group-6m4q started at 2022-11-24 09:00:35 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:16.080: INFO: 	Container kube-proxy ready: false, restart count 3
Nov 24 09:07:16.080: INFO: netserver-1 started at 2022-11-24 09:04:04 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:16.080: INFO: 	Container webserver ready: false, restart count 4
Nov 24 09:07:16.080: INFO: pod-qos-class-74f9b596-fee6-498b-bc31-4c37b3f76389 started at 2022-11-24 09:06:28 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:16.080: INFO: 	Container agnhost ready: false, restart count 0
Nov 24 09:07:16.080: INFO: csi-hostpathplugin-0 started at 2022-11-24 09:06:47 +0000 UTC (0+7 container statuses recorded)
Nov 24 09:07:16.080: INFO: 	Container csi-attacher ready: true, restart count 0
Nov 24 09:07:16.080: INFO: 	Container csi-provisioner ready: true, restart count 0
Nov 24 09:07:16.080: INFO: 	Container csi-resizer ready: true, restart count 0
Nov 24 09:07:16.080: INFO: 	Container csi-snapshotter ready: true, restart count 0
Nov 24 09:07:16.080: INFO: 	Container hostpath ready: true, restart count 0
Nov 24 09:07:16.080: INFO: 	Container liveness-probe ready: true, restart count 0
Nov 24 09:07:16.080: INFO: 	Container node-driver-registrar ready: true, restart count 0
Nov 24 09:07:16.080: INFO: webserver-pod started at 2022-11-24 09:04:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:16.080: INFO: 	Container agnhost ready: false, restart count 0
Nov 24 09:07:16.080: INFO: l7-default-backend-8549d69d99-762zc started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:16.080: INFO: 	Container default-http-backend ready: true, restart count 0
Nov 24 09:07:16.080: INFO: konnectivity-agent-k4jdw started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:16.080: INFO: 	Container konnectivity-agent ready: true, restart count 2
Nov 24 09:07:16.080: INFO: httpd-deployment-6859889f88-22w25 started at 2022-11-24 09:04:51 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:16.080: INFO: 	Container httpd ready: true, restart count 0
Nov 24 09:07:16.080: INFO: metadata-proxy-v0.1-lwtk4 started at 2022-11-24 09:00:35 +0000 UTC (0+2 container statuses recorded)
Nov 24 09:07:16.080: INFO: 	Container metadata-proxy ready: true, restart count 0
Nov 24 09:07:16.080: INFO: 	Container prometheus-to-sd-exporter ready: true, restart count 0
Nov 24 09:07:16.080: INFO: kube-dns-autoscaler-5f6455f985-hxtg5 started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:16.080: INFO: 	Container autoscaler ready: true, restart count 5
Nov 24 09:07:16.080: INFO: pod-configmaps-6929437e-13e1-4a93-b7fa-e8ec8d7c7138 started at 2022-11-24 09:04:04 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:07:16.080: INFO: 	Container createcm-volume-test ready: false, restart count 0
Nov 24 09:07:16.080: INFO: 	Container delcm-volume-test ready: false, restart count 0
Nov 24 09:07:16.080: INFO: 	Container updcm-volume-test ready: false, restart count 0
Nov 24 09:07:16.080: INFO: exceed-active-deadline-lkrv4 started at 2022-11-24 09:06:42 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:16.080: INFO: 	Container c ready: true, restart count 0
Nov 24 09:07:16.080: INFO: netserver-1 started at 2022-11-24 09:04:49 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:16.080: INFO: 	Container webserver ready: true, restart count 2
Nov 24 09:07:16.080: INFO: pod-subpath-test-secret-56vz started at 2022-11-24 09:04:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:16.080: INFO: 	Container test-container-subpath-secret-56vz ready: false, restart count 0
Nov 24 09:07:16.080: INFO: csi-mockplugin-0 started at 2022-11-24 09:06:45 +0000 UTC (0+4 container statuses recorded)
Nov 24 09:07:16.080: INFO: 	Container busybox ready: true, restart count 0
Nov 24 09:07:16.080: INFO: 	Container csi-provisioner ready: true, restart count 0
Nov 24 09:07:16.080: INFO: 	Container driver-registrar ready: true, restart count 0
Nov 24 09:07:16.080: INFO: 	Container mock ready: true, restart count 0
Nov 24 09:07:16.080: INFO: hostexec-bootstrap-e2e-minion-group-6m4q-h8v54 started at 2022-11-24 09:04:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:16.080: INFO: 	Container agnhost-container ready: true, restart count 2
Nov 24 09:07:16.080: INFO: hostpath-injector started at 2022-11-24 09:03:07 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:16.080: INFO: 	Container hostpath-injector ready: false, restart count 1
Nov 24 09:07:16.080: INFO: hostexec-bootstrap-e2e-minion-group-6m4q-mmz2l started at 2022-11-24 09:06:28 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:16.080: INFO: 	Container agnhost-container ready: false, restart count 2
Nov 24 09:07:16.080: INFO: hostexec-bootstrap-e2e-minion-group-6m4q-zsd7h started at 2022-11-24 09:06:29 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:16.080: INFO: 	Container agnhost-container ready: true, restart count 2
Nov 24 09:07:16.080: INFO: coredns-6d97d5ddb-9z7tn started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:16.080: INFO: 	Container coredns ready: true, restart count 5
Nov 24 09:07:16.080: INFO: volume-snapshot-controller-0 started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:16.080: INFO: 	Container volume-snapshot-controller ready: true, restart count 2
Nov 24 09:07:16.080: INFO: csi-hostpathplugin-0 started at 2022-11-24 09:02:44 +0000 UTC (0+7 container statuses recorded)
Nov 24 09:07:16.080: INFO: 	Container csi-attacher ready: false, restart count 5
Nov 24 09:07:16.080: INFO: 	Container csi-provisioner ready: false, restart count 5
Nov 24 09:07:16.080: INFO: 	Container csi-resizer ready: false, restart count 5
Nov 24 09:07:16.080: INFO: 	Container csi-snapshotter ready: false, restart count 5
Nov 24 09:07:16.080: INFO: 	Container hostpath ready: false, restart count 5
Nov 24 09:07:16.080: INFO: 	Container liveness-probe ready: false, restart count 5
Nov 24 09:07:16.080: INFO: 	Container node-driver-registrar ready: false, restart count 5
Nov 24 09:07:16.080: INFO: liveness-285ed85f-af70-4221-a9ae-9d3784882e9c started at 2022-11-24 09:06:27 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:16.080: INFO: 	Container agnhost-container ready: true, restart count 0
Nov 24 09:07:16.516: INFO: 
Latency metrics for node bootstrap-e2e-minion-group-6m4q
Nov 24 09:07:16.516: INFO: 
Logging node info for node bootstrap-e2e-minion-group-fj34
Nov 24 09:07:16.582: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-fj34    26b0a38a-1259-4217-8b0f-bfa92e43b570 5077 0 2022-11-24 09:00:32 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-fj34 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-fj34 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-9395":"bootstrap-e2e-minion-group-fj34","csi-mock-csi-mock-volumes-1806":"bootstrap-e2e-minion-group-fj34","csi-mock-csi-mock-volumes-9231":"bootstrap-e2e-minion-group-fj34","csi-mock-csi-mock-volumes-9394":"bootstrap-e2e-minion-group-fj34"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-11-24 09:00:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kubelet Update v1 2022-11-24 09:00:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-24 09:04:27 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {node-problem-detector Update v1 2022-11-24 09:05:38 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-24 09:06:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-serial-1-6/us-west1-b/bootstrap-e2e-minion-group-fj34,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-24 09:05:38 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-24 09:05:38 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-24 09:05:38 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-24 09:05:38 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-24 09:05:38 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-24 09:05:38 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-24 09:05:38 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-24 09:00:50 +0000 UTC,LastTransitionTime:2022-11-24 09:00:50 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-24 09:06:11 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-24 09:06:11 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-24 09:06:11 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-24 09:06:11 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.82.73.153,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-fj34.c.k8s-jkns-gce-serial-1-6.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-fj34.c.k8s-jkns-gce-serial-1-6.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:557b5201a29dc5c84dc79b98af6f523a,SystemUUID:557b5201-a29d-c5c8-4dc7-9b98af6f523a,BootID:0f4289cb-5f88-4ee3-b552-b99fcc030f54,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.44+45279654db87f4,KubeProxyVersion:v1.27.0-alpha.0.44+45279654db87f4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:67201224,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:c0ddb4794bc8a3631e3373015f913c00b230ee54f87bde9ade195b3a3415c60f registry.k8s.io/build-image/distroless-iptables:v0.1.2],SizeBytes:7685585,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-9231^cbf4a4b9-6bd6-11ed-88e7-326e345b4078],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-9231^cbf4a4b9-6bd6-11ed-88e7-326e345b4078,DevicePath:,},},Config:nil,},}
Nov 24 09:07:16.582: INFO: 
Logging kubelet events for node bootstrap-e2e-minion-group-fj34
Nov 24 09:07:16.639: INFO: 
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-fj34
Nov 24 09:07:16.854: INFO: netserver-2 started at 2022-11-24 09:04:49 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:16.854: INFO: 	Container webserver ready: true, restart count 3
Nov 24 09:07:16.854: INFO: csi-mockplugin-attacher-0 started at 2022-11-24 09:02:44 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:16.854: INFO: 	Container csi-attacher ready: true, restart count 2
Nov 24 09:07:16.854: INFO: csi-mockplugin-attacher-0 started at 2022-11-24 09:02:44 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:16.854: INFO: 	Container csi-attacher ready: true, restart count 2
Nov 24 09:07:16.854: INFO: konnectivity-agent-jjqhp started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:16.854: INFO: 	Container konnectivity-agent ready: true, restart count 3
Nov 24 09:07:16.854: INFO: test-pod-2 started at 2022-11-24 09:02:40 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:16.854: INFO: 	Container token-test ready: false, restart count 0
Nov 24 09:07:16.854: INFO: csi-hostpathplugin-0 started at 2022-11-24 09:03:06 +0000 UTC (0+7 container statuses recorded)
Nov 24 09:07:16.854: INFO: 	Container csi-attacher ready: true, restart count 1
Nov 24 09:07:16.854: INFO: 	Container csi-provisioner ready: true, restart count 1
Nov 24 09:07:16.854: INFO: 	Container csi-resizer ready: true, restart count 1
Nov 24 09:07:16.854: INFO: 	Container csi-snapshotter ready: true, restart count 1
Nov 24 09:07:16.854: INFO: 	Container hostpath ready: true, restart count 1
Nov 24 09:07:16.854: INFO: 	Container liveness-probe ready: true, restart count 1
Nov 24 09:07:16.854: INFO: 	Container node-driver-registrar ready: true, restart count 1
Nov 24 09:07:16.854: INFO: hostexec-bootstrap-e2e-minion-group-fj34-z4nnm started at 2022-11-24 09:06:46 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:16.854: INFO: 	Container agnhost-container ready: true, restart count 1
Nov 24 09:07:16.854: INFO: pod-subpath-test-inlinevolume-mcdr started at 2022-11-24 09:04:49 +0000 UTC (2+1 container statuses recorded)
Nov 24 09:07:16.854: INFO: 	Init container init-volume-inlinevolume-mcdr ready: true, restart count 0
Nov 24 09:07:16.854: INFO: 	Init container test-init-volume-inlinevolume-mcdr ready: true, restart count 0
Nov 24 09:07:16.854: INFO: 	Container test-container-subpath-inlinevolume-mcdr ready: false, restart count 0
Nov 24 09:07:16.854: INFO: hostexec-bootstrap-e2e-minion-group-fj34-rbzc6 started at 2022-11-24 09:06:28 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:16.854: INFO: 	Container agnhost-container ready: true, restart count 0
Nov 24 09:07:16.854: INFO: hostexec-bootstrap-e2e-minion-group-fj34-f7vrh started at 2022-11-24 09:06:27 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:16.854: INFO: 	Container agnhost-container ready: true, restart count 0
Nov 24 09:07:16.854: INFO: csi-mockplugin-attacher-0 started at 2022-11-24 09:06:32 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:16.854: INFO: 	Container csi-attacher ready: false, restart count 2
Nov 24 09:07:16.854: INFO: kube-proxy-bootstrap-e2e-minion-group-fj34 started at 2022-11-24 09:00:32 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:16.854: INFO: 	Container kube-proxy ready: false, restart count 3
Nov 24 09:07:16.854: INFO: metadata-proxy-v0.1-rtz4q started at 2022-11-24 09:00:33 +0000 UTC (0+2 container statuses recorded)
Nov 24 09:07:16.854: INFO: 	Container metadata-proxy ready: true, restart count 0
Nov 24 09:07:16.854: INFO: 	Container prometheus-to-sd-exporter ready: true, restart count 0
Nov 24 09:07:16.854: INFO: test-pod-1 started at 2022-11-24 09:02:40 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:16.854: INFO: 	Container token-test ready: false, restart count 0
Nov 24 09:07:16.854: INFO: hostexec-bootstrap-e2e-minion-group-fj34-9j92x started at 2022-11-24 09:04:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:16.854: INFO: 	Container agnhost-container ready: true, restart count 1
Nov 24 09:07:16.854: INFO: pvc-volume-tester-5zg8r started at 2022-11-24 09:03:02 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:16.854: INFO: 	Container volume-tester ready: false, restart count 0
Nov 24 09:07:16.854: INFO: httpd-deployment-6859889f88-whrb9 started at 2022-11-24 09:05:53 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:16.854: INFO: 	Container httpd ready: true, restart count 1
Nov 24 09:07:16.854: INFO: csi-mockplugin-0 started at 2022-11-24 09:06:32 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:07:16.854: INFO: 	Container csi-provisioner ready: true, restart count 2
Nov 24 09:07:16.854: INFO: 	Container driver-registrar ready: true, restart count 2
Nov 24 09:07:16.854: INFO: 	Container mock ready: true, restart count 2
Nov 24 09:07:16.854: INFO: metrics-server-v0.5.2-867b8754b9-lprlm started at 2022-11-24 09:01:14 +0000 UTC (0+2 container statuses recorded)
Nov 24 09:07:16.854: INFO: 	Container metrics-server ready: false, restart count 4
Nov 24 09:07:16.854: INFO: 	Container metrics-server-nanny ready: false, restart count 4
Nov 24 09:07:16.854: INFO: netserver-2 started at 2022-11-24 09:04:04 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:16.854: INFO: 	Container webserver ready: true, restart count 3
Nov 24 09:07:16.854: INFO: csi-mockplugin-0 started at 2022-11-24 09:02:44 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:07:16.854: INFO: 	Container csi-provisioner ready: true, restart count 2
Nov 24 09:07:16.854: INFO: 	Container driver-registrar ready: true, restart count 2
Nov 24 09:07:16.854: INFO: 	Container mock ready: true, restart count 2
Nov 24 09:07:16.854: INFO: csi-mockplugin-0 started at 2022-11-24 09:02:44 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:07:16.854: INFO: 	Container csi-provisioner ready: true, restart count 0
Nov 24 09:07:16.854: INFO: 	Container driver-registrar ready: true, restart count 0
Nov 24 09:07:16.854: INFO: 	Container mock ready: true, restart count 0
Nov 24 09:07:16.854: INFO: csi-mockplugin-resizer-0 started at 2022-11-24 09:02:44 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:16.854: INFO: 	Container csi-resizer ready: true, restart count 1
Nov 24 09:07:17.691: INFO: 
Latency metrics for node bootstrap-e2e-minion-group-fj34
STEP: Collecting events from namespace "webhook-3694-markers". 11/24/22 09:07:17.691
STEP: Found 0 events. 11/24/22 09:07:17.762
Nov 24 09:07:17.872: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Nov 24 09:07:17.872: INFO: 
Nov 24 09:07:18.069: INFO: 
Logging node info for node bootstrap-e2e-master
Nov 24 09:07:18.262: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master    57b53f45-775d-4de5-a4ff-420df60cf61e 4439 0 2022-11-24 09:00:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-24 09:00:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-11-24 09:00:50 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-11-24 09:00:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-11-24 09:06:32 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-serial-1-6/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3858374656 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3596230656 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-24 09:00:50 +0000 UTC,LastTransitionTime:2022-11-24 09:00:50 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-24 09:06:32 +0000 UTC,LastTransitionTime:2022-11-24 09:00:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-24 09:06:32 +0000 UTC,LastTransitionTime:2022-11-24 09:00:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-24 09:06:32 +0000 UTC,LastTransitionTime:2022-11-24 09:00:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-24 09:06:32 +0000 UTC,LastTransitionTime:2022-11-24 09:00:54 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:35.233.217.30,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-jkns-gce-serial-1-6.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-jkns-gce-serial-1-6.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:2380dd218709b39effceaa3da78bc7d6,SystemUUID:2380dd21-8709-b39e-ffce-aa3da78bc7d6,BootID:8a5acb5e-406f-47f0-bc85-bed589236d7d,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.44+45279654db87f4,KubeProxyVersion:v1.27.0-alpha.0.44+45279654db87f4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:135160275,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:124989753,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:57659704,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:2c111f004bec24888d8cfa2a812a38fb8341350abac67dcd0ac64e709dfe389c registry.k8s.io/kas-network-proxy/proxy-server:v0.0.33],SizeBytes:22020129,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 24 09:07:18.262: INFO: 
Logging kubelet events for node bootstrap-e2e-master
Nov 24 09:07:18.416: INFO: 
Logging pods the kubelet thinks is on node bootstrap-e2e-master
Nov 24 09:07:18.634: INFO: etcd-server-events-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:18.634: INFO: 	Container etcd-container ready: true, restart count 3
Nov 24 09:07:18.634: INFO: etcd-server-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:18.634: INFO: 	Container etcd-container ready: true, restart count 0
Nov 24 09:07:18.634: INFO: konnectivity-server-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:18.634: INFO: 	Container konnectivity-server-container ready: true, restart count 0
Nov 24 09:07:18.634: INFO: kube-addon-manager-bootstrap-e2e-master started at 2022-11-24 09:00:06 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:18.634: INFO: 	Container kube-addon-manager ready: true, restart count 0
Nov 24 09:07:18.634: INFO: l7-lb-controller-bootstrap-e2e-master started at 2022-11-24 09:00:07 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:18.634: INFO: 	Container l7-lb-controller ready: true, restart count 4
Nov 24 09:07:18.634: INFO: metadata-proxy-v0.1-dgq6b started at 2022-11-24 09:01:06 +0000 UTC (0+2 container statuses recorded)
Nov 24 09:07:18.634: INFO: 	Container metadata-proxy ready: true, restart count 0
Nov 24 09:07:18.634: INFO: 	Container prometheus-to-sd-exporter ready: true, restart count 0
Nov 24 09:07:18.634: INFO: kube-apiserver-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:18.634: INFO: 	Container kube-apiserver ready: true, restart count 1
Nov 24 09:07:18.634: INFO: kube-controller-manager-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:18.634: INFO: 	Container kube-controller-manager ready: true, restart count 3
Nov 24 09:07:18.634: INFO: kube-scheduler-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:18.634: INFO: 	Container kube-scheduler ready: false, restart count 2
Nov 24 09:07:19.800: INFO: 
Latency metrics for node bootstrap-e2e-master
Nov 24 09:07:19.800: INFO: 
Logging node info for node bootstrap-e2e-minion-group-0xkq
Nov 24 09:07:19.870: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-0xkq    34eb6b8a-d427-45c3-aa67-9f7aa0a1f8a1 4146 0 2022-11-24 09:00:32 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-0xkq kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-0xkq topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-8812":"bootstrap-e2e-minion-group-0xkq"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-11-24 09:00:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}}}} } {kubelet Update v1 2022-11-24 09:00:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-24 09:00:50 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2022-11-24 09:05:37 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-24 09:06:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-serial-1-6/us-west1-b/bootstrap-e2e-minion-group-0xkq,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-24 09:05:37 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-24 09:05:37 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-24 09:05:37 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-24 09:05:37 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-24 09:05:37 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-24 09:05:37 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-24 09:05:37 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-24 09:00:50 +0000 UTC,LastTransitionTime:2022-11-24 09:00:50 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-24 09:05:30 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-24 09:05:30 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-24 09:05:30 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-24 09:05:30 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:34.145.99.248,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-0xkq.c.k8s-jkns-gce-serial-1-6.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-0xkq.c.k8s-jkns-gce-serial-1-6.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:23bcd2ca790827437c5cec98facdba94,SystemUUID:23bcd2ca-7908-2743-7c5c-ec98facdba94,BootID:84f5ff41-fbc9-4fdb-966f-19346788bdab,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.44+45279654db87f4,KubeProxyVersion:v1.27.0-alpha.0.44+45279654db87f4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:67201224,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/debian-base@sha256:ebda8587ec0f49eb88ee3a608ef018484908cbc5aa32556a0d78356088c185d4 registry.k8s.io/debian-base:v2.0.0],SizeBytes:21093264,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 24 09:07:19.871: INFO: 
Logging kubelet events for node bootstrap-e2e-minion-group-0xkq
Nov 24 09:07:19.984: INFO: 
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-0xkq
Nov 24 09:07:20.118: INFO: pod-exec-websocket-cead3064-22b6-443d-92b2-4d30159a31ae started at 2022-11-24 09:06:28 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:20.118: INFO: 	Container main ready: true, restart count 1
Nov 24 09:07:20.118: INFO: hostexec-bootstrap-e2e-minion-group-0xkq-6hrgb started at 2022-11-24 09:06:27 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:20.118: INFO: 	Container agnhost-container ready: false, restart count 2
Nov 24 09:07:20.118: INFO: sample-webhook-deployment-865554f4d9-qhln9 started at 2022-11-24 09:04:35 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:20.118: INFO: 	Container sample-webhook ready: true, restart count 4
Nov 24 09:07:20.118: INFO: agnhost-host-aliases07dd0013-880a-43df-b65a-dd3cc866b1c6 started at 2022-11-24 09:04:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:20.118: INFO: 	Container agnhost-container ready: false, restart count 0
Nov 24 09:07:20.118: INFO: httpd-deployment-6859889f88-cjjj8 started at 2022-11-24 09:04:51 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:20.118: INFO: 	Container httpd ready: true, restart count 2
Nov 24 09:07:20.118: INFO: hostexec-bootstrap-e2e-minion-group-0xkq-gs72q started at 2022-11-24 09:06:42 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:20.118: INFO: 	Container agnhost-container ready: true, restart count 1
Nov 24 09:07:20.118: INFO: webserver-pod started at 2022-11-24 09:03:45 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:20.118: INFO: 	Container agnhost ready: false, restart count 0
Nov 24 09:07:20.118: INFO: pod-always-succeed1ac1248a-f95d-4ec8-add5-00fdfc91f740 started at 2022-11-24 09:04:11 +0000 UTC (1+1 container statuses recorded)
Nov 24 09:07:20.118: INFO: 	Init container foo ready: true, restart count 0
Nov 24 09:07:20.118: INFO: 	Container bar ready: false, restart count 0
Nov 24 09:07:20.118: INFO: metadata-proxy-v0.1-jg8bk started at 2022-11-24 09:00:33 +0000 UTC (0+2 container statuses recorded)
Nov 24 09:07:20.118: INFO: 	Container metadata-proxy ready: true, restart count 0
Nov 24 09:07:20.118: INFO: 	Container prometheus-to-sd-exporter ready: true, restart count 0
Nov 24 09:07:20.118: INFO: busybox-readonly-true-0c7fd3e6-417c-4909-a077-6624310b4dfb started at 2022-11-24 09:04:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:20.118: INFO: 	Container busybox-readonly-true-0c7fd3e6-417c-4909-a077-6624310b4dfb ready: false, restart count 0
Nov 24 09:07:20.118: INFO: busybox-e4175cec-5a98-457b-8d7a-fc687790f79e started at 2022-11-24 09:04:11 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:20.118: INFO: 	Container busybox ready: false, restart count 3
Nov 24 09:07:20.118: INFO: hostexec-bootstrap-e2e-minion-group-0xkq-pqnxr started at 2022-11-24 09:06:47 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:20.118: INFO: 	Container agnhost-container ready: true, restart count 0
Nov 24 09:07:20.118: INFO: netserver-0 started at 2022-11-24 09:04:49 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:20.118: INFO: 	Container webserver ready: false, restart count 4
Nov 24 09:07:20.118: INFO: pod-projected-configmaps-8d25746a-f0af-4a47-9309-b7d6c1547608 started at 2022-11-24 09:06:45 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:07:20.118: INFO: 	Container createcm-volume-test ready: false, restart count 0
Nov 24 09:07:20.118: INFO: 	Container delcm-volume-test ready: false, restart count 0
Nov 24 09:07:20.119: INFO: 	Container updcm-volume-test ready: false, restart count 0
Nov 24 09:07:20.119: INFO: csi-mockplugin-0 started at 2022-11-24 09:02:44 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:07:20.119: INFO: 	Container csi-provisioner ready: true, restart count 3
Nov 24 09:07:20.119: INFO: 	Container driver-registrar ready: true, restart count 3
Nov 24 09:07:20.119: INFO: 	Container mock ready: true, restart count 3
Nov 24 09:07:20.119: INFO: netserver-0 started at 2022-11-24 09:04:04 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:20.119: INFO: 	Container webserver ready: false, restart count 4
Nov 24 09:07:20.119: INFO: coredns-6d97d5ddb-q22hn started at 2022-11-24 09:00:58 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:20.119: INFO: 	Container coredns ready: false, restart count 4
Nov 24 09:07:20.119: INFO: test-pod-3 started at 2022-11-24 09:02:41 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:20.119: INFO: 	Container token-test ready: true, restart count 0
Nov 24 09:07:20.119: INFO: kube-proxy-bootstrap-e2e-minion-group-0xkq started at 2022-11-24 09:00:32 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:20.119: INFO: 	Container kube-proxy ready: false, restart count 4
Nov 24 09:07:20.119: INFO: konnectivity-agent-nxcws started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:20.119: INFO: 	Container konnectivity-agent ready: false, restart count 3
Nov 24 09:07:20.119: INFO: sample-webhook-deployment-865554f4d9-pngsn started at 2022-11-24 09:04:04 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:20.119: INFO: 	Container sample-webhook ready: false, restart count 4
Nov 24 09:07:20.566: INFO: 
Latency metrics for node bootstrap-e2e-minion-group-0xkq
Nov 24 09:07:20.566: INFO: 
Logging node info for node bootstrap-e2e-minion-group-6m4q
Nov 24 09:07:20.623: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-6m4q    be4476db-4c35-4ea4-96f6-e1f0e7c12742 5330 0 2022-11-24 09:00:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-6m4q kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-6m4q topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-7570":"bootstrap-e2e-minion-group-6m4q"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-24 09:00:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-24 09:00:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-11-24 09:03:07 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {node-problem-detector Update v1 2022-11-24 09:05:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-24 09:07:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-serial-1-6/us-west1-b/bootstrap-e2e-minion-group-6m4q,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-24 09:05:40 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-24 09:05:40 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-24 09:05:40 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-24 09:05:40 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-24 09:05:40 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-24 09:05:40 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-24 09:05:40 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-24 09:00:50 +0000 UTC,LastTransitionTime:2022-11-24 09:00:50 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-24 09:07:05 +0000 UTC,LastTransitionTime:2022-11-24 09:00:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-24 09:07:05 +0000 UTC,LastTransitionTime:2022-11-24 09:00:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-24 09:07:05 +0000 UTC,LastTransitionTime:2022-11-24 09:00:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-24 09:07:05 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:35.247.58.118,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-6m4q.c.k8s-jkns-gce-serial-1-6.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-6m4q.c.k8s-jkns-gce-serial-1-6.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:7b2cc9e909d10f7df61b26e8aece9707,SystemUUID:7b2cc9e9-09d1-0f7d-f61b-26e8aece9707,BootID:64607970-cc6d-408c-9269-dff979065832,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.44+45279654db87f4,KubeProxyVersion:v1.27.0-alpha.0.44+45279654db87f4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:67201224,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 registry.k8s.io/sig-storage/snapshot-controller:v6.1.0],SizeBytes:22620891,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-volume-2730^cf01fd4e-6bd6-11ed-883e-2a0722949c55],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-volume-2730^cf01fd4e-6bd6-11ed-883e-2a0722949c55,DevicePath:,},},Config:nil,},}
Nov 24 09:07:20.623: INFO: 
Logging kubelet events for node bootstrap-e2e-minion-group-6m4q
Nov 24 09:07:20.705: INFO: 
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-6m4q
Nov 24 09:07:21.087: INFO: hostexec-bootstrap-e2e-minion-group-6m4q-h8v54 started at 2022-11-24 09:04:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:21.087: INFO: 	Container agnhost-container ready: true, restart count 2
Nov 24 09:07:21.087: INFO: hostpath-injector started at 2022-11-24 09:03:07 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:21.087: INFO: 	Container hostpath-injector ready: false, restart count 1
Nov 24 09:07:21.087: INFO: hostexec-bootstrap-e2e-minion-group-6m4q-mmz2l started at 2022-11-24 09:06:28 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:21.087: INFO: 	Container agnhost-container ready: true, restart count 3
Nov 24 09:07:21.087: INFO: coredns-6d97d5ddb-9z7tn started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:21.087: INFO: 	Container coredns ready: true, restart count 5
Nov 24 09:07:21.087: INFO: volume-snapshot-controller-0 started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:21.087: INFO: 	Container volume-snapshot-controller ready: true, restart count 2
Nov 24 09:07:21.087: INFO: csi-hostpathplugin-0 started at 2022-11-24 09:02:44 +0000 UTC (0+7 container statuses recorded)
Nov 24 09:07:21.087: INFO: 	Container csi-attacher ready: false, restart count 5
Nov 24 09:07:21.087: INFO: 	Container csi-provisioner ready: false, restart count 5
Nov 24 09:07:21.087: INFO: 	Container csi-resizer ready: false, restart count 5
Nov 24 09:07:21.087: INFO: 	Container csi-snapshotter ready: false, restart count 5
Nov 24 09:07:21.087: INFO: 	Container hostpath ready: false, restart count 5
Nov 24 09:07:21.087: INFO: 	Container liveness-probe ready: false, restart count 5
Nov 24 09:07:21.087: INFO: 	Container node-driver-registrar ready: false, restart count 5
Nov 24 09:07:21.087: INFO: liveness-285ed85f-af70-4221-a9ae-9d3784882e9c started at 2022-11-24 09:06:27 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:21.087: INFO: 	Container agnhost-container ready: true, restart count 0
Nov 24 09:07:21.087: INFO: hostexec-bootstrap-e2e-minion-group-6m4q-zsd7h started at 2022-11-24 09:06:29 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:21.087: INFO: 	Container agnhost-container ready: true, restart count 2
Nov 24 09:07:21.087: INFO: pod-0 started at 2022-11-24 09:04:46 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:21.087: INFO: 	Container donothing ready: true, restart count 2
Nov 24 09:07:21.087: INFO: kube-proxy-bootstrap-e2e-minion-group-6m4q started at 2022-11-24 09:00:35 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:21.087: INFO: 	Container kube-proxy ready: false, restart count 4
Nov 24 09:07:21.087: INFO: netserver-1 started at 2022-11-24 09:04:04 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:21.087: INFO: 	Container webserver ready: false, restart count 4
Nov 24 09:07:21.087: INFO: pod-qos-class-74f9b596-fee6-498b-bc31-4c37b3f76389 started at 2022-11-24 09:06:28 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:21.087: INFO: 	Container agnhost ready: false, restart count 0
Nov 24 09:07:21.087: INFO: csi-hostpathplugin-0 started at 2022-11-24 09:06:47 +0000 UTC (0+7 container statuses recorded)
Nov 24 09:07:21.087: INFO: 	Container csi-attacher ready: true, restart count 0
Nov 24 09:07:21.087: INFO: 	Container csi-provisioner ready: true, restart count 0
Nov 24 09:07:21.087: INFO: 	Container csi-resizer ready: true, restart count 0
Nov 24 09:07:21.087: INFO: 	Container csi-snapshotter ready: true, restart count 0
Nov 24 09:07:21.087: INFO: 	Container hostpath ready: true, restart count 0
Nov 24 09:07:21.087: INFO: 	Container liveness-probe ready: true, restart count 0
Nov 24 09:07:21.087: INFO: 	Container node-driver-registrar ready: true, restart count 0
Nov 24 09:07:21.087: INFO: webserver-pod started at 2022-11-24 09:04:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:21.087: INFO: 	Container agnhost ready: false, restart count 0
Nov 24 09:07:21.087: INFO: l7-default-backend-8549d69d99-762zc started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:21.087: INFO: 	Container default-http-backend ready: true, restart count 0
Nov 24 09:07:21.087: INFO: konnectivity-agent-k4jdw started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:21.087: INFO: 	Container konnectivity-agent ready: true, restart count 2
Nov 24 09:07:21.087: INFO: httpd-deployment-6859889f88-22w25 started at 2022-11-24 09:04:51 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:21.087: INFO: 	Container httpd ready: true, restart count 0
Nov 24 09:07:21.087: INFO: metadata-proxy-v0.1-lwtk4 started at 2022-11-24 09:00:35 +0000 UTC (0+2 container statuses recorded)
Nov 24 09:07:21.087: INFO: 	Container metadata-proxy ready: true, restart count 0
Nov 24 09:07:21.087: INFO: 	Container prometheus-to-sd-exporter ready: true, restart count 0
Nov 24 09:07:21.087: INFO: kube-dns-autoscaler-5f6455f985-hxtg5 started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:21.087: INFO: 	Container autoscaler ready: true, restart count 5
Nov 24 09:07:21.087: INFO: pod-configmaps-6929437e-13e1-4a93-b7fa-e8ec8d7c7138 started at 2022-11-24 09:04:04 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:07:21.087: INFO: 	Container createcm-volume-test ready: false, restart count 0
Nov 24 09:07:21.087: INFO: 	Container delcm-volume-test ready: false, restart count 0
Nov 24 09:07:21.087: INFO: 	Container updcm-volume-test ready: false, restart count 0
Nov 24 09:07:21.087: INFO: netserver-1 started at 2022-11-24 09:04:49 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:21.087: INFO: 	Container webserver ready: true, restart count 2
Nov 24 09:07:21.087: INFO: pod-subpath-test-secret-56vz started at 2022-11-24 09:04:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:21.087: INFO: 	Container test-container-subpath-secret-56vz ready: false, restart count 0
Nov 24 09:07:21.087: INFO: csi-mockplugin-0 started at 2022-11-24 09:06:45 +0000 UTC (0+4 container statuses recorded)
Nov 24 09:07:21.087: INFO: 	Container busybox ready: true, restart count 1
Nov 24 09:07:21.087: INFO: 	Container csi-provisioner ready: true, restart count 1
Nov 24 09:07:21.087: INFO: 	Container driver-registrar ready: true, restart count 1
Nov 24 09:07:21.087: INFO: 	Container mock ready: true, restart count 1
Nov 24 09:07:21.578: INFO: 
Latency metrics for node bootstrap-e2e-minion-group-6m4q
Nov 24 09:07:21.578: INFO: 
Logging node info for node bootstrap-e2e-minion-group-fj34
Nov 24 09:07:21.725: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-fj34    26b0a38a-1259-4217-8b0f-bfa92e43b570 5077 0 2022-11-24 09:00:32 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-fj34 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-fj34 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-9395":"bootstrap-e2e-minion-group-fj34","csi-mock-csi-mock-volumes-1806":"bootstrap-e2e-minion-group-fj34","csi-mock-csi-mock-volumes-9231":"bootstrap-e2e-minion-group-fj34","csi-mock-csi-mock-volumes-9394":"bootstrap-e2e-minion-group-fj34"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-11-24 09:00:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kubelet Update v1 2022-11-24 09:00:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-24 09:04:27 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {node-problem-detector Update v1 2022-11-24 09:05:38 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-24 09:06:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-serial-1-6/us-west1-b/bootstrap-e2e-minion-group-fj34,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-24 09:05:38 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-24 09:05:38 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-24 09:05:38 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-24 09:05:38 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-24 09:05:38 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-24 09:05:38 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-24 09:05:38 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-24 09:00:50 +0000 UTC,LastTransitionTime:2022-11-24 09:00:50 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-24 09:06:11 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-24 09:06:11 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-24 09:06:11 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-24 09:06:11 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.82.73.153,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-fj34.c.k8s-jkns-gce-serial-1-6.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-fj34.c.k8s-jkns-gce-serial-1-6.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:557b5201a29dc5c84dc79b98af6f523a,SystemUUID:557b5201-a29d-c5c8-4dc7-9b98af6f523a,BootID:0f4289cb-5f88-4ee3-b552-b99fcc030f54,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.44+45279654db87f4,KubeProxyVersion:v1.27.0-alpha.0.44+45279654db87f4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:67201224,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:c0ddb4794bc8a3631e3373015f913c00b230ee54f87bde9ade195b3a3415c60f registry.k8s.io/build-image/distroless-iptables:v0.1.2],SizeBytes:7685585,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-9231^cbf4a4b9-6bd6-11ed-88e7-326e345b4078],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-9231^cbf4a4b9-6bd6-11ed-88e7-326e345b4078,DevicePath:,},},Config:nil,},}
Nov 24 09:07:21.726: INFO: 
Logging kubelet events for node bootstrap-e2e-minion-group-fj34
Nov 24 09:07:21.843: INFO: 
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-fj34
Nov 24 09:07:22.098: INFO: csi-mockplugin-resizer-0 started at 2022-11-24 09:02:44 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:22.098: INFO: 	Container csi-resizer ready: true, restart count 1
Nov 24 09:07:22.098: INFO: metrics-server-v0.5.2-867b8754b9-lprlm started at 2022-11-24 09:01:14 +0000 UTC (0+2 container statuses recorded)
Nov 24 09:07:22.098: INFO: 	Container metrics-server ready: false, restart count 4
Nov 24 09:07:22.098: INFO: 	Container metrics-server-nanny ready: false, restart count 4
Nov 24 09:07:22.098: INFO: netserver-2 started at 2022-11-24 09:04:04 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:22.098: INFO: 	Container webserver ready: true, restart count 3
Nov 24 09:07:22.098: INFO: csi-mockplugin-0 started at 2022-11-24 09:02:44 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:07:22.098: INFO: 	Container csi-provisioner ready: true, restart count 2
Nov 24 09:07:22.098: INFO: 	Container driver-registrar ready: true, restart count 2
Nov 24 09:07:22.098: INFO: 	Container mock ready: true, restart count 2
Nov 24 09:07:22.098: INFO: csi-mockplugin-0 started at 2022-11-24 09:02:44 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:07:22.098: INFO: 	Container csi-provisioner ready: true, restart count 0
Nov 24 09:07:22.098: INFO: 	Container driver-registrar ready: true, restart count 0
Nov 24 09:07:22.098: INFO: 	Container mock ready: true, restart count 0
Nov 24 09:07:22.098: INFO: netserver-2 started at 2022-11-24 09:04:49 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:22.098: INFO: 	Container webserver ready: true, restart count 3
Nov 24 09:07:22.098: INFO: csi-mockplugin-attacher-0 started at 2022-11-24 09:02:44 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:22.098: INFO: 	Container csi-attacher ready: true, restart count 2
Nov 24 09:07:22.098: INFO: csi-mockplugin-attacher-0 started at 2022-11-24 09:02:44 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:22.098: INFO: 	Container csi-attacher ready: true, restart count 2
Nov 24 09:07:22.098: INFO: hostexec-bootstrap-e2e-minion-group-fj34-rbzc6 started at 2022-11-24 09:06:28 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:22.098: INFO: 	Container agnhost-container ready: true, restart count 0
Nov 24 09:07:22.098: INFO: konnectivity-agent-jjqhp started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:22.098: INFO: 	Container konnectivity-agent ready: true, restart count 3
Nov 24 09:07:22.098: INFO: test-pod-2 started at 2022-11-24 09:02:40 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:22.098: INFO: 	Container token-test ready: false, restart count 0
Nov 24 09:07:22.098: INFO: csi-hostpathplugin-0 started at 2022-11-24 09:03:06 +0000 UTC (0+7 container statuses recorded)
Nov 24 09:07:22.098: INFO: 	Container csi-attacher ready: true, restart count 1
Nov 24 09:07:22.098: INFO: 	Container csi-provisioner ready: true, restart count 1
Nov 24 09:07:22.098: INFO: 	Container csi-resizer ready: true, restart count 1
Nov 24 09:07:22.098: INFO: 	Container csi-snapshotter ready: true, restart count 1
Nov 24 09:07:22.098: INFO: 	Container hostpath ready: true, restart count 1
Nov 24 09:07:22.098: INFO: 	Container liveness-probe ready: true, restart count 1
Nov 24 09:07:22.098: INFO: 	Container node-driver-registrar ready: true, restart count 1
Nov 24 09:07:22.098: INFO: hostexec-bootstrap-e2e-minion-group-fj34-z4nnm started at 2022-11-24 09:06:46 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:22.098: INFO: 	Container agnhost-container ready: true, restart count 1
Nov 24 09:07:22.098: INFO: pod-subpath-test-inlinevolume-mcdr started at 2022-11-24 09:04:49 +0000 UTC (2+1 container statuses recorded)
Nov 24 09:07:22.098: INFO: 	Init container init-volume-inlinevolume-mcdr ready: true, restart count 0
Nov 24 09:07:22.098: INFO: 	Init container test-init-volume-inlinevolume-mcdr ready: true, restart count 0
Nov 24 09:07:22.098: INFO: 	Container test-container-subpath-inlinevolume-mcdr ready: false, restart count 0
Nov 24 09:07:22.098: INFO: httpd-deployment-6859889f88-whrb9 started at 2022-11-24 09:05:53 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:22.098: INFO: 	Container httpd ready: false, restart count 1
Nov 24 09:07:22.098: INFO: hostexec-bootstrap-e2e-minion-group-fj34-f7vrh started at 2022-11-24 09:06:27 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:22.098: INFO: 	Container agnhost-container ready: true, restart count 0
Nov 24 09:07:22.098: INFO: csi-mockplugin-attacher-0 started at 2022-11-24 09:06:32 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:22.098: INFO: 	Container csi-attacher ready: false, restart count 2
Nov 24 09:07:22.098: INFO: kube-proxy-bootstrap-e2e-minion-group-fj34 started at 2022-11-24 09:00:32 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:22.098: INFO: 	Container kube-proxy ready: false, restart count 3
Nov 24 09:07:22.098: INFO: metadata-proxy-v0.1-rtz4q started at 2022-11-24 09:00:33 +0000 UTC (0+2 container statuses recorded)
Nov 24 09:07:22.098: INFO: 	Container metadata-proxy ready: true, restart count 0
Nov 24 09:07:22.098: INFO: 	Container prometheus-to-sd-exporter ready: true, restart count 0
Nov 24 09:07:22.098: INFO: test-pod-1 started at 2022-11-24 09:02:40 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:22.098: INFO: 	Container token-test ready: false, restart count 0
Nov 24 09:07:22.098: INFO: hostexec-bootstrap-e2e-minion-group-fj34-9j92x started at 2022-11-24 09:04:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:22.098: INFO: 	Container agnhost-container ready: true, restart count 1
Nov 24 09:07:22.098: INFO: pvc-volume-tester-5zg8r started at 2022-11-24 09:03:02 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:07:22.098: INFO: 	Container volume-tester ready: false, restart count 0
Nov 24 09:07:22.098: INFO: csi-mockplugin-0 started at 2022-11-24 09:06:32 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:07:22.098: INFO: 	Container csi-provisioner ready: true, restart count 2
Nov 24 09:07:22.098: INFO: 	Container driver-registrar ready: true, restart count 2
Nov 24 09:07:22.098: INFO: 	Container mock ready: true, restart count 2
Nov 24 09:07:22.609: INFO: 
Latency metrics for node bootstrap-e2e-minion-group-fj34
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  tear down framework | framework.go:193
STEP: Destroying namespace "webhook-3694" for this suite. 11/24/22 09:07:22.609
STEP: Destroying namespace "webhook-3694-markers" for this suite. 11/24/22 09:07:22.757

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should deny crd creation [Conformance] 2m0s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\sshould\sdeny\scrd\screation\s\[Conformance\]$'

test/e2e/framework/framework.go:241
k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc000ef3e00)
	test/e2e/framework/framework.go:241 +0x96f
There were additional failures detected after the initial failure:
[PANICKED]
Test Panicked
In [AfterEach] at: /usr/local/go/src/runtime/panic.go:260

runtime error: invalid memory address or nil pointer dereference

Full Stack Trace
  k8s.io/kubernetes/test/e2e/apimachinery.cleanWebhookTest({0x0, 0x0}, {0x0, 0x0})
  	test/e2e/apimachinery/webhook.go:1680 +0x46
  k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.2()
  	test/e2e/apimachinery/webhook.go:106 +0x2f

				[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  set up framework | framework.go:178
STEP: Creating a kubernetes client 11/24/22 09:23:41.734
Nov 24 09:23:41.734: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Building a namespace api object, basename webhook 11/24/22 09:23:41.736
Nov 24 09:25:41.781: INFO: Unexpected error: 
    <*fmt.wrapError | 0xc000e14260>: {
        msg: "wait for service account \"default\" in namespace \"webhook-111\": timed out waiting for the condition",
        err: <*errors.errorString | 0xc0000d1db0>{
            s: "timed out waiting for the condition",
        },
    }
Nov 24 09:25:41.782: FAIL: wait for service account "default" in namespace "webhook-111": timed out waiting for the condition

Full Stack Trace
k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc000ef3e00)
	test/e2e/framework/framework.go:241 +0x96f
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  test/e2e/framework/node/init/init.go:32
Nov 24 09:25:41.782: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  test/e2e/apimachinery/webhook.go:105
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  dump namespaces | framework.go:196
STEP: dump namespace information after failure 11/24/22 09:25:41.867
STEP: Collecting events from namespace "webhook-111". 11/24/22 09:25:41.867
STEP: Found 0 events. 11/24/22 09:25:41.908
Nov 24 09:25:41.949: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Nov 24 09:25:41.949: INFO: 
Nov 24 09:25:41.997: INFO: 
Logging node info for node bootstrap-e2e-master
Nov 24 09:25:42.039: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master    57b53f45-775d-4de5-a4ff-420df60cf61e 11458 0 2022-11-24 09:00:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-24 09:00:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-11-24 09:00:50 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-11-24 09:00:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-11-24 09:21:48 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-serial-1-6/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3858374656 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3596230656 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-24 09:00:50 +0000 UTC,LastTransitionTime:2022-11-24 09:00:50 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-24 09:21:48 +0000 UTC,LastTransitionTime:2022-11-24 09:00:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-24 09:21:48 +0000 UTC,LastTransitionTime:2022-11-24 09:00:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-24 09:21:48 +0000 UTC,LastTransitionTime:2022-11-24 09:00:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-24 09:21:48 +0000 UTC,LastTransitionTime:2022-11-24 09:00:54 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:35.233.217.30,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-jkns-gce-serial-1-6.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-jkns-gce-serial-1-6.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:2380dd218709b39effceaa3da78bc7d6,SystemUUID:2380dd21-8709-b39e-ffce-aa3da78bc7d6,BootID:8a5acb5e-406f-47f0-bc85-bed589236d7d,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.44+45279654db87f4,KubeProxyVersion:v1.27.0-alpha.0.44+45279654db87f4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:135160275,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:124989753,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:57659704,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:2c111f004bec24888d8cfa2a812a38fb8341350abac67dcd0ac64e709dfe389c registry.k8s.io/kas-network-proxy/proxy-server:v0.0.33],SizeBytes:22020129,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 24 09:25:42.039: INFO: 
Logging kubelet events for node bootstrap-e2e-master
Nov 24 09:25:42.087: INFO: 
Logging pods the kubelet thinks is on node bootstrap-e2e-master
Nov 24 09:25:42.131: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-master: error trying to reach service: No agent available
Nov 24 09:25:42.131: INFO: 
Logging node info for node bootstrap-e2e-minion-group-0xkq
Nov 24 09:25:42.177: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-0xkq    34eb6b8a-d427-45c3-aa67-9f7aa0a1f8a1 11911 0 2022-11-24 09:00:32 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-0xkq kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-0xkq topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-5616":"bootstrap-e2e-minion-group-0xkq","csi-mock-csi-mock-volumes-4020":"bootstrap-e2e-minion-group-0xkq"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-11-24 09:00:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}}}} } {kubelet Update v1 2022-11-24 09:00:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-24 09:18:36 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2022-11-24 09:25:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {node-problem-detector Update v1 2022-11-24 09:25:39 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-serial-1-6/us-west1-b/bootstrap-e2e-minion-group-0xkq,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-24 09:25:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-24 09:25:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-24 09:25:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-24 09:25:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-24 09:25:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-24 09:25:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-24 09:25:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-24 09:00:50 +0000 UTC,LastTransitionTime:2022-11-24 09:00:50 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-24 09:24:47 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-24 09:24:47 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-24 09:24:47 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-24 09:24:47 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:34.145.99.248,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-0xkq.c.k8s-jkns-gce-serial-1-6.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-0xkq.c.k8s-jkns-gce-serial-1-6.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:23bcd2ca790827437c5cec98facdba94,SystemUUID:23bcd2ca-7908-2743-7c5c-ec98facdba94,BootID:84f5ff41-fbc9-4fdb-966f-19346788bdab,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.44+45279654db87f4,KubeProxyVersion:v1.27.0-alpha.0.44+45279654db87f4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:67201224,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/debian-base@sha256:ebda8587ec0f49eb88ee3a608ef018484908cbc5aa32556a0d78356088c185d4 registry.k8s.io/debian-base:v2.0.0],SizeBytes:21093264,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-5616^f895d0cb-6bd8-11ed-82b3-fe6d40909f02 kubernetes.io/csi/csi-hostpath-ephemeral-5616^f8bc8630-6bd8-11ed-82b3-fe6d40909f02],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-5616^f895d0cb-6bd8-11ed-82b3-fe6d40909f02,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-5616^f8bc8630-6bd8-11ed-82b3-fe6d40909f02,DevicePath:,},},Config:nil,},}
Nov 24 09:25:42.177: INFO: 
Logging kubelet events for node bootstrap-e2e-minion-group-0xkq
Nov 24 09:25:42.222: INFO: 
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-0xkq
Nov 24 09:25:42.266: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-0xkq: error trying to reach service: No agent available
Nov 24 09:25:42.266: INFO: 
Logging node info for node bootstrap-e2e-minion-group-6m4q
Nov 24 09:25:42.308: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-6m4q    be4476db-4c35-4ea4-96f6-e1f0e7c12742 11862 0 2022-11-24 09:00:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-6m4q kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-6m4q topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-24 09:00:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-24 09:00:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-11-24 09:12:06 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {node-problem-detector Update v1 2022-11-24 09:20:42 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-24 09:24:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-serial-1-6/us-west1-b/bootstrap-e2e-minion-group-6m4q,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-24 09:20:42 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-24 09:20:42 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-24 09:20:42 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-24 09:20:42 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-24 09:20:42 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-24 09:20:42 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-24 09:20:42 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-24 09:00:50 +0000 UTC,LastTransitionTime:2022-11-24 09:00:50 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-24 09:24:48 +0000 UTC,LastTransitionTime:2022-11-24 09:00:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-24 09:24:48 +0000 UTC,LastTransitionTime:2022-11-24 09:00:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-24 09:24:48 +0000 UTC,LastTransitionTime:2022-11-24 09:00:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-24 09:24:48 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:35.247.58.118,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-6m4q.c.k8s-jkns-gce-serial-1-6.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-6m4q.c.k8s-jkns-gce-serial-1-6.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:7b2cc9e909d10f7df61b26e8aece9707,SystemUUID:7b2cc9e9-09d1-0f7d-f61b-26e8aece9707,BootID:64607970-cc6d-408c-9269-dff979065832,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.44+45279654db87f4,KubeProxyVersion:v1.27.0-alpha.0.44+45279654db87f4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:67201224,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 registry.k8s.io/sig-storage/snapshot-controller:v6.1.0],SizeBytes:22620891,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-7570^55118aeb-6bd7-11ed-8dba-2207550599a3 kubernetes.io/csi/csi-hostpath-ephemeral-8753^758a12fe-6bd7-11ed-b4fd-0e9a0f0cf363],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-7570^55118aeb-6bd7-11ed-8dba-2207550599a3,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-8753^758a12fe-6bd7-11ed-b4fd-0e9a0f0cf363,DevicePath:,},},Config:nil,},}
Nov 24 09:25:42.308: INFO: 
Logging kubelet events for node bootstrap-e2e-minion-group-6m4q
Nov 24 09:25:42.354: INFO: 
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-6m4q
Nov 24 09:25:42.397: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-6m4q: error trying to reach service: No agent available
Nov 24 09:25:42.397: INFO: 
Logging node info for node bootstrap-e2e-minion-group-fj34
Nov 24 09:25:42.440: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-fj34    26b0a38a-1259-4217-8b0f-bfa92e43b570 11913 0 2022-11-24 09:00:32 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-fj34 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-fj34 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-4261":"bootstrap-e2e-minion-group-fj34","csi-hostpath-ephemeral-7265":"bootstrap-e2e-minion-group-fj34","csi-hostpath-ephemeral-9395":"bootstrap-e2e-minion-group-fj34","csi-mock-csi-mock-volumes-9394":"bootstrap-e2e-minion-group-fj34"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-11-24 09:00:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kubelet Update v1 2022-11-24 09:00:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-24 09:10:50 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2022-11-24 09:24:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {node-problem-detector Update v1 2022-11-24 09:25:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-serial-1-6/us-west1-b/bootstrap-e2e-minion-group-fj34,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-24 09:25:40 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-24 09:25:40 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-24 09:25:40 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-24 09:25:40 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-24 09:25:40 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-24 09:25:40 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-24 09:25:40 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-24 09:00:50 +0000 UTC,LastTransitionTime:2022-11-24 09:00:50 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-24 09:24:47 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-24 09:24:47 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-24 09:24:47 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-24 09:24:47 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.82.73.153,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-fj34.c.k8s-jkns-gce-serial-1-6.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-fj34.c.k8s-jkns-gce-serial-1-6.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:557b5201a29dc5c84dc79b98af6f523a,SystemUUID:557b5201-a29d-c5c8-4dc7-9b98af6f523a,BootID:0f4289cb-5f88-4ee3-b552-b99fcc030f54,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.44+45279654db87f4,KubeProxyVersion:v1.27.0-alpha.0.44+45279654db87f4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:67201224,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:c0ddb4794bc8a3631e3373015f913c00b230ee54f87bde9ade195b3a3415c60f registry.k8s.io/build-image/distroless-iptables:v0.1.2],SizeBytes:7685585,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-1806^5a1ffb25-6bd7-11ed-9365-7e36e6fec9d2 kubernetes.io/csi/csi-mock-csi-mock-volumes-9231^cbf4a4b9-6bd6-11ed-88e7-326e345b4078],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-9231^cbf4a4b9-6bd6-11ed-88e7-326e345b4078,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-1806^5a1ffb25-6bd7-11ed-9365-7e36e6fec9d2,DevicePath:,},},Config:nil,},}
Nov 24 09:25:42.440: INFO: 
Logging kubelet events for node bootstrap-e2e-minion-group-fj34
Nov 24 09:25:42.486: INFO: 
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-fj34
Nov 24 09:25:42.529: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-fj34: error trying to reach service: No agent available
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  tear down framework | framework.go:193
STEP: Destroying namespace "webhook-111" for this suite. 11/24/22 09:25:42.53

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should mutate custom resource with different stored version [Conformance] 1m56s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\sshould\smutate\scustom\sresource\swith\sdifferent\sstored\sversion\s\[Conformance\]$'

test/e2e/framework/framework.go:241
k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc0009a5e00)
	test/e2e/framework/framework.go:241 +0x96f
There were additional failures detected after the initial failure:
[PANICKED]
Test Panicked
In [AfterEach] at: /usr/local/go/src/runtime/panic.go:260

runtime error: invalid memory address or nil pointer dereference

Full Stack Trace
  k8s.io/kubernetes/test/e2e/apimachinery.cleanWebhookTest({0x0, 0x0}, {0x0, 0x0})
  	test/e2e/apimachinery/webhook.go:1680 +0x46
  k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.2()
  	test/e2e/apimachinery/webhook.go:106 +0x2f

				[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  set up framework | framework.go:178
STEP: Creating a kubernetes client 11/24/22 09:42:45.05
Nov 24 09:42:45.050: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Building a namespace api object, basename webhook 11/24/22 09:42:45.051
Nov 24 09:42:55.093: INFO: Unexpected error while creating namespace: Internal error occurred: resource quota evaluation timed out
Nov 24 09:43:07.134: INFO: Unexpected error while creating namespace: Internal error occurred: resource quota evaluation timed out
Nov 24 09:43:19.134: INFO: Unexpected error while creating namespace: Internal error occurred: resource quota evaluation timed out
Nov 24 09:43:31.134: INFO: Unexpected error while creating namespace: Internal error occurred: resource quota evaluation timed out
Nov 24 09:43:41.176: INFO: Unexpected error while creating namespace: Internal error occurred: resource quota evaluation timed out
Nov 24 09:43:41.176: INFO: Unexpected error: 
    <*errors.errorString | 0xc00017fa20>: {
        s: "timed out waiting for the condition",
    }
Nov 24 09:43:41.176: FAIL: timed out waiting for the condition

Full Stack Trace
k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc0009a5e00)
	test/e2e/framework/framework.go:241 +0x96f
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  test/e2e/framework/node/init/init.go:32
Nov 24 09:43:41.177: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  test/e2e/apimachinery/webhook.go:105
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  dump namespaces | framework.go:196
STEP: dump namespace information after failure 11/24/22 09:44:41.219
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  tear down framework | framework.go:193

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should mutate custom resource with pruning [Conformance] 56s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\sshould\smutate\scustom\sresource\swith\spruning\s\[Conformance\]$'

test/e2e/apimachinery/webhook.go:853
k8s.io/kubernetes/test/e2e/apimachinery.deployWebhookAndService(0xc000d9d4a0, {0xc00329c6c0, 0x2c}, 0xc00369bbd0, 0x20fb, 0x20fc)
	test/e2e/apimachinery/webhook.go:853 +0x13da
k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.1()
	test/e2e/apimachinery/webhook.go:102 +0x226
There were additional failures detected after the initial failure:
[FAILED]
Nov 24 09:04:53.072: failed to list events in namespace "webhook-7113": Get "https://35.233.217.30/api/v1/namespaces/webhook-7113/events": dial tcp 35.233.217.30:443: connect: connection refused
In [DeferCleanup (Each)] at: test/e2e/framework/debug/dump.go:44
----------
[FAILED]
Nov 24 09:04:53.152: Couldn't delete ns: "webhook-7113": Delete "https://35.233.217.30/api/v1/namespaces/webhook-7113": dial tcp 35.233.217.30:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://35.233.217.30/api/v1/namespaces/webhook-7113", Err:(*net.OpError)(0xc0010dfa40)}),Couldn't delete ns: "webhook-7113-markers": Delete "https://35.233.217.30/api/v1/namespaces/webhook-7113-markers": dial tcp 35.233.217.30:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://35.233.217.30/api/v1/namespaces/webhook-7113-markers", Err:(*net.OpError)(0xc0010dfc70)})
In [DeferCleanup (Each)] at: test/e2e/framework/framework.go:370

				[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  set up framework | framework.go:178
STEP: Creating a kubernetes client 11/24/22 09:03:56.438
Nov 24 09:03:56.438: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Building a namespace api object, basename webhook 11/24/22 09:03:56.439
STEP: Waiting for a default service account to be provisioned in namespace 11/24/22 09:03:56.647
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 11/24/22 09:03:56.747
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  test/e2e/framework/metrics/init/init.go:31
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  test/e2e/apimachinery/webhook.go:90
STEP: Setting up server cert 11/24/22 09:03:57.208
STEP: Create role binding to let webhook read extension-apiserver-authentication 11/24/22 09:03:57.879
STEP: Deploying the webhook pod 11/24/22 09:03:57.954
STEP: Wait for the deployment to be ready 11/24/22 09:03:58.311
Nov 24 09:03:58.699: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:0, UpdatedReplicas:0, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), Reason:"NewReplicaSetCreated", Message:"Created new replica set \"sample-webhook-deployment-865554f4d9\""}, v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}}, CollisionCount:(*int32)(nil)}
Nov 24 09:04:00.780: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 24 09:04:02.742: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 24 09:04:04.743: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 24 09:04:06.742: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 24 09:04:08.746: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 24 09:04:10.744: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 24 09:04:12.742: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 24 09:04:14.747: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 24 09:04:16.742: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 24 09:04:18.743: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 24 09:04:20.746: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 24 09:04:22.743: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 24 09:04:24.827: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 24 09:04:26.742: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 24 09:04:28.748: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 24, 9, 3, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
STEP: Deploying the webhook service 11/24/22 09:04:30.743
STEP: Verifying the service has paired with the endpoint 11/24/22 09:04:30.796
Nov 24 09:04:31.797: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
Nov 24 09:04:32.797: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
Nov 24 09:04:33.797: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
Nov 24 09:04:34.797: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
Nov 24 09:04:35.797: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
Nov 24 09:04:36.797: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
Nov 24 09:04:37.797: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
Nov 24 09:04:38.797: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
Nov 24 09:04:39.797: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
Nov 24 09:04:40.797: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
Nov 24 09:04:41.797: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
Nov 24 09:04:42.797: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
Nov 24 09:04:43.797: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
Nov 24 09:04:44.797: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
Nov 24 09:04:45.797: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
Nov 24 09:04:46.797: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
Nov 24 09:04:47.797: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
Nov 24 09:04:48.797: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
Nov 24 09:04:49.797: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
Nov 24 09:04:50.797: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
Nov 24 09:04:51.797: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
Nov 24 09:04:52.796: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
Nov 24 09:04:52.836: INFO: Unexpected error: waiting for service webhook-7113/e2e-test-webhook have 1 endpoint: 
    <*url.Error | 0xc0036ea630>: {
        Op: "Get",
        URL: "https://35.233.217.30/api/v1/namespaces/webhook-7113/endpoints",
        Err: <*net.OpError | 0xc0010df7c0>{
            Op: "dial",
            Net: "tcp",
            Source: nil,
            Addr: <*net.TCPAddr | 0xc003a91ef0>{
                IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 35, 233, 217, 30],
                Port: 443,
                Zone: "",
            },
            Err: <*os.SyscallError | 0xc0009d5e80>{
                Syscall: "connect",
                Err: <syscall.Errno>0x6f,
            },
        },
    }
Nov 24 09:04:52.836: FAIL: waiting for service webhook-7113/e2e-test-webhook have 1 endpoint: Get "https://35.233.217.30/api/v1/namespaces/webhook-7113/endpoints": dial tcp 35.233.217.30:443: connect: connection refused

Full Stack Trace
k8s.io/kubernetes/test/e2e/apimachinery.deployWebhookAndService(0xc000d9d4a0, {0xc00329c6c0, 0x2c}, 0xc00369bbd0, 0x20fb, 0x20fc)
	test/e2e/apimachinery/webhook.go:853 +0x13da
k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.1()
	test/e2e/apimachinery/webhook.go:102 +0x226
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  test/e2e/framework/node/init/init.go:32
Nov 24 09:04:52.836: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  test/e2e/apimachinery/webhook.go:105
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  dump namespaces | framework.go:196
STEP: dump namespace information after failure 11/24/22 09:04:53.032
STEP: Collecting events from namespace "webhook-7113". 11/24/22 09:04:53.032
Nov 24 09:04:53.072: INFO: Unexpected error: failed to list events in namespace "webhook-7113": 
    <*url.Error | 0xc0037826c0>: {
        Op: "Get",
        URL: "https://35.233.217.30/api/v1/namespaces/webhook-7113/events",
        Err: <*net.OpError | 0xc000c38050>{
            Op: "dial",
            Net: "tcp",
            Source: nil,
            Addr: <*net.TCPAddr | 0xc0012cce70>{
                IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 35, 233, 217, 30],
                Port: 443,
                Zone: "",
            },
            Err: <*os.SyscallError | 0xc0006b08a0>{
                Syscall: "connect",
                Err: <syscall.Errno>0x6f,
            },
        },
    }
Nov 24 09:04:53.072: FAIL: failed to list events in namespace "webhook-7113": Get "https://35.233.217.30/api/v1/namespaces/webhook-7113/events": dial tcp 35.233.217.30:443: connect: connection refused

Full Stack Trace
k8s.io/kubernetes/test/e2e/framework/debug.dumpEventsInNamespace(0xc00079e5c0, {0xc000cd1b60, 0xc})
	test/e2e/framework/debug/dump.go:44 +0x191
k8s.io/kubernetes/test/e2e/framework/debug.DumpAllNamespaceInfo({0x801de88, 0xc002c63520}, {0xc000cd1b60, 0xc})
	test/e2e/framework/debug/dump.go:62 +0x8d
k8s.io/kubernetes/test/e2e/framework/debug/init.init.0.func1.1(0xc00079e650?, {0xc000cd1b60?, 0x7fa7740?})
	test/e2e/framework/debug/init/init.go:34 +0x32
k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo.func1()
	test/e2e/framework/framework.go:274 +0x6d
k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo(0xc000d9d4a0)
	test/e2e/framework/framework.go:271 +0x179
reflect.Value.call({0x6627cc0?, 0xc00117bff0?, 0xc00462bfb0?}, {0x75b6e72, 0x4}, {0xae73300, 0x0, 0xc002c638e8?})
	/usr/local/go/src/reflect/value.go:584 +0x8c5
reflect.Value.Call({0x6627cc0?, 0xc00117bff0?, 0x29449fc?}, {0xae73300?, 0xc00462bf80?, 0x2fdb5c0?})
	/usr/local/go/src/reflect/value.go:368 +0xbc
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  tear down framework | framework.go:193
STEP: Destroying namespace "webhook-7113" for this suite. 11/24/22 09:04:53.072
STEP: Destroying namespace "webhook-7113-markers" for this suite. 11/24/22 09:04:53.112
Nov 24 09:04:53.152: FAIL: Couldn't delete ns: "webhook-7113": Delete "https://35.233.217.30/api/v1/namespaces/webhook-7113": dial tcp 35.233.217.30:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://35.233.217.30/api/v1/namespaces/webhook-7113", Err:(*net.OpError)(0xc0010dfa40)}),Couldn't delete ns: "webhook-7113-markers": Delete "https://35.233.217.30/api/v1/namespaces/webhook-7113-markers": dial tcp 35.233.217.30:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://35.233.217.30/api/v1/namespaces/webhook-7113-markers", Err:(*net.OpError)(0xc0010dfc70)})

Full Stack Trace
k8s.io/kubernetes/test/e2e/framework.(*Framework).AfterEach.func1()
	test/e2e/framework/framework.go:370 +0x4fe
k8s.io/kubernetes/test/e2e/framework.(*Framework).AfterEach(0xc000d9d4a0)
	test/e2e/framework/framework.go:383 +0x1ca
reflect.Value.call({0x6627cc0?, 0xc00117bf50?, 0xc00443ffb0?}, {0x75b6e72, 0x4}, {0xae73300, 0x0, 0x0?})
	/usr/local/go/src/reflect/value.go:584 +0x8c5
reflect.Value.Call({0x6627cc0?, 0xc00117bf50?, 0x0?}, {0xae73300?, 0x5?, 0xc000fecd38?})
	/usr/local/go/src/reflect/value.go:368 +0xbc

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should not be able to mutate or prevent deletion of webhook configuration objects [Conformance] 3m11s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\sshould\snot\sbe\sable\sto\smutate\sor\sprevent\sdeletion\sof\swebhook\sconfiguration\sobjects\s\[Conformance\]$'

test/e2e/framework/framework.go:241
k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc001175e00)
	test/e2e/framework/framework.go:241 +0x96f
There were additional failures detected after the initial failure:
[PANICKED]
Test Panicked
In [AfterEach] at: /usr/local/go/src/runtime/panic.go:260

runtime error: invalid memory address or nil pointer dereference

Full Stack Trace
  k8s.io/kubernetes/test/e2e/apimachinery.cleanWebhookTest({0x0, 0x0}, {0x0, 0x0})
  	test/e2e/apimachinery/webhook.go:1680 +0x46
  k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.2()
  	test/e2e/apimachinery/webhook.go:106 +0x2f

				[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  set up framework | framework.go:178
STEP: Creating a kubernetes client 11/24/22 09:25:55.463
Nov 24 09:25:55.463: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Building a namespace api object, basename webhook 11/24/22 09:25:55.465
Nov 24 09:27:55.512: INFO: Unexpected error: 
    <*fmt.wrapError | 0xc00143c020>: {
        msg: "wait for service account \"default\" in namespace \"webhook-9950\": timed out waiting for the condition",
        err: <*errors.errorString | 0xc000217c50>{
            s: "timed out waiting for the condition",
        },
    }
Nov 24 09:27:55.512: FAIL: wait for service account "default" in namespace "webhook-9950": timed out waiting for the condition

Full Stack Trace
k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc001175e00)
	test/e2e/framework/framework.go:241 +0x96f
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  test/e2e/framework/node/init/init.go:32
Nov 24 09:27:55.513: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  test/e2e/apimachinery/webhook.go:105
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  dump namespaces | framework.go:196
STEP: dump namespace information after failure 11/24/22 09:28:55.553
STEP: Collecting events from namespace "webhook-9950". 11/24/22 09:28:55.553
STEP: Found 0 events. 11/24/22 09:28:55.594
Nov 24 09:29:02.932: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Nov 24 09:29:02.932: INFO: 
Nov 24 09:29:03.017: INFO: 
Logging node info for node bootstrap-e2e-master
Nov 24 09:29:03.075: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master    57b53f45-775d-4de5-a4ff-420df60cf61e 12044 0 2022-11-24 09:00:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-24 09:00:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-11-24 09:00:50 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-11-24 09:00:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-11-24 09:26:48 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-serial-1-6/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3858374656 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3596230656 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-24 09:00:50 +0000 UTC,LastTransitionTime:2022-11-24 09:00:50 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-24 09:26:48 +0000 UTC,LastTransitionTime:2022-11-24 09:00:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-24 09:26:48 +0000 UTC,LastTransitionTime:2022-11-24 09:00:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-24 09:26:48 +0000 UTC,LastTransitionTime:2022-11-24 09:00:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-24 09:26:48 +0000 UTC,LastTransitionTime:2022-11-24 09:00:54 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:35.233.217.30,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-jkns-gce-serial-1-6.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-jkns-gce-serial-1-6.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:2380dd218709b39effceaa3da78bc7d6,SystemUUID:2380dd21-8709-b39e-ffce-aa3da78bc7d6,BootID:8a5acb5e-406f-47f0-bc85-bed589236d7d,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.44+45279654db87f4,KubeProxyVersion:v1.27.0-alpha.0.44+45279654db87f4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:135160275,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:124989753,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:57659704,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:2c111f004bec24888d8cfa2a812a38fb8341350abac67dcd0ac64e709dfe389c registry.k8s.io/kas-network-proxy/proxy-server:v0.0.33],SizeBytes:22020129,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 24 09:29:03.075: INFO: 
Logging kubelet events for node bootstrap-e2e-master
Nov 24 09:29:03.197: INFO: 
Logging pods the kubelet thinks is on node bootstrap-e2e-master
Nov 24 09:29:03.314: INFO: kube-controller-manager-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:03.314: INFO: 	Container kube-controller-manager ready: false, restart count 7
Nov 24 09:29:03.314: INFO: kube-scheduler-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:03.314: INFO: 	Container kube-scheduler ready: false, restart count 7
Nov 24 09:29:03.314: INFO: kube-apiserver-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:03.314: INFO: 	Container kube-apiserver ready: false, restart count 3
Nov 24 09:29:03.314: INFO: etcd-server-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:03.314: INFO: 	Container etcd-container ready: true, restart count 4
Nov 24 09:29:03.314: INFO: konnectivity-server-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:03.314: INFO: 	Container konnectivity-server-container ready: true, restart count 0
Nov 24 09:29:03.314: INFO: kube-addon-manager-bootstrap-e2e-master started at 2022-11-24 09:00:06 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:03.314: INFO: 	Container kube-addon-manager ready: true, restart count 2
Nov 24 09:29:03.314: INFO: l7-lb-controller-bootstrap-e2e-master started at 2022-11-24 09:00:07 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:03.314: INFO: 	Container l7-lb-controller ready: false, restart count 7
Nov 24 09:29:03.314: INFO: metadata-proxy-v0.1-dgq6b started at 2022-11-24 09:01:06 +0000 UTC (0+2 container statuses recorded)
Nov 24 09:29:03.314: INFO: 	Container metadata-proxy ready: true, restart count 0
Nov 24 09:29:03.314: INFO: 	Container prometheus-to-sd-exporter ready: true, restart count 0
Nov 24 09:29:03.314: INFO: etcd-server-events-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:03.314: INFO: 	Container etcd-container ready: true, restart count 3
Nov 24 09:29:03.795: INFO: 
Latency metrics for node bootstrap-e2e-master
Nov 24 09:29:03.795: INFO: 
Logging node info for node bootstrap-e2e-minion-group-0xkq
Nov 24 09:29:03.901: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-0xkq    34eb6b8a-d427-45c3-aa67-9f7aa0a1f8a1 12219 0 2022-11-24 09:00:32 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-0xkq kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-0xkq topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-4020":"bootstrap-e2e-minion-group-0xkq"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-11-24 09:00:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}}}} } {kubelet Update v1 2022-11-24 09:00:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-24 09:18:36 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {node-problem-detector Update v1 2022-11-24 09:25:39 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-24 09:29:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-serial-1-6/us-west1-b/bootstrap-e2e-minion-group-0xkq,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-24 09:25:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-24 09:25:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-24 09:25:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-24 09:25:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-24 09:25:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-24 09:25:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-24 09:25:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-24 09:00:50 +0000 UTC,LastTransitionTime:2022-11-24 09:00:50 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-24 09:24:47 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-24 09:24:47 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-24 09:24:47 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-24 09:24:47 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:34.145.99.248,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-0xkq.c.k8s-jkns-gce-serial-1-6.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-0xkq.c.k8s-jkns-gce-serial-1-6.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:23bcd2ca790827437c5cec98facdba94,SystemUUID:23bcd2ca-7908-2743-7c5c-ec98facdba94,BootID:84f5ff41-fbc9-4fdb-966f-19346788bdab,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.44+45279654db87f4,KubeProxyVersion:v1.27.0-alpha.0.44+45279654db87f4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:67201224,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/debian-base@sha256:ebda8587ec0f49eb88ee3a608ef018484908cbc5aa32556a0d78356088c185d4 registry.k8s.io/debian-base:v2.0.0],SizeBytes:21093264,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-5616^f895d0cb-6bd8-11ed-82b3-fe6d40909f02 kubernetes.io/csi/csi-hostpath-ephemeral-5616^f8bc8630-6bd8-11ed-82b3-fe6d40909f02],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-5616^f895d0cb-6bd8-11ed-82b3-fe6d40909f02,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-5616^f8bc8630-6bd8-11ed-82b3-fe6d40909f02,DevicePath:,},},Config:nil,},}
Nov 24 09:29:03.902: INFO: 
Logging kubelet events for node bootstrap-e2e-minion-group-0xkq
Nov 24 09:29:04.162: INFO: 
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-0xkq
Nov 24 09:29:04.725: INFO: csi-mockplugin-0 started at 2022-11-24 09:02:44 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:29:04.725: INFO: 	Container csi-provisioner ready: false, restart count 8
Nov 24 09:29:04.725: INFO: 	Container driver-registrar ready: false, restart count 8
Nov 24 09:29:04.725: INFO: 	Container mock ready: false, restart count 8
Nov 24 09:29:04.725: INFO: hostexec-bootstrap-e2e-minion-group-0xkq-pqnxr started at 2022-11-24 09:06:47 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.725: INFO: 	Container agnhost-container ready: true, restart count 1
Nov 24 09:29:04.725: INFO: pod-subpath-test-preprovisionedpv-tmmr started at 2022-11-24 09:07:37 +0000 UTC (2+1 container statuses recorded)
Nov 24 09:29:04.725: INFO: 	Init container init-volume-preprovisionedpv-tmmr ready: true, restart count 0
Nov 24 09:29:04.725: INFO: 	Init container test-init-volume-preprovisionedpv-tmmr ready: true, restart count 0
Nov 24 09:29:04.725: INFO: 	Container test-container-subpath-preprovisionedpv-tmmr ready: false, restart count 0
Nov 24 09:29:04.725: INFO: pod-configmaps-e234b165-43bc-41ce-91d4-7789b97cbf1a started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.725: INFO: 	Container env-test ready: false, restart count 0
Nov 24 09:29:04.725: INFO: netserver-0 started at 2022-11-24 09:18:27 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.725: INFO: 	Container webserver ready: true, restart count 4
Nov 24 09:29:04.725: INFO: netserver-0 started at 2022-11-24 09:04:49 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.725: INFO: 	Container webserver ready: false, restart count 8
Nov 24 09:29:04.725: INFO: pod-disruption-failure-ignore-0-r2g6r started at 2022-11-24 09:17:13 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.725: INFO: 	Container c ready: false, restart count 0
Nov 24 09:29:04.725: INFO: test-pod-3 started at 2022-11-24 09:02:41 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.725: INFO: 	Container token-test ready: false, restart count 0
Nov 24 09:29:04.725: INFO: netserver-0 started at 2022-11-24 09:04:04 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.725: INFO: 	Container webserver ready: false, restart count 9
Nov 24 09:29:04.725: INFO: coredns-6d97d5ddb-q22hn started at 2022-11-24 09:00:58 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.725: INFO: 	Container coredns ready: false, restart count 9
Nov 24 09:29:04.725: INFO: sample-webhook-deployment-865554f4d9-pngsn started at 2022-11-24 09:04:04 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.725: INFO: 	Container sample-webhook ready: false, restart count 9
Nov 24 09:29:04.725: INFO: alpine-nnp-false-d237a6ae-3e11-402c-9f30-27adea86549e started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.725: INFO: 	Container alpine-nnp-false-d237a6ae-3e11-402c-9f30-27adea86549e ready: false, restart count 0
Nov 24 09:29:04.725: INFO: pod-disruption-failure-ignore-3-d94v4 started at 2022-11-24 09:17:17 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.725: INFO: 	Container c ready: false, restart count 0
Nov 24 09:29:04.725: INFO: csi-hostpathplugin-0 started at 2022-11-24 09:18:27 +0000 UTC (0+7 container statuses recorded)
Nov 24 09:29:04.725: INFO: 	Container csi-attacher ready: false, restart count 2
Nov 24 09:29:04.725: INFO: 	Container csi-provisioner ready: false, restart count 2
Nov 24 09:29:04.725: INFO: 	Container csi-resizer ready: false, restart count 2
Nov 24 09:29:04.725: INFO: 	Container csi-snapshotter ready: false, restart count 2
Nov 24 09:29:04.725: INFO: 	Container hostpath ready: false, restart count 2
Nov 24 09:29:04.725: INFO: 	Container liveness-probe ready: false, restart count 2
Nov 24 09:29:04.725: INFO: 	Container node-driver-registrar ready: false, restart count 3
Nov 24 09:29:04.725: INFO: kube-proxy-bootstrap-e2e-minion-group-0xkq started at 2022-11-24 09:00:32 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.725: INFO: 	Container kube-proxy ready: false, restart count 8
Nov 24 09:29:04.725: INFO: konnectivity-agent-nxcws started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.725: INFO: 	Container konnectivity-agent ready: false, restart count 8
Nov 24 09:29:04.725: INFO: apparmor-loader-nf47q started at 2022-11-24 09:18:27 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.725: INFO: 	Container apparmor-loader ready: true, restart count 2
Nov 24 09:29:04.725: INFO: httpd started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.725: INFO: 	Container httpd ready: false, restart count 5
Nov 24 09:29:04.725: INFO: agnhost started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.725: INFO: 	Container agnhost ready: false, restart count 0
Nov 24 09:29:04.725: INFO: csi-mockplugin-attacher-0 started at 2022-11-24 09:13:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.725: INFO: 	Container csi-attacher ready: true, restart count 5
Nov 24 09:29:04.725: INFO: pod-disruption-failure-ignore-1-b8vdq started at 2022-11-24 09:17:13 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.725: INFO: 	Container c ready: false, restart count 0
Nov 24 09:29:04.725: INFO: ss2-0 started at 2022-11-24 09:18:51 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.725: INFO: 	Container webserver ready: true, restart count 2
Nov 24 09:29:04.725: INFO: hostexec-bootstrap-e2e-minion-group-0xkq-vtzpg started at 2022-11-24 09:18:35 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.725: INFO: 	Container agnhost-container ready: false, restart count 4
Nov 24 09:29:04.725: INFO: inline-volume-tester-6w8qg started at 2022-11-24 09:18:36 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.725: INFO: 	Container csi-volume-tester ready: false, restart count 0
Nov 24 09:29:04.725: INFO: pod-secrets-6ef894cf-d4cc-4c12-a50d-3e49edaec470 started at 2022-11-24 09:07:37 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:29:04.725: INFO: 	Container creates-volume-test ready: false, restart count 0
Nov 24 09:29:04.725: INFO: 	Container dels-volume-test ready: false, restart count 0
Nov 24 09:29:04.725: INFO: 	Container upds-volume-test ready: false, restart count 0
Nov 24 09:29:04.725: INFO: sample-webhook-deployment-865554f4d9-qhln9 started at 2022-11-24 09:04:35 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.725: INFO: 	Container sample-webhook ready: true, restart count 10
Nov 24 09:29:04.725: INFO: test-apparmor-k8mtn started at 2022-11-24 09:18:35 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.725: INFO: 	Container test ready: false, restart count 0
Nov 24 09:29:04.725: INFO: webserver-7d887d45b-b2lng started at 2022-11-24 09:10:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.725: INFO: 	Container httpd ready: true, restart count 7
Nov 24 09:29:04.725: INFO: service-deletion-pmnf7 started at 2022-11-24 09:13:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.725: INFO: 	Container service-deletion ready: false, restart count 3
Nov 24 09:29:04.725: INFO: pod-disruption-failure-ignore-1-8q4cc started at 2022-11-24 09:13:53 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.725: INFO: 	Container c ready: false, restart count 0
Nov 24 09:29:04.725: INFO: update-demo-nautilus-827pl started at 2022-11-24 09:18:35 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.725: INFO: 	Container update-demo ready: false, restart count 3
Nov 24 09:29:04.725: INFO: webserver-7d887d45b-zjrtz started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.725: INFO: 	Container httpd ready: true, restart count 3
Nov 24 09:29:04.725: INFO: pod-subpath-test-preprovisionedpv-bchr started at 2022-11-24 09:07:37 +0000 UTC (1+1 container statuses recorded)
Nov 24 09:29:04.725: INFO: 	Init container init-volume-preprovisionedpv-bchr ready: true, restart count 0
Nov 24 09:29:04.725: INFO: 	Container test-container-subpath-preprovisionedpv-bchr ready: false, restart count 0
Nov 24 09:29:04.725: INFO: hostexec-bootstrap-e2e-minion-group-0xkq-gs72q started at 2022-11-24 09:06:42 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.725: INFO: 	Container agnhost-container ready: false, restart count 6
Nov 24 09:29:04.725: INFO: sample-webhook-deployment-865554f4d9-shnzq started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.725: INFO: 	Container sample-webhook ready: true, restart count 2
Nov 24 09:29:04.725: INFO: external-provisioner-s6wpd started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.725: INFO: 	Container nfs-provisioner ready: true, restart count 8
Nov 24 09:29:04.725: INFO: client-containers-73020471-75dc-486c-91d8-b2150c34f574 started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.725: INFO: 	Container agnhost-container ready: false, restart count 0
Nov 24 09:29:04.725: INFO: pod-disruption-failure-ignore-2-m4qbn started at 2022-11-24 09:17:17 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.725: INFO: 	Container c ready: false, restart count 0
Nov 24 09:29:04.725: INFO: agnhost-host-aliases07dd0013-880a-43df-b65a-dd3cc866b1c6 started at 2022-11-24 09:04:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.725: INFO: 	Container agnhost-container ready: false, restart count 0
Nov 24 09:29:04.725: INFO: httpd-deployment-6859889f88-cjjj8 started at 2022-11-24 09:04:51 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.725: INFO: 	Container httpd ready: false, restart count 6
Nov 24 09:29:04.725: INFO: busybox-e4175cec-5a98-457b-8d7a-fc687790f79e started at 2022-11-24 09:04:11 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.725: INFO: 	Container busybox ready: false, restart count 10
Nov 24 09:29:04.725: INFO: csi-mockplugin-0 started at 2022-11-24 09:13:37 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:29:04.725: INFO: 	Container csi-provisioner ready: true, restart count 6
Nov 24 09:29:04.725: INFO: 	Container driver-registrar ready: true, restart count 6
Nov 24 09:29:04.725: INFO: 	Container mock ready: true, restart count 6
Nov 24 09:29:04.725: INFO: pod-always-succeed1ac1248a-f95d-4ec8-add5-00fdfc91f740 started at 2022-11-24 09:04:11 +0000 UTC (1+1 container statuses recorded)
Nov 24 09:29:04.725: INFO: 	Init container foo ready: true, restart count 0
Nov 24 09:29:04.725: INFO: 	Container bar ready: false, restart count 0
Nov 24 09:29:04.725: INFO: metadata-proxy-v0.1-jg8bk started at 2022-11-24 09:00:33 +0000 UTC (0+2 container statuses recorded)
Nov 24 09:29:04.725: INFO: 	Container metadata-proxy ready: true, restart count 0
Nov 24 09:29:04.725: INFO: 	Container prometheus-to-sd-exporter ready: true, restart count 0
Nov 24 09:29:04.725: INFO: busybox-readonly-true-0c7fd3e6-417c-4909-a077-6624310b4dfb started at 2022-11-24 09:04:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.725: INFO: 	Container busybox-readonly-true-0c7fd3e6-417c-4909-a077-6624310b4dfb ready: false, restart count 0
Nov 24 09:29:04.725: INFO: pod-disruption-failure-ignore-0-ngtgb started at 2022-11-24 09:13:53 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.725: INFO: 	Container c ready: false, restart count 0
Nov 24 09:29:05.240: INFO: 
Latency metrics for node bootstrap-e2e-minion-group-0xkq
Nov 24 09:29:05.240: INFO: 
Logging node info for node bootstrap-e2e-minion-group-6m4q
Nov 24 09:29:05.289: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-6m4q    be4476db-4c35-4ea4-96f6-e1f0e7c12742 12084 0 2022-11-24 09:00:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-6m4q kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-6m4q topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-8753":"bootstrap-e2e-minion-group-6m4q"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-24 09:00:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-24 09:00:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-11-24 09:12:06 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {node-problem-detector Update v1 2022-11-24 09:25:43 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-24 09:27:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-serial-1-6/us-west1-b/bootstrap-e2e-minion-group-6m4q,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-24 09:25:43 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-24 09:25:43 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-24 09:25:43 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-24 09:25:43 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-24 09:25:43 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-24 09:25:43 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-24 09:25:43 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-24 09:00:50 +0000 UTC,LastTransitionTime:2022-11-24 09:00:50 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-24 09:24:48 +0000 UTC,LastTransitionTime:2022-11-24 09:00:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-24 09:24:48 +0000 UTC,LastTransitionTime:2022-11-24 09:00:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-24 09:24:48 +0000 UTC,LastTransitionTime:2022-11-24 09:00:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-24 09:24:48 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:35.247.58.118,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-6m4q.c.k8s-jkns-gce-serial-1-6.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-6m4q.c.k8s-jkns-gce-serial-1-6.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:7b2cc9e909d10f7df61b26e8aece9707,SystemUUID:7b2cc9e9-09d1-0f7d-f61b-26e8aece9707,BootID:64607970-cc6d-408c-9269-dff979065832,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.44+45279654db87f4,KubeProxyVersion:v1.27.0-alpha.0.44+45279654db87f4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:67201224,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 registry.k8s.io/sig-storage/snapshot-controller:v6.1.0],SizeBytes:22620891,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-7570^55118aeb-6bd7-11ed-8dba-2207550599a3 kubernetes.io/csi/csi-hostpath-ephemeral-8753^758a12fe-6bd7-11ed-b4fd-0e9a0f0cf363],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-7570^55118aeb-6bd7-11ed-8dba-2207550599a3,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-8753^758a12fe-6bd7-11ed-b4fd-0e9a0f0cf363,DevicePath:,},},Config:nil,},}
Nov 24 09:29:05.289: INFO: 
Logging kubelet events for node bootstrap-e2e-minion-group-6m4q
Nov 24 09:29:05.425: INFO: 
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-6m4q
Nov 24 09:29:05.510: INFO: csi-mockplugin-0 started at 2022-11-24 09:06:45 +0000 UTC (0+4 container statuses recorded)
Nov 24 09:29:05.510: INFO: 	Container busybox ready: true, restart count 6
Nov 24 09:29:05.510: INFO: 	Container csi-provisioner ready: false, restart count 7
Nov 24 09:29:05.510: INFO: 	Container driver-registrar ready: false, restart count 6
Nov 24 09:29:05.510: INFO: 	Container mock ready: false, restart count 6
Nov 24 09:29:05.510: INFO: hostexec-bootstrap-e2e-minion-group-6m4q-h8v54 started at 2022-11-24 09:04:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.510: INFO: 	Container agnhost-container ready: true, restart count 7
Nov 24 09:29:05.510: INFO: liveness-285ed85f-af70-4221-a9ae-9d3784882e9c started at 2022-11-24 09:06:27 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.510: INFO: 	Container agnhost-container ready: true, restart count 3
Nov 24 09:29:05.510: INFO: coredns-6d97d5ddb-9z7tn started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.510: INFO: 	Container coredns ready: false, restart count 9
Nov 24 09:29:05.510: INFO: volume-snapshot-controller-0 started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.510: INFO: 	Container volume-snapshot-controller ready: false, restart count 6
Nov 24 09:29:05.510: INFO: ss2-2 started at 2022-11-24 09:18:27 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.510: INFO: 	Container webserver ready: false, restart count 4
Nov 24 09:29:05.510: INFO: pod-0 started at 2022-11-24 09:04:46 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.510: INFO: 	Container donothing ready: true, restart count 5
Nov 24 09:29:05.510: INFO: netserver-1 started at 2022-11-24 09:18:27 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.510: INFO: 	Container webserver ready: false, restart count 6
Nov 24 09:29:05.510: INFO: csi-hostpathplugin-0 started at 2022-11-24 09:06:47 +0000 UTC (0+7 container statuses recorded)
Nov 24 09:29:05.510: INFO: 	Container csi-attacher ready: false, restart count 8
Nov 24 09:29:05.510: INFO: 	Container csi-provisioner ready: false, restart count 8
Nov 24 09:29:05.510: INFO: 	Container csi-resizer ready: false, restart count 8
Nov 24 09:29:05.510: INFO: 	Container csi-snapshotter ready: false, restart count 8
Nov 24 09:29:05.510: INFO: 	Container hostpath ready: false, restart count 8
Nov 24 09:29:05.510: INFO: 	Container liveness-probe ready: false, restart count 8
Nov 24 09:29:05.510: INFO: 	Container node-driver-registrar ready: false, restart count 7
Nov 24 09:29:05.510: INFO: csi-hostpathplugin-0 started at 2022-11-24 09:07:37 +0000 UTC (0+7 container statuses recorded)
Nov 24 09:29:05.510: INFO: 	Container csi-attacher ready: true, restart count 8
Nov 24 09:29:05.510: INFO: 	Container csi-provisioner ready: true, restart count 8
Nov 24 09:29:05.510: INFO: 	Container csi-resizer ready: true, restart count 8
Nov 24 09:29:05.510: INFO: 	Container csi-snapshotter ready: true, restart count 8
Nov 24 09:29:05.510: INFO: 	Container hostpath ready: true, restart count 8
Nov 24 09:29:05.510: INFO: 	Container liveness-probe ready: true, restart count 8
Nov 24 09:29:05.510: INFO: 	Container node-driver-registrar ready: true, restart count 7
Nov 24 09:29:05.510: INFO: pvc-volume-tester-8w74v started at 2022-11-24 09:07:38 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.510: INFO: 	Container volume-tester ready: false, restart count 0
Nov 24 09:29:05.510: INFO: webserver-7d887d45b-lr79x started at 2022-11-24 09:07:41 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.510: INFO: 	Container httpd ready: false, restart count 7
Nov 24 09:29:05.510: INFO: kube-proxy-bootstrap-e2e-minion-group-6m4q started at 2022-11-24 09:00:35 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.510: INFO: 	Container kube-proxy ready: false, restart count 8
Nov 24 09:29:05.510: INFO: netserver-1 started at 2022-11-24 09:04:04 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.510: INFO: 	Container webserver ready: false, restart count 8
Nov 24 09:29:05.510: INFO: inline-volume-tester-2k2tt started at 2022-11-24 09:18:27 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.510: INFO: 	Container csi-volume-tester ready: false, restart count 0
Nov 24 09:29:05.510: INFO: httpd-deployment-6859889f88-22w25 started at 2022-11-24 09:04:51 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.510: INFO: 	Container httpd ready: true, restart count 6
Nov 24 09:29:05.510: INFO: my-hostname-private-ae51c3f4-8897-433b-b3ed-7b3c0ce69bc4-9dsrv started at 2022-11-24 09:18:27 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.510: INFO: 	Container my-hostname-private-ae51c3f4-8897-433b-b3ed-7b3c0ce69bc4 ready: true, restart count 4
Nov 24 09:29:05.510: INFO: webserver-pod started at 2022-11-24 09:04:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.510: INFO: 	Container agnhost ready: false, restart count 4
Nov 24 09:29:05.510: INFO: l7-default-backend-8549d69d99-762zc started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.510: INFO: 	Container default-http-backend ready: true, restart count 0
Nov 24 09:29:05.510: INFO: konnectivity-agent-k4jdw started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.510: INFO: 	Container konnectivity-agent ready: false, restart count 7
Nov 24 09:29:05.510: INFO: pod-client started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.510: INFO: 	Container pod-client ready: true, restart count 4
Nov 24 09:29:05.510: INFO: metadata-proxy-v0.1-lwtk4 started at 2022-11-24 09:00:35 +0000 UTC (0+2 container statuses recorded)
Nov 24 09:29:05.510: INFO: 	Container metadata-proxy ready: true, restart count 0
Nov 24 09:29:05.510: INFO: 	Container prometheus-to-sd-exporter ready: true, restart count 0
Nov 24 09:29:05.510: INFO: kube-dns-autoscaler-5f6455f985-hxtg5 started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.510: INFO: 	Container autoscaler ready: false, restart count 8
Nov 24 09:29:05.510: INFO: pod-configmaps-6929437e-13e1-4a93-b7fa-e8ec8d7c7138 started at 2022-11-24 09:04:04 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:29:05.510: INFO: 	Container createcm-volume-test ready: false, restart count 0
Nov 24 09:29:05.510: INFO: 	Container delcm-volume-test ready: false, restart count 0
Nov 24 09:29:05.510: INFO: 	Container updcm-volume-test ready: false, restart count 0
Nov 24 09:29:05.510: INFO: inline-volume-tester-rr76m started at 2022-11-24 09:07:45 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.510: INFO: 	Container csi-volume-tester ready: false, restart count 0
Nov 24 09:29:05.510: INFO: netserver-1 started at 2022-11-24 09:04:49 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.510: INFO: 	Container webserver ready: false, restart count 8
Nov 24 09:29:05.510: INFO: inline-volume-tester-vc928 started at 2022-11-24 09:07:38 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.510: INFO: 	Container csi-volume-tester ready: false, restart count 0
Nov 24 09:29:05.510: INFO: pod-subpath-test-secret-56vz started at 2022-11-24 09:04:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.510: INFO: 	Container test-container-subpath-secret-56vz ready: false, restart count 0
Nov 24 09:29:05.799: INFO: 
Latency metrics for node bootstrap-e2e-minion-group-6m4q
Nov 24 09:29:05.799: INFO: 
Logging node info for node bootstrap-e2e-minion-group-fj34
Nov 24 09:29:05.845: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-fj34    26b0a38a-1259-4217-8b0f-bfa92e43b570 12221 0 2022-11-24 09:00:32 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-fj34 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-fj34 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-4261":"bootstrap-e2e-minion-group-fj34","csi-hostpath-ephemeral-7265":"bootstrap-e2e-minion-group-fj34","csi-mock-csi-mock-volumes-1806":"bootstrap-e2e-minion-group-fj34","csi-mock-csi-mock-volumes-9231":"bootstrap-e2e-minion-group-fj34"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-11-24 09:00:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kubelet Update v1 2022-11-24 09:00:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-24 09:10:50 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {node-problem-detector Update v1 2022-11-24 09:25:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-24 09:29:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-serial-1-6/us-west1-b/bootstrap-e2e-minion-group-fj34,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-24 09:25:40 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-24 09:25:40 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-24 09:25:40 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-24 09:25:40 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-24 09:25:40 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-24 09:25:40 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-24 09:25:40 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-24 09:00:50 +0000 UTC,LastTransitionTime:2022-11-24 09:00:50 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-24 09:24:47 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-24 09:24:47 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-24 09:24:47 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-24 09:24:47 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.82.73.153,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-fj34.c.k8s-jkns-gce-serial-1-6.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-fj34.c.k8s-jkns-gce-serial-1-6.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:557b5201a29dc5c84dc79b98af6f523a,SystemUUID:557b5201-a29d-c5c8-4dc7-9b98af6f523a,BootID:0f4289cb-5f88-4ee3-b552-b99fcc030f54,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.44+45279654db87f4,KubeProxyVersion:v1.27.0-alpha.0.44+45279654db87f4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:67201224,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:c0ddb4794bc8a3631e3373015f913c00b230ee54f87bde9ade195b3a3415c60f registry.k8s.io/build-image/distroless-iptables:v0.1.2],SizeBytes:7685585,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-1806^5a1ffb25-6bd7-11ed-9365-7e36e6fec9d2 kubernetes.io/csi/csi-mock-csi-mock-volumes-9231^cbf4a4b9-6bd6-11ed-88e7-326e345b4078],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-9231^cbf4a4b9-6bd6-11ed-88e7-326e345b4078,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-1806^5a1ffb25-6bd7-11ed-9365-7e36e6fec9d2,DevicePath:,},},Config:nil,},}
Nov 24 09:29:05.845: INFO: 
Logging kubelet events for node bootstrap-e2e-minion-group-fj34
Nov 24 09:29:05.896: INFO: 
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-fj34
Nov 24 09:29:05.992: INFO: netserver-2 started at 2022-11-24 09:04:49 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.992: INFO: 	Container webserver ready: false, restart count 8
Nov 24 09:29:05.992: INFO: csi-mockplugin-attacher-0 started at 2022-11-24 09:02:44 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.992: INFO: 	Container csi-attacher ready: false, restart count 6
Nov 24 09:29:05.992: INFO: external-provisioner-br7l6 started at 2022-11-24 09:13:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.992: INFO: 	Container nfs-provisioner ready: true, restart count 6
Nov 24 09:29:05.992: INFO: csi-hostpathplugin-0 started at 2022-11-24 09:18:54 +0000 UTC (0+7 container statuses recorded)
Nov 24 09:29:05.992: INFO: 	Container csi-attacher ready: true, restart count 0
Nov 24 09:29:05.992: INFO: 	Container csi-provisioner ready: true, restart count 0
Nov 24 09:29:05.992: INFO: 	Container csi-resizer ready: true, restart count 0
Nov 24 09:29:05.992: INFO: 	Container csi-snapshotter ready: true, restart count 0
Nov 24 09:29:05.992: INFO: 	Container hostpath ready: true, restart count 0
Nov 24 09:29:05.992: INFO: 	Container liveness-probe ready: true, restart count 0
Nov 24 09:29:05.992: INFO: 	Container node-driver-registrar ready: true, restart count 0
Nov 24 09:29:05.992: INFO: konnectivity-agent-jjqhp started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.992: INFO: 	Container konnectivity-agent ready: true, restart count 8
Nov 24 09:29:05.992: INFO: pod-subpath-test-preprovisionedpv-bvlk started at 2022-11-24 09:07:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.992: INFO: 	Container test-container-subpath-preprovisionedpv-bvlk ready: false, restart count 0
Nov 24 09:29:05.992: INFO: csi-hostpathplugin-0 started at 2022-11-24 09:18:45 +0000 UTC (0+7 container statuses recorded)
Nov 24 09:29:05.992: INFO: 	Container csi-attacher ready: true, restart count 0
Nov 24 09:29:05.992: INFO: 	Container csi-provisioner ready: true, restart count 0
Nov 24 09:29:05.992: INFO: 	Container csi-resizer ready: true, restart count 0
Nov 24 09:29:05.992: INFO: 	Container csi-snapshotter ready: true, restart count 0
Nov 24 09:29:05.992: INFO: 	Container hostpath ready: true, restart count 0
Nov 24 09:29:05.992: INFO: 	Container liveness-probe ready: true, restart count 0
Nov 24 09:29:05.992: INFO: 	Container node-driver-registrar ready: true, restart count 0
Nov 24 09:29:05.992: INFO: host-test-container-pod started at 2022-11-24 09:24:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.992: INFO: 	Container agnhost-container ready: true, restart count 1
Nov 24 09:29:05.992: INFO: kube-proxy-bootstrap-e2e-minion-group-fj34 started at 2022-11-24 09:00:32 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.992: INFO: 	Container kube-proxy ready: false, restart count 9
Nov 24 09:29:05.992: INFO: metadata-proxy-v0.1-rtz4q started at 2022-11-24 09:00:33 +0000 UTC (0+2 container statuses recorded)
Nov 24 09:29:05.992: INFO: 	Container metadata-proxy ready: true, restart count 0
Nov 24 09:29:05.992: INFO: 	Container prometheus-to-sd-exporter ready: true, restart count 0
Nov 24 09:29:05.992: INFO: pvc-volume-tester-5zg8r started at 2022-11-24 09:03:02 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.992: INFO: 	Container volume-tester ready: false, restart count 0
Nov 24 09:29:05.992: INFO: pvc-volume-tester-txtfw started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.992: INFO: 	Container volume-tester ready: false, restart count 0
Nov 24 09:29:05.992: INFO: csi-mockplugin-attacher-0 started at 2022-11-24 09:06:32 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.992: INFO: 	Container csi-attacher ready: true, restart count 8
Nov 24 09:29:05.992: INFO: netserver-2 started at 2022-11-24 09:18:27 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.992: INFO: 	Container webserver ready: false, restart count 4
Nov 24 09:29:05.992: INFO: ss2-1 started at 2022-11-24 09:18:38 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.992: INFO: 	Container webserver ready: false, restart count 6
Nov 24 09:29:05.992: INFO: inline-volume-tester-2dgl7 started at 2022-11-24 09:18:54 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.992: INFO: 	Container csi-volume-tester ready: false, restart count 0
Nov 24 09:29:05.992: INFO: csi-mockplugin-0 started at 2022-11-24 09:02:44 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:29:05.992: INFO: 	Container csi-provisioner ready: true, restart count 8
Nov 24 09:29:05.992: INFO: 	Container driver-registrar ready: true, restart count 8
Nov 24 09:29:05.992: INFO: 	Container mock ready: true, restart count 8
Nov 24 09:29:05.992: INFO: csi-mockplugin-resizer-0 started at 2022-11-24 09:02:44 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.992: INFO: 	Container csi-resizer ready: true, restart count 6
Nov 24 09:29:05.992: INFO: csi-mockplugin-attacher-0 started at 2022-11-24 09:02:44 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.992: INFO: 	Container csi-attacher ready: true, restart count 7
Nov 24 09:29:05.992: INFO: update-demo-nautilus-56j4t started at 2022-11-24 09:18:35 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.992: INFO: 	Container update-demo ready: true, restart count 3
Nov 24 09:29:05.992: INFO: test-pod-2 started at 2022-11-24 09:02:40 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.992: INFO: 	Container token-test ready: false, restart count 0
Nov 24 09:29:05.992: INFO: csi-hostpathplugin-0 started at 2022-11-24 09:03:06 +0000 UTC (0+7 container statuses recorded)
Nov 24 09:29:05.992: INFO: 	Container csi-attacher ready: false, restart count 5
Nov 24 09:29:05.992: INFO: 	Container csi-provisioner ready: false, restart count 5
Nov 24 09:29:05.992: INFO: 	Container csi-resizer ready: false, restart count 5
Nov 24 09:29:05.992: INFO: 	Container csi-snapshotter ready: false, restart count 5
Nov 24 09:29:05.992: INFO: 	Container hostpath ready: false, restart count 5
Nov 24 09:29:05.992: INFO: 	Container liveness-probe ready: false, restart count 5
Nov 24 09:29:05.992: INFO: 	Container node-driver-registrar ready: false, restart count 5
Nov 24 09:29:05.992: INFO: hostexec-bootstrap-e2e-minion-group-fj34-z4nnm started at 2022-11-24 09:06:46 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.992: INFO: 	Container agnhost-container ready: true, restart count 6
Nov 24 09:29:05.992: INFO: pod-subpath-test-inlinevolume-mcdr started at 2022-11-24 09:04:49 +0000 UTC (2+1 container statuses recorded)
Nov 24 09:29:05.992: INFO: 	Init container init-volume-inlinevolume-mcdr ready: true, restart count 0
Nov 24 09:29:05.992: INFO: 	Init container test-init-volume-inlinevolume-mcdr ready: true, restart count 0
Nov 24 09:29:05.992: INFO: 	Container test-container-subpath-inlinevolume-mcdr ready: false, restart count 0
Nov 24 09:29:05.992: INFO: test-container-pod started at 2022-11-24 09:24:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.992: INFO: 	Container webserver ready: true, restart count 1
Nov 24 09:29:05.992: INFO: test-pod-1 started at 2022-11-24 09:02:40 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.992: INFO: 	Container token-test ready: false, restart count 0
Nov 24 09:29:05.992: INFO: hostexec-bootstrap-e2e-minion-group-fj34-9j92x started at 2022-11-24 09:04:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.992: INFO: 	Container agnhost-container ready: true, restart count 5
Nov 24 09:29:05.992: INFO: httpd-deployment-6859889f88-whrb9 started at 2022-11-24 09:05:53 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.992: INFO: 	Container httpd ready: false, restart count 6
Nov 24 09:29:05.992: INFO: csi-mockplugin-0 started at 2022-11-24 09:06:32 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:29:05.992: INFO: 	Container csi-provisioner ready: true, restart count 7
Nov 24 09:29:05.992: INFO: 	Container driver-registrar ready: true, restart count 7
Nov 24 09:29:05.992: INFO: 	Container mock ready: true, restart count 7
Nov 24 09:29:05.992: INFO: webserver-7d887d45b-g8gjr started at 2022-11-24 09:07:41 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.992: INFO: 	Container httpd ready: true, restart count 7
Nov 24 09:29:05.992: INFO: metrics-server-v0.5.2-867b8754b9-lprlm started at 2022-11-24 09:01:14 +0000 UTC (0+2 container statuses recorded)
Nov 24 09:29:05.992: INFO: 	Container metrics-server ready: false, restart count 8
Nov 24 09:29:05.992: INFO: 	Container metrics-server-nanny ready: false, restart count 8
Nov 24 09:29:05.992: INFO: netserver-2 started at 2022-11-24 09:04:04 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.992: INFO: 	Container webserver ready: false, restart count 6
Nov 24 09:29:05.992: INFO: csi-mockplugin-0 started at 2022-11-24 09:02:44 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:29:05.992: INFO: 	Container csi-provisioner ready: false, restart count 5
Nov 24 09:29:05.992: INFO: 	Container driver-registrar ready: false, restart count 5
Nov 24 09:29:05.992: INFO: 	Container mock ready: false, restart count 5
Nov 24 09:29:05.992: INFO: execpodpxn7d started at 2022-11-24 09:18:55 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.992: INFO: 	Container agnhost-container ready: true, restart count 1
Nov 24 09:29:06.465: INFO: 
Latency metrics for node bootstrap-e2e-minion-group-fj34
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
  tear down framework | framework.go:193
STEP: Destroying namespace "webhook-9950" for this suite. 11/24/22 09:29:06.465

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-api-machinery] Aggregator Should be able to support the 1.17 Sample API Server using the current Aggregator [Conformance] 1m56s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sAggregator\sShould\sbe\sable\sto\ssupport\sthe\s1\.17\sSample\sAPI\sServer\susing\sthe\scurrent\sAggregator\s\[Conformance\]$'

test/e2e/framework/framework.go:241
k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc000a324b0)
	test/e2e/framework/framework.go:241 +0x96f
There were additional failures detected after the initial failure:
[PANICKED]
Test Panicked
In [AfterEach] at: /usr/local/go/src/runtime/panic.go:260

runtime error: invalid memory address or nil pointer dereference

Full Stack Trace
  k8s.io/kubernetes/test/e2e/apimachinery.cleanTest({0x0, 0x0}, 0x0?, {0x0, 0x0})
  	test/e2e/apimachinery/aggregator.go:108 +0x46
  k8s.io/kubernetes/test/e2e/apimachinery.glob..func1.1()
  	test/e2e/apimachinery/aggregator.go:69 +0x36

				[BeforeEach] [sig-api-machinery] Aggregator
  set up framework | framework.go:178
STEP: Creating a kubernetes client 11/24/22 09:42:45.065
Nov 24 09:42:45.065: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Building a namespace api object, basename aggregator 11/24/22 09:42:45.067
Nov 24 09:42:55.108: INFO: Unexpected error while creating namespace: Internal error occurred: resource quota evaluation timed out
Nov 24 09:43:07.150: INFO: Unexpected error while creating namespace: Internal error occurred: resource quota evaluation timed out
Nov 24 09:43:19.151: INFO: Unexpected error while creating namespace: Internal error occurred: resource quota evaluation timed out
Nov 24 09:43:31.151: INFO: Unexpected error while creating namespace: Internal error occurred: resource quota evaluation timed out
Nov 24 09:43:41.192: INFO: Unexpected error while creating namespace: Internal error occurred: resource quota evaluation timed out
Nov 24 09:43:41.192: INFO: Unexpected error: 
    <*errors.errorString | 0xc000289c70>: {
        s: "timed out waiting for the condition",
    }
Nov 24 09:43:41.192: FAIL: timed out waiting for the condition

Full Stack Trace
k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc000a324b0)
	test/e2e/framework/framework.go:241 +0x96f
[AfterEach] [sig-api-machinery] Aggregator
  test/e2e/apimachinery/aggregator.go:68
[AfterEach] [sig-api-machinery] Aggregator
  test/e2e/framework/node/init/init.go:32
Nov 24 09:43:41.192: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-api-machinery] Aggregator
  dump namespaces | framework.go:196
STEP: dump namespace information after failure 11/24/22 09:44:41.234
[DeferCleanup (Each)] [sig-api-machinery] Aggregator
  tear down framework | framework.go:193

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin] should be able to convert a non homogeneous list of CRs [Conformance] 5m34s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sCustomResourceConversionWebhook\s\[Privileged\:ClusterAdmin\]\sshould\sbe\sable\sto\sconvert\sa\snon\shomogeneous\slist\sof\sCRs\s\[Conformance\]$'

test/e2e/framework/framework.go:241
k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc00064e870)
	test/e2e/framework/framework.go:241 +0x96f
There were additional failures detected after the initial failure:
[PANICKED]
Test Panicked
In [AfterEach] at: /usr/local/go/src/runtime/panic.go:260

runtime error: invalid memory address or nil pointer dereference

Full Stack Trace
  k8s.io/kubernetes/test/e2e/apimachinery.cleanCRDWebhookTest({0x0, 0x0}, {0x0, 0x0})
  	test/e2e/apimachinery/crd_conversion_webhook.go:214 +0x46
  k8s.io/kubernetes/test/e2e/apimachinery.glob..func5.2()
  	test/e2e/apimachinery/crd_conversion_webhook.go:140 +0x2f

				[BeforeEach] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin]
  set up framework | framework.go:178
STEP: Creating a kubernetes client 11/24/22 09:33:15.774
Nov 24 09:33:15.775: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Building a namespace api object, basename crd-webhook 11/24/22 09:33:15.776
Nov 24 09:35:15.846: INFO: Unexpected error: 
    <*fmt.wrapError | 0xc002f8c000>: {
        msg: "wait for service account \"default\" in namespace \"crd-webhook-4015\": timed out waiting for the condition",
        err: <*errors.errorString | 0xc0001ffa30>{
            s: "timed out waiting for the condition",
        },
    }
Nov 24 09:35:15.846: FAIL: wait for service account "default" in namespace "crd-webhook-4015": timed out waiting for the condition

Full Stack Trace
k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc00064e870)
	test/e2e/framework/framework.go:241 +0x96f
[AfterEach] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin]
  test/e2e/framework/node/init/init.go:32
Nov 24 09:35:15.847: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[AfterEach] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin]
  test/e2e/apimachinery/crd_conversion_webhook.go:139
[DeferCleanup (Each)] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin]
  dump namespaces | framework.go:196
STEP: dump namespace information after failure 11/24/22 09:36:15.888
STEP: Collecting events from namespace "crd-webhook-4015". 11/24/22 09:36:15.889
STEP: Found 0 events. 11/24/22 09:36:15.93
Nov 24 09:37:15.977: INFO: unable to fetch pod debug info: Get "https://35.233.217.30/api/v1/namespaces/crd-webhook-4015/pods": stream error: stream ID 275; INTERNAL_ERROR; received from peer
Nov 24 09:37:15.977: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Nov 24 09:37:15.977: INFO: 
Nov 24 09:37:48.889: INFO: 
Logging node info for node bootstrap-e2e-master
Nov 24 09:37:48.947: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master    57b53f45-775d-4de5-a4ff-420df60cf61e 13536 0 2022-11-24 09:00:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-24 09:00:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-11-24 09:00:50 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-11-24 09:00:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-11-24 09:33:06 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-serial-1-6/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3858374656 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3596230656 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-24 09:00:50 +0000 UTC,LastTransitionTime:2022-11-24 09:00:50 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-24 09:33:06 +0000 UTC,LastTransitionTime:2022-11-24 09:00:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-24 09:33:06 +0000 UTC,LastTransitionTime:2022-11-24 09:00:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-24 09:33:06 +0000 UTC,LastTransitionTime:2022-11-24 09:00:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-24 09:33:06 +0000 UTC,LastTransitionTime:2022-11-24 09:00:54 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:35.233.217.30,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-jkns-gce-serial-1-6.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-jkns-gce-serial-1-6.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:2380dd218709b39effceaa3da78bc7d6,SystemUUID:2380dd21-8709-b39e-ffce-aa3da78bc7d6,BootID:8a5acb5e-406f-47f0-bc85-bed589236d7d,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.44+45279654db87f4,KubeProxyVersion:v1.27.0-alpha.0.44+45279654db87f4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:135160275,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:124989753,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:57659704,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:2c111f004bec24888d8cfa2a812a38fb8341350abac67dcd0ac64e709dfe389c registry.k8s.io/kas-network-proxy/proxy-server:v0.0.33],SizeBytes:22020129,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 24 09:37:48.948: INFO: 
Logging kubelet events for node bootstrap-e2e-master
Nov 24 09:37:49.003: INFO: 
Logging pods the kubelet thinks is on node bootstrap-e2e-master
Nov 24 09:37:49.183: INFO: l7-lb-controller-bootstrap-e2e-master started at 2022-11-24 09:00:07 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:37:49.183: INFO: 	Container l7-lb-controller ready: false, restart count 9
Nov 24 09:37:49.183: INFO: metadata-proxy-v0.1-dgq6b started at 2022-11-24 09:01:06 +0000 UTC (0+2 container statuses recorded)
Nov 24 09:37:49.183: INFO: 	Container metadata-proxy ready: true, restart count 0
Nov 24 09:37:49.183: INFO: 	Container prometheus-to-sd-exporter ready: true, restart count 0
Nov 24 09:37:49.183: INFO: etcd-server-events-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:37:49.183: INFO: 	Container etcd-container ready: true, restart count 4
Nov 24 09:37:49.183: INFO: etcd-server-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:37:49.183: INFO: 	Container etcd-container ready: true, restart count 6
Nov 24 09:37:49.183: INFO: konnectivity-server-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:37:49.183: INFO: 	Container konnectivity-server-container ready: true, restart count 0
Nov 24 09:37:49.183: INFO: kube-addon-manager-bootstrap-e2e-master started at 2022-11-24 09:00:06 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:37:49.183: INFO: 	Container kube-addon-manager ready: true, restart count 3
Nov 24 09:37:49.183: INFO: kube-apiserver-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:37:49.183: INFO: 	Container kube-apiserver ready: false, restart count 3
Nov 24 09:37:49.183: INFO: kube-controller-manager-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:37:49.183: INFO: 	Container kube-controller-manager ready: true, restart count 10
Nov 24 09:37:49.183: INFO: kube-scheduler-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:37:49.183: INFO: 	Container kube-scheduler ready: true, restart count 10
Nov 24 09:38:49.237: INFO: 
Logging node info for node bootstrap-e2e-minion-group-0xkq
Nov 24 09:38:49.280: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-0xkq    34eb6b8a-d427-45c3-aa67-9f7aa0a1f8a1 14040 0 2022-11-24 09:00:32 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-0xkq kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-0xkq topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-8441":"bootstrap-e2e-minion-group-0xkq"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-11-24 09:00:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}}}} } {kubelet Update v1 2022-11-24 09:00:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {node-problem-detector Update v1 2022-11-24 09:37:21 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-24 09:38:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2022-11-24 09:38:27 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-serial-1-6/us-west1-b/bootstrap-e2e-minion-group-0xkq,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-24 09:37:21 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-24 09:37:21 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-24 09:37:21 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-24 09:37:21 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-24 09:37:21 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-24 09:37:21 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-24 09:37:21 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-24 09:00:50 +0000 UTC,LastTransitionTime:2022-11-24 09:00:50 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-24 09:37:48 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-24 09:37:48 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-24 09:37:48 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-24 09:37:48 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:34.145.99.248,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-0xkq.c.k8s-jkns-gce-serial-1-6.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-0xkq.c.k8s-jkns-gce-serial-1-6.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:23bcd2ca790827437c5cec98facdba94,SystemUUID:23bcd2ca-7908-2743-7c5c-ec98facdba94,BootID:84f5ff41-fbc9-4fdb-966f-19346788bdab,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.44+45279654db87f4,KubeProxyVersion:v1.27.0-alpha.0.44+45279654db87f4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:67201224,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/debian-base@sha256:ebda8587ec0f49eb88ee3a608ef018484908cbc5aa32556a0d78356088c185d4 registry.k8s.io/debian-base:v2.0.0],SizeBytes:21093264,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-5616^f895d0cb-6bd8-11ed-82b3-fe6d40909f02 kubernetes.io/csi/csi-hostpath-ephemeral-5616^f8bc8630-6bd8-11ed-82b3-fe6d40909f02],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-5616^f8bc8630-6bd8-11ed-82b3-fe6d40909f02,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-5616^f895d0cb-6bd8-11ed-82b3-fe6d40909f02,DevicePath:,},},Config:nil,},}
Nov 24 09:38:49.282: INFO: 
Logging kubelet events for node bootstrap-e2e-minion-group-0xkq
Nov 24 09:38:49.375: INFO: 
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-0xkq
Nov 24 09:38:49.467: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-0xkq: error trying to reach service: No agent available
Nov 24 09:38:49.467: INFO: 
Logging node info for node bootstrap-e2e-minion-group-6m4q
Nov 24 09:38:49.614: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-6m4q    be4476db-4c35-4ea4-96f6-e1f0e7c12742 13969 0 2022-11-24 09:00:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-6m4q kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-6m4q topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-8753":"bootstrap-e2e-minion-group-6m4q","csi-hostpath-volume-expand-4427":"bootstrap-e2e-minion-group-6m4q","csi-mock-csi-mock-volumes-6588":"bootstrap-e2e-minion-group-6m4q"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-24 09:00:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-24 09:00:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-11-24 09:30:39 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {node-problem-detector Update v1 2022-11-24 09:37:25 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-24 09:38:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-serial-1-6/us-west1-b/bootstrap-e2e-minion-group-6m4q,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-24 09:37:25 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-24 09:37:25 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-24 09:37:25 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-24 09:37:25 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-24 09:37:25 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-24 09:37:25 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-24 09:37:25 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-24 09:00:50 +0000 UTC,LastTransitionTime:2022-11-24 09:00:50 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-24 09:38:13 +0000 UTC,LastTransitionTime:2022-11-24 09:00:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-24 09:38:13 +0000 UTC,LastTransitionTime:2022-11-24 09:00:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-24 09:38:13 +0000 UTC,LastTransitionTime:2022-11-24 09:00:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-24 09:38:13 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:35.247.58.118,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-6m4q.c.k8s-jkns-gce-serial-1-6.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-6m4q.c.k8s-jkns-gce-serial-1-6.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:7b2cc9e909d10f7df61b26e8aece9707,SystemUUID:7b2cc9e9-09d1-0f7d-f61b-26e8aece9707,BootID:64607970-cc6d-408c-9269-dff979065832,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.44+45279654db87f4,KubeProxyVersion:v1.27.0-alpha.0.44+45279654db87f4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:67201224,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 registry.k8s.io/sig-storage/snapshot-controller:v6.1.0],SizeBytes:22620891,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-7570^55118aeb-6bd7-11ed-8dba-2207550599a3 kubernetes.io/csi/csi-hostpath-ephemeral-8753^758a12fe-6bd7-11ed-b4fd-0e9a0f0cf363],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-8753^758a12fe-6bd7-11ed-b4fd-0e9a0f0cf363,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-7570^55118aeb-6bd7-11ed-8dba-2207550599a3,DevicePath:,},},Config:nil,},}
Nov 24 09:38:49.615: INFO: 
Logging kubelet events for node bootstrap-e2e-minion-group-6m4q
Nov 24 09:38:49.783: INFO: 
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-6m4q
Nov 24 09:38:49.923: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-6m4q: error trying to reach service: No agent available
Nov 24 09:38:49.923: INFO: 
Logging node info for node bootstrap-e2e-minion-group-fj34
Nov 24 09:38:50.054: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-fj34    26b0a38a-1259-4217-8b0f-bfa92e43b570 13981 0 2022-11-24 09:00:32 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-fj34 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-fj34 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-4261":"bootstrap-e2e-minion-group-fj34","csi-hostpath-ephemeral-9395":"bootstrap-e2e-minion-group-fj34","csi-hostpath-volumelimits-3035":"bootstrap-e2e-minion-group-fj34","csi-mock-csi-mock-volumes-9394":"bootstrap-e2e-minion-group-fj34"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-11-24 09:00:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kubelet Update v1 2022-11-24 09:00:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-24 09:10:50 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {node-problem-detector Update v1 2022-11-24 09:37:23 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-24 09:38:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-serial-1-6/us-west1-b/bootstrap-e2e-minion-group-fj34,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-24 09:37:23 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-24 09:37:23 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-24 09:37:23 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-24 09:37:23 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-24 09:37:23 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-24 09:37:23 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-24 09:37:23 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-24 09:00:50 +0000 UTC,LastTransitionTime:2022-11-24 09:00:50 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-24 09:38:11 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-24 09:38:11 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-24 09:38:11 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-24 09:38:11 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.82.73.153,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-fj34.c.k8s-jkns-gce-serial-1-6.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-fj34.c.k8s-jkns-gce-serial-1-6.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:557b5201a29dc5c84dc79b98af6f523a,SystemUUID:557b5201-a29d-c5c8-4dc7-9b98af6f523a,BootID:0f4289cb-5f88-4ee3-b552-b99fcc030f54,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.44+45279654db87f4,KubeProxyVersion:v1.27.0-alpha.0.44+45279654db87f4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:67201224,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:c0ddb4794bc8a3631e3373015f913c00b230ee54f87bde9ade195b3a3415c60f registry.k8s.io/build-image/distroless-iptables:v0.1.2],SizeBytes:7685585,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-1806^5a1ffb25-6bd7-11ed-9365-7e36e6fec9d2 kubernetes.io/csi/csi-mock-csi-mock-volumes-9231^cbf4a4b9-6bd6-11ed-88e7-326e345b4078],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-9231^cbf4a4b9-6bd6-11ed-88e7-326e345b4078,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-1806^5a1ffb25-6bd7-11ed-9365-7e36e6fec9d2,DevicePath:,},},Config:nil,},}
Nov 24 09:38:50.055: INFO: 
Logging kubelet events for node bootstrap-e2e-minion-group-fj34
Nov 24 09:38:50.180: INFO: 
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-fj34
Nov 24 09:38:50.295: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-fj34: error trying to reach service: No agent available
[DeferCleanup (Each)] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin]
  tear down framework | framework.go:193
STEP: Destroying namespace "crd-webhook-4015" for this suite. 11/24/22 09:38:50.295

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin] should include custom resource definition resources in discovery documents [Conformance] 1m56s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sCustomResourceDefinition\sresources\s\[Privileged\:ClusterAdmin\]\sshould\sinclude\scustom\sresource\sdefinition\sresources\sin\sdiscovery\sdocuments\s\[Conformance\]$'

test/e2e/framework/framework.go:241
k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc0011a0d20)
	test/e2e/framework/framework.go:241 +0x96f
				[BeforeEach] [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin]
  set up framework | framework.go:178
STEP: Creating a kubernetes client 11/24/22 09:42:45.053
Nov 24 09:42:45.053: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Building a namespace api object, basename custom-resource-definition 11/24/22 09:42:45.055
Nov 24 09:42:55.096: INFO: Unexpected error while creating namespace: Internal error occurred: resource quota evaluation timed out
Nov 24 09:43:07.138: INFO: Unexpected error while creating namespace: Internal error occurred: resource quota evaluation timed out
Nov 24 09:43:19.139: INFO: Unexpected error while creating namespace: Internal error occurred: resource quota evaluation timed out
Nov 24 09:43:31.139: INFO: Unexpected error while creating namespace: Internal error occurred: resource quota evaluation timed out
Nov 24 09:43:41.180: INFO: Unexpected error while creating namespace: Internal error occurred: resource quota evaluation timed out
Nov 24 09:43:41.180: INFO: Unexpected error: 
    <*errors.errorString | 0xc0001cba10>: {
        s: "timed out waiting for the condition",
    }
Nov 24 09:43:41.180: FAIL: timed out waiting for the condition

Full Stack Trace
k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc0011a0d20)
	test/e2e/framework/framework.go:241 +0x96f
[AfterEach] [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin]
  test/e2e/framework/node/init/init.go:32
Nov 24 09:43:41.180: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin]
  dump namespaces | framework.go:196
STEP: dump namespace information after failure 11/24/22 09:44:41.224
[DeferCleanup (Each)] [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin]
  tear down framework | framework.go:193

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] removes definition from spec when one version gets changed to not be served [Conformance] 2m20s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sCustomResourcePublishOpenAPI\s\[Privileged\:ClusterAdmin\]\sremoves\sdefinition\sfrom\sspec\swhen\sone\sversion\sgets\schanged\sto\snot\sbe\sserved\s\[Conformance\]$'

test/e2e/framework/framework.go:241
k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc0009fa960)
	test/e2e/framework/framework.go:241 +0x96f
				[BeforeEach] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin]
  set up framework | framework.go:178
STEP: Creating a kubernetes client 11/24/22 09:25:20.126
Nov 24 09:25:20.126: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Building a namespace api object, basename crd-publish-openapi 11/24/22 09:25:20.128
Nov 24 09:25:20.167: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:25:22.207: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:25:24.207: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:25:26.207: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:25:28.207: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:25:30.207: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:25:32.207: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:27:37.168: INFO: Unexpected error: 
    <*fmt.wrapError | 0xc003cf0000>: {
        msg: "wait for service account \"default\" in namespace \"crd-publish-openapi-8760\": timed out waiting for the condition",
        err: <*errors.errorString | 0xc000243a20>{
            s: "timed out waiting for the condition",
        },
    }
Nov 24 09:27:37.168: FAIL: wait for service account "default" in namespace "crd-publish-openapi-8760": timed out waiting for the condition

Full Stack Trace
k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc0009fa960)
	test/e2e/framework/framework.go:241 +0x96f
[AfterEach] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin]
  test/e2e/framework/node/init/init.go:32
Nov 24 09:27:37.169: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin]
  dump namespaces | framework.go:196
STEP: dump namespace information after failure 11/24/22 09:27:37.254
STEP: Collecting events from namespace "crd-publish-openapi-8760". 11/24/22 09:27:37.254
STEP: Found 0 events. 11/24/22 09:27:37.295
Nov 24 09:27:37.335: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Nov 24 09:27:37.335: INFO: 
Nov 24 09:27:37.381: INFO: 
Logging node info for node bootstrap-e2e-master
Nov 24 09:27:37.422: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master    57b53f45-775d-4de5-a4ff-420df60cf61e 12044 0 2022-11-24 09:00:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-24 09:00:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-11-24 09:00:50 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-11-24 09:00:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-11-24 09:26:48 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-serial-1-6/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3858374656 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3596230656 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-24 09:00:50 +0000 UTC,LastTransitionTime:2022-11-24 09:00:50 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-24 09:26:48 +0000 UTC,LastTransitionTime:2022-11-24 09:00:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-24 09:26:48 +0000 UTC,LastTransitionTime:2022-11-24 09:00:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-24 09:26:48 +0000 UTC,LastTransitionTime:2022-11-24 09:00:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-24 09:26:48 +0000 UTC,LastTransitionTime:2022-11-24 09:00:54 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:35.233.217.30,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-jkns-gce-serial-1-6.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-jkns-gce-serial-1-6.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:2380dd218709b39effceaa3da78bc7d6,SystemUUID:2380dd21-8709-b39e-ffce-aa3da78bc7d6,BootID:8a5acb5e-406f-47f0-bc85-bed589236d7d,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.44+45279654db87f4,KubeProxyVersion:v1.27.0-alpha.0.44+45279654db87f4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:135160275,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:124989753,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:57659704,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:2c111f004bec24888d8cfa2a812a38fb8341350abac67dcd0ac64e709dfe389c registry.k8s.io/kas-network-proxy/proxy-server:v0.0.33],SizeBytes:22020129,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 24 09:27:37.422: INFO: 
Logging kubelet events for node bootstrap-e2e-master
Nov 24 09:27:37.473: INFO: 
Logging pods the kubelet thinks is on node bootstrap-e2e-master
Nov 24 09:27:37.528: INFO: metadata-proxy-v0.1-dgq6b started at 2022-11-24 09:01:06 +0000 UTC (0+2 container statuses recorded)
Nov 24 09:27:37.528: INFO: 	Container metadata-proxy ready: true, restart count 0
Nov 24 09:27:37.528: INFO: 	Container prometheus-to-sd-exporter ready: true, restart count 0
Nov 24 09:27:37.528: INFO: etcd-server-events-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:37.528: INFO: 	Container etcd-container ready: true, restart count 3
Nov 24 09:27:37.528: INFO: etcd-server-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:37.528: INFO: 	Container etcd-container ready: true, restart count 3
Nov 24 09:27:37.528: INFO: konnectivity-server-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:37.528: INFO: 	Container konnectivity-server-container ready: true, restart count 0
Nov 24 09:27:37.528: INFO: kube-addon-manager-bootstrap-e2e-master started at 2022-11-24 09:00:06 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:37.528: INFO: 	Container kube-addon-manager ready: true, restart count 2
Nov 24 09:27:37.528: INFO: l7-lb-controller-bootstrap-e2e-master started at 2022-11-24 09:00:07 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:37.528: INFO: 	Container l7-lb-controller ready: false, restart count 7
Nov 24 09:27:37.528: INFO: kube-apiserver-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:37.528: INFO: 	Container kube-apiserver ready: true, restart count 3
Nov 24 09:27:37.528: INFO: kube-controller-manager-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:37.528: INFO: 	Container kube-controller-manager ready: false, restart count 7
Nov 24 09:27:37.528: INFO: kube-scheduler-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:37.528: INFO: 	Container kube-scheduler ready: false, restart count 7
Nov 24 09:27:38.154: INFO: 
Latency metrics for node bootstrap-e2e-master
Nov 24 09:27:38.154: INFO: 
Logging node info for node bootstrap-e2e-minion-group-0xkq
Nov 24 09:27:38.282: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-0xkq    34eb6b8a-d427-45c3-aa67-9f7aa0a1f8a1 11953 0 2022-11-24 09:00:32 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-0xkq kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-0xkq topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-5616":"bootstrap-e2e-minion-group-0xkq","csi-mock-csi-mock-volumes-4020":"bootstrap-e2e-minion-group-0xkq"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-11-24 09:00:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}}}} } {kubelet Update v1 2022-11-24 09:00:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-24 09:18:36 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {node-problem-detector Update v1 2022-11-24 09:25:39 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-24 09:25:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-serial-1-6/us-west1-b/bootstrap-e2e-minion-group-0xkq,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-24 09:25:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-24 09:25:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-24 09:25:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-24 09:25:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-24 09:25:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-24 09:25:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-24 09:25:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-24 09:00:50 +0000 UTC,LastTransitionTime:2022-11-24 09:00:50 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-24 09:24:47 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-24 09:24:47 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-24 09:24:47 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-24 09:24:47 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:34.145.99.248,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-0xkq.c.k8s-jkns-gce-serial-1-6.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-0xkq.c.k8s-jkns-gce-serial-1-6.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:23bcd2ca790827437c5cec98facdba94,SystemUUID:23bcd2ca-7908-2743-7c5c-ec98facdba94,BootID:84f5ff41-fbc9-4fdb-966f-19346788bdab,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.44+45279654db87f4,KubeProxyVersion:v1.27.0-alpha.0.44+45279654db87f4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:67201224,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/debian-base@sha256:ebda8587ec0f49eb88ee3a608ef018484908cbc5aa32556a0d78356088c185d4 registry.k8s.io/debian-base:v2.0.0],SizeBytes:21093264,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-5616^f895d0cb-6bd8-11ed-82b3-fe6d40909f02 kubernetes.io/csi/csi-hostpath-ephemeral-5616^f8bc8630-6bd8-11ed-82b3-fe6d40909f02],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-5616^f895d0cb-6bd8-11ed-82b3-fe6d40909f02,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-5616^f8bc8630-6bd8-11ed-82b3-fe6d40909f02,DevicePath:,},},Config:nil,},}
Nov 24 09:27:38.282: INFO: 
Logging kubelet events for node bootstrap-e2e-minion-group-0xkq
Nov 24 09:27:38.426: INFO: 
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-0xkq
Nov 24 09:27:38.855: INFO: pod-disruption-failure-ignore-2-m4qbn started at 2022-11-24 09:17:17 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:38.855: INFO: 	Container c ready: false, restart count 0
Nov 24 09:27:38.855: INFO: agnhost-host-aliases07dd0013-880a-43df-b65a-dd3cc866b1c6 started at 2022-11-24 09:04:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:38.855: INFO: 	Container agnhost-container ready: false, restart count 0
Nov 24 09:27:38.855: INFO: httpd-deployment-6859889f88-cjjj8 started at 2022-11-24 09:04:51 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:38.855: INFO: 	Container httpd ready: false, restart count 6
Nov 24 09:27:38.855: INFO: hostexec-bootstrap-e2e-minion-group-0xkq-gs72q started at 2022-11-24 09:06:42 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:38.855: INFO: 	Container agnhost-container ready: false, restart count 6
Nov 24 09:27:38.855: INFO: sample-webhook-deployment-865554f4d9-shnzq started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:38.855: INFO: 	Container sample-webhook ready: true, restart count 2
Nov 24 09:27:38.855: INFO: external-provisioner-s6wpd started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:38.855: INFO: 	Container nfs-provisioner ready: true, restart count 6
Nov 24 09:27:38.855: INFO: client-containers-73020471-75dc-486c-91d8-b2150c34f574 started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:38.855: INFO: 	Container agnhost-container ready: false, restart count 0
Nov 24 09:27:38.855: INFO: metadata-proxy-v0.1-jg8bk started at 2022-11-24 09:00:33 +0000 UTC (0+2 container statuses recorded)
Nov 24 09:27:38.855: INFO: 	Container metadata-proxy ready: true, restart count 0
Nov 24 09:27:38.855: INFO: 	Container prometheus-to-sd-exporter ready: true, restart count 0
Nov 24 09:27:38.855: INFO: busybox-readonly-true-0c7fd3e6-417c-4909-a077-6624310b4dfb started at 2022-11-24 09:04:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:38.855: INFO: 	Container busybox-readonly-true-0c7fd3e6-417c-4909-a077-6624310b4dfb ready: false, restart count 0
Nov 24 09:27:38.855: INFO: busybox-e4175cec-5a98-457b-8d7a-fc687790f79e started at 2022-11-24 09:04:11 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:38.855: INFO: 	Container busybox ready: false, restart count 10
Nov 24 09:27:38.855: INFO: csi-mockplugin-0 started at 2022-11-24 09:13:37 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:27:38.855: INFO: 	Container csi-provisioner ready: true, restart count 6
Nov 24 09:27:38.855: INFO: 	Container driver-registrar ready: true, restart count 6
Nov 24 09:27:38.855: INFO: 	Container mock ready: true, restart count 6
Nov 24 09:27:38.855: INFO: pod-always-succeed1ac1248a-f95d-4ec8-add5-00fdfc91f740 started at 2022-11-24 09:04:11 +0000 UTC (1+1 container statuses recorded)
Nov 24 09:27:38.855: INFO: 	Init container foo ready: true, restart count 0
Nov 24 09:27:38.855: INFO: 	Container bar ready: false, restart count 0
Nov 24 09:27:38.855: INFO: pod-disruption-failure-ignore-0-ngtgb started at 2022-11-24 09:13:53 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:38.855: INFO: 	Container c ready: false, restart count 0
Nov 24 09:27:38.855: INFO: netserver-0 started at 2022-11-24 09:04:49 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:38.855: INFO: 	Container webserver ready: false, restart count 8
Nov 24 09:27:38.855: INFO: pod-disruption-failure-ignore-0-r2g6r started at 2022-11-24 09:17:13 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:38.855: INFO: 	Container c ready: false, restart count 0
Nov 24 09:27:38.855: INFO: csi-mockplugin-0 started at 2022-11-24 09:02:44 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:27:38.855: INFO: 	Container csi-provisioner ready: false, restart count 8
Nov 24 09:27:38.855: INFO: 	Container driver-registrar ready: false, restart count 8
Nov 24 09:27:38.855: INFO: 	Container mock ready: false, restart count 8
Nov 24 09:27:38.855: INFO: hostexec-bootstrap-e2e-minion-group-0xkq-pqnxr started at 2022-11-24 09:06:47 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:38.855: INFO: 	Container agnhost-container ready: true, restart count 1
Nov 24 09:27:38.855: INFO: pod-subpath-test-preprovisionedpv-tmmr started at 2022-11-24 09:07:37 +0000 UTC (2+1 container statuses recorded)
Nov 24 09:27:38.855: INFO: 	Init container init-volume-preprovisionedpv-tmmr ready: true, restart count 0
Nov 24 09:27:38.855: INFO: 	Init container test-init-volume-preprovisionedpv-tmmr ready: true, restart count 0
Nov 24 09:27:38.855: INFO: 	Container test-container-subpath-preprovisionedpv-tmmr ready: false, restart count 0
Nov 24 09:27:38.855: INFO: pod-configmaps-e234b165-43bc-41ce-91d4-7789b97cbf1a started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:38.855: INFO: 	Container env-test ready: false, restart count 0
Nov 24 09:27:38.855: INFO: netserver-0 started at 2022-11-24 09:18:27 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:38.855: INFO: 	Container webserver ready: true, restart count 4
Nov 24 09:27:38.855: INFO: coredns-6d97d5ddb-q22hn started at 2022-11-24 09:00:58 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:38.855: INFO: 	Container coredns ready: false, restart count 9
Nov 24 09:27:38.855: INFO: external-provisioner-nzpx5 started at 2022-11-24 09:13:56 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:38.855: INFO: 	Container nfs-provisioner ready: true, restart count 2
Nov 24 09:27:38.855: INFO: test-pod-3 started at 2022-11-24 09:02:41 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:38.855: INFO: 	Container token-test ready: false, restart count 0
Nov 24 09:27:38.855: INFO: netserver-0 started at 2022-11-24 09:04:04 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:38.855: INFO: 	Container webserver ready: false, restart count 9
Nov 24 09:27:38.855: INFO: csi-hostpathplugin-0 started at 2022-11-24 09:18:27 +0000 UTC (0+7 container statuses recorded)
Nov 24 09:27:38.855: INFO: 	Container csi-attacher ready: true, restart count 2
Nov 24 09:27:38.855: INFO: 	Container csi-provisioner ready: true, restart count 2
Nov 24 09:27:38.855: INFO: 	Container csi-resizer ready: true, restart count 2
Nov 24 09:27:38.855: INFO: 	Container csi-snapshotter ready: true, restart count 2
Nov 24 09:27:38.855: INFO: 	Container hostpath ready: true, restart count 2
Nov 24 09:27:38.855: INFO: 	Container liveness-probe ready: true, restart count 2
Nov 24 09:27:38.855: INFO: 	Container node-driver-registrar ready: true, restart count 3
Nov 24 09:27:38.855: INFO: kube-proxy-bootstrap-e2e-minion-group-0xkq started at 2022-11-24 09:00:32 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:38.855: INFO: 	Container kube-proxy ready: false, restart count 8
Nov 24 09:27:38.855: INFO: konnectivity-agent-nxcws started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:38.855: INFO: 	Container konnectivity-agent ready: true, restart count 8
Nov 24 09:27:38.855: INFO: sample-webhook-deployment-865554f4d9-pngsn started at 2022-11-24 09:04:04 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:38.855: INFO: 	Container sample-webhook ready: false, restart count 9
Nov 24 09:27:38.855: INFO: alpine-nnp-false-d237a6ae-3e11-402c-9f30-27adea86549e started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:38.855: INFO: 	Container alpine-nnp-false-d237a6ae-3e11-402c-9f30-27adea86549e ready: false, restart count 0
Nov 24 09:27:38.855: INFO: pod-disruption-failure-ignore-3-d94v4 started at 2022-11-24 09:17:17 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:38.855: INFO: 	Container c ready: false, restart count 0
Nov 24 09:27:38.855: INFO: httpd started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:38.855: INFO: 	Container httpd ready: false, restart count 5
Nov 24 09:27:38.855: INFO: agnhost started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:38.855: INFO: 	Container agnhost ready: false, restart count 0
Nov 24 09:27:38.855: INFO: apparmor-loader-nf47q started at 2022-11-24 09:18:27 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:38.855: INFO: 	Container apparmor-loader ready: true, restart count 2
Nov 24 09:27:38.855: INFO: pod-secrets-6ef894cf-d4cc-4c12-a50d-3e49edaec470 started at 2022-11-24 09:07:37 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:27:38.855: INFO: 	Container creates-volume-test ready: false, restart count 0
Nov 24 09:27:38.855: INFO: 	Container dels-volume-test ready: false, restart count 0
Nov 24 09:27:38.855: INFO: 	Container upds-volume-test ready: false, restart count 0
Nov 24 09:27:38.855: INFO: external-provisioner-f4vcp started at 2022-11-24 09:13:55 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:38.855: INFO: 	Container nfs-provisioner ready: true, restart count 4
Nov 24 09:27:38.855: INFO: csi-mockplugin-attacher-0 started at 2022-11-24 09:13:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:38.855: INFO: 	Container csi-attacher ready: false, restart count 4
Nov 24 09:27:38.855: INFO: pod-disruption-failure-ignore-1-b8vdq started at 2022-11-24 09:17:13 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:38.855: INFO: 	Container c ready: false, restart count 0
Nov 24 09:27:38.855: INFO: ss2-0 started at 2022-11-24 09:18:51 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:38.855: INFO: 	Container webserver ready: true, restart count 2
Nov 24 09:27:38.855: INFO: hostexec-bootstrap-e2e-minion-group-0xkq-vtzpg started at 2022-11-24 09:18:35 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:38.855: INFO: 	Container agnhost-container ready: false, restart count 4
Nov 24 09:27:38.855: INFO: inline-volume-tester-6w8qg started at 2022-11-24 09:18:36 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:38.855: INFO: 	Container csi-volume-tester ready: false, restart count 0
Nov 24 09:27:38.855: INFO: update-demo-nautilus-827pl started at 2022-11-24 09:18:35 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:38.855: INFO: 	Container update-demo ready: true, restart count 3
Nov 24 09:27:38.855: INFO: webserver-7d887d45b-zjrtz started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:38.855: INFO: 	Container httpd ready: true, restart count 3
Nov 24 09:27:38.855: INFO: pod-subpath-test-preprovisionedpv-bchr started at 2022-11-24 09:07:37 +0000 UTC (1+1 container statuses recorded)
Nov 24 09:27:38.855: INFO: 	Init container init-volume-preprovisionedpv-bchr ready: true, restart count 0
Nov 24 09:27:38.855: INFO: 	Container test-container-subpath-preprovisionedpv-bchr ready: false, restart count 0
Nov 24 09:27:38.855: INFO: sample-webhook-deployment-865554f4d9-qhln9 started at 2022-11-24 09:04:35 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:38.855: INFO: 	Container sample-webhook ready: false, restart count 9
Nov 24 09:27:38.855: INFO: test-apparmor-k8mtn started at 2022-11-24 09:18:35 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:38.855: INFO: 	Container test ready: false, restart count 0
Nov 24 09:27:38.855: INFO: webserver-7d887d45b-b2lng started at 2022-11-24 09:10:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:38.855: INFO: 	Container httpd ready: false, restart count 6
Nov 24 09:27:38.855: INFO: service-deletion-pmnf7 started at 2022-11-24 09:13:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:38.855: INFO: 	Container service-deletion ready: true, restart count 3
Nov 24 09:27:38.855: INFO: pod-disruption-failure-ignore-1-8q4cc started at 2022-11-24 09:13:53 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:38.855: INFO: 	Container c ready: false, restart count 0
Nov 24 09:27:39.359: INFO: 
Latency metrics for node bootstrap-e2e-minion-group-0xkq
Nov 24 09:27:39.359: INFO: 
Logging node info for node bootstrap-e2e-minion-group-6m4q
Nov 24 09:27:39.417: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-6m4q    be4476db-4c35-4ea4-96f6-e1f0e7c12742 12084 0 2022-11-24 09:00:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-6m4q kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-6m4q topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-8753":"bootstrap-e2e-minion-group-6m4q"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-24 09:00:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-24 09:00:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-11-24 09:12:06 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {node-problem-detector Update v1 2022-11-24 09:25:43 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-24 09:27:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-serial-1-6/us-west1-b/bootstrap-e2e-minion-group-6m4q,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-24 09:25:43 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-24 09:25:43 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-24 09:25:43 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-24 09:25:43 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-24 09:25:43 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-24 09:25:43 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-24 09:25:43 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-24 09:00:50 +0000 UTC,LastTransitionTime:2022-11-24 09:00:50 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-24 09:24:48 +0000 UTC,LastTransitionTime:2022-11-24 09:00:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-24 09:24:48 +0000 UTC,LastTransitionTime:2022-11-24 09:00:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-24 09:24:48 +0000 UTC,LastTransitionTime:2022-11-24 09:00:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-24 09:24:48 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:35.247.58.118,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-6m4q.c.k8s-jkns-gce-serial-1-6.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-6m4q.c.k8s-jkns-gce-serial-1-6.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:7b2cc9e909d10f7df61b26e8aece9707,SystemUUID:7b2cc9e9-09d1-0f7d-f61b-26e8aece9707,BootID:64607970-cc6d-408c-9269-dff979065832,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.44+45279654db87f4,KubeProxyVersion:v1.27.0-alpha.0.44+45279654db87f4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:67201224,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 registry.k8s.io/sig-storage/snapshot-controller:v6.1.0],SizeBytes:22620891,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-7570^55118aeb-6bd7-11ed-8dba-2207550599a3 kubernetes.io/csi/csi-hostpath-ephemeral-8753^758a12fe-6bd7-11ed-b4fd-0e9a0f0cf363],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-7570^55118aeb-6bd7-11ed-8dba-2207550599a3,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-8753^758a12fe-6bd7-11ed-b4fd-0e9a0f0cf363,DevicePath:,},},Config:nil,},}
Nov 24 09:27:39.418: INFO: 
Logging kubelet events for node bootstrap-e2e-minion-group-6m4q
Nov 24 09:27:39.473: INFO: 
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-6m4q
Nov 24 09:27:39.767: INFO: httpd-deployment-6859889f88-22w25 started at 2022-11-24 09:04:51 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.767: INFO: 	Container httpd ready: true, restart count 6
Nov 24 09:27:39.767: INFO: my-hostname-private-ae51c3f4-8897-433b-b3ed-7b3c0ce69bc4-9dsrv started at 2022-11-24 09:18:27 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.767: INFO: 	Container my-hostname-private-ae51c3f4-8897-433b-b3ed-7b3c0ce69bc4 ready: true, restart count 4
Nov 24 09:27:39.767: INFO: webserver-pod started at 2022-11-24 09:04:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.767: INFO: 	Container agnhost ready: false, restart count 4
Nov 24 09:27:39.767: INFO: l7-default-backend-8549d69d99-762zc started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.767: INFO: 	Container default-http-backend ready: true, restart count 0
Nov 24 09:27:39.767: INFO: konnectivity-agent-k4jdw started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.767: INFO: 	Container konnectivity-agent ready: false, restart count 7
Nov 24 09:27:39.767: INFO: pod-client started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.767: INFO: 	Container pod-client ready: true, restart count 4
Nov 24 09:27:39.767: INFO: metadata-proxy-v0.1-lwtk4 started at 2022-11-24 09:00:35 +0000 UTC (0+2 container statuses recorded)
Nov 24 09:27:39.767: INFO: 	Container metadata-proxy ready: true, restart count 0
Nov 24 09:27:39.767: INFO: 	Container prometheus-to-sd-exporter ready: true, restart count 0
Nov 24 09:27:39.767: INFO: kube-dns-autoscaler-5f6455f985-hxtg5 started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.767: INFO: 	Container autoscaler ready: false, restart count 8
Nov 24 09:27:39.767: INFO: pod-configmaps-6929437e-13e1-4a93-b7fa-e8ec8d7c7138 started at 2022-11-24 09:04:04 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:27:39.767: INFO: 	Container createcm-volume-test ready: false, restart count 0
Nov 24 09:27:39.767: INFO: 	Container delcm-volume-test ready: false, restart count 0
Nov 24 09:27:39.767: INFO: 	Container updcm-volume-test ready: false, restart count 0
Nov 24 09:27:39.767: INFO: inline-volume-tester-rr76m started at 2022-11-24 09:07:45 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.767: INFO: 	Container csi-volume-tester ready: false, restart count 0
Nov 24 09:27:39.767: INFO: netserver-1 started at 2022-11-24 09:04:49 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.767: INFO: 	Container webserver ready: true, restart count 8
Nov 24 09:27:39.767: INFO: inline-volume-tester-vc928 started at 2022-11-24 09:07:38 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.767: INFO: 	Container csi-volume-tester ready: false, restart count 0
Nov 24 09:27:39.767: INFO: pod-subpath-test-secret-56vz started at 2022-11-24 09:04:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.767: INFO: 	Container test-container-subpath-secret-56vz ready: false, restart count 0
Nov 24 09:27:39.767: INFO: csi-mockplugin-0 started at 2022-11-24 09:06:45 +0000 UTC (0+4 container statuses recorded)
Nov 24 09:27:39.767: INFO: 	Container busybox ready: false, restart count 5
Nov 24 09:27:39.767: INFO: 	Container csi-provisioner ready: false, restart count 6
Nov 24 09:27:39.767: INFO: 	Container driver-registrar ready: false, restart count 6
Nov 24 09:27:39.767: INFO: 	Container mock ready: false, restart count 6
Nov 24 09:27:39.767: INFO: hostexec-bootstrap-e2e-minion-group-6m4q-h8v54 started at 2022-11-24 09:04:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.767: INFO: 	Container agnhost-container ready: false, restart count 6
Nov 24 09:27:39.767: INFO: liveness-285ed85f-af70-4221-a9ae-9d3784882e9c started at 2022-11-24 09:06:27 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.767: INFO: 	Container agnhost-container ready: false, restart count 2
Nov 24 09:27:39.767: INFO: coredns-6d97d5ddb-9z7tn started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.767: INFO: 	Container coredns ready: false, restart count 9
Nov 24 09:27:39.767: INFO: volume-snapshot-controller-0 started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.767: INFO: 	Container volume-snapshot-controller ready: false, restart count 6
Nov 24 09:27:39.767: INFO: ss2-2 started at 2022-11-24 09:18:27 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.767: INFO: 	Container webserver ready: false, restart count 2
Nov 24 09:27:39.767: INFO: pod-0 started at 2022-11-24 09:04:46 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.767: INFO: 	Container donothing ready: true, restart count 5
Nov 24 09:27:39.767: INFO: netserver-1 started at 2022-11-24 09:18:27 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.767: INFO: 	Container webserver ready: false, restart count 6
Nov 24 09:27:39.767: INFO: csi-hostpathplugin-0 started at 2022-11-24 09:06:47 +0000 UTC (0+7 container statuses recorded)
Nov 24 09:27:39.767: INFO: 	Container csi-attacher ready: false, restart count 7
Nov 24 09:27:39.767: INFO: 	Container csi-provisioner ready: false, restart count 7
Nov 24 09:27:39.767: INFO: 	Container csi-resizer ready: false, restart count 7
Nov 24 09:27:39.767: INFO: 	Container csi-snapshotter ready: false, restart count 7
Nov 24 09:27:39.767: INFO: 	Container hostpath ready: false, restart count 7
Nov 24 09:27:39.767: INFO: 	Container liveness-probe ready: false, restart count 7
Nov 24 09:27:39.767: INFO: 	Container node-driver-registrar ready: false, restart count 7
Nov 24 09:27:39.767: INFO: csi-hostpathplugin-0 started at 2022-11-24 09:07:37 +0000 UTC (0+7 container statuses recorded)
Nov 24 09:27:39.767: INFO: 	Container csi-attacher ready: true, restart count 8
Nov 24 09:27:39.767: INFO: 	Container csi-provisioner ready: true, restart count 8
Nov 24 09:27:39.767: INFO: 	Container csi-resizer ready: true, restart count 8
Nov 24 09:27:39.767: INFO: 	Container csi-snapshotter ready: true, restart count 8
Nov 24 09:27:39.767: INFO: 	Container hostpath ready: true, restart count 8
Nov 24 09:27:39.767: INFO: 	Container liveness-probe ready: true, restart count 8
Nov 24 09:27:39.767: INFO: 	Container node-driver-registrar ready: true, restart count 7
Nov 24 09:27:39.767: INFO: pvc-volume-tester-8w74v started at 2022-11-24 09:07:38 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.767: INFO: 	Container volume-tester ready: false, restart count 0
Nov 24 09:27:39.767: INFO: webserver-7d887d45b-lr79x started at 2022-11-24 09:07:41 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.767: INFO: 	Container httpd ready: true, restart count 7
Nov 24 09:27:39.767: INFO: kube-proxy-bootstrap-e2e-minion-group-6m4q started at 2022-11-24 09:00:35 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.767: INFO: 	Container kube-proxy ready: true, restart count 8
Nov 24 09:27:39.767: INFO: netserver-1 started at 2022-11-24 09:04:04 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.767: INFO: 	Container webserver ready: false, restart count 8
Nov 24 09:27:39.767: INFO: inline-volume-tester-2k2tt started at 2022-11-24 09:18:27 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.767: INFO: 	Container csi-volume-tester ready: false, restart count 0
Nov 24 09:27:40.202: INFO: 
Latency metrics for node bootstrap-e2e-minion-group-6m4q
Nov 24 09:27:40.202: INFO: 
Logging node info for node bootstrap-e2e-minion-group-fj34
Nov 24 09:27:40.243: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-fj34    26b0a38a-1259-4217-8b0f-bfa92e43b570 12120 0 2022-11-24 09:00:32 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-fj34 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-fj34 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-4261":"bootstrap-e2e-minion-group-fj34","csi-hostpath-ephemeral-7265":"bootstrap-e2e-minion-group-fj34","csi-mock-csi-mock-volumes-1806":"bootstrap-e2e-minion-group-fj34","csi-mock-csi-mock-volumes-9231":"bootstrap-e2e-minion-group-fj34"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-11-24 09:00:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kubelet Update v1 2022-11-24 09:00:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-24 09:10:50 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {node-problem-detector Update v1 2022-11-24 09:25:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-24 09:27:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-serial-1-6/us-west1-b/bootstrap-e2e-minion-group-fj34,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-24 09:25:40 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-24 09:25:40 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-24 09:25:40 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-24 09:25:40 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-24 09:25:40 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-24 09:25:40 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-24 09:25:40 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-24 09:00:50 +0000 UTC,LastTransitionTime:2022-11-24 09:00:50 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-24 09:24:47 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-24 09:24:47 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-24 09:24:47 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-24 09:24:47 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.82.73.153,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-fj34.c.k8s-jkns-gce-serial-1-6.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-fj34.c.k8s-jkns-gce-serial-1-6.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:557b5201a29dc5c84dc79b98af6f523a,SystemUUID:557b5201-a29d-c5c8-4dc7-9b98af6f523a,BootID:0f4289cb-5f88-4ee3-b552-b99fcc030f54,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.44+45279654db87f4,KubeProxyVersion:v1.27.0-alpha.0.44+45279654db87f4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:67201224,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:c0ddb4794bc8a3631e3373015f913c00b230ee54f87bde9ade195b3a3415c60f registry.k8s.io/build-image/distroless-iptables:v0.1.2],SizeBytes:7685585,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-1806^5a1ffb25-6bd7-11ed-9365-7e36e6fec9d2 kubernetes.io/csi/csi-mock-csi-mock-volumes-9231^cbf4a4b9-6bd6-11ed-88e7-326e345b4078],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-9231^cbf4a4b9-6bd6-11ed-88e7-326e345b4078,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-1806^5a1ffb25-6bd7-11ed-9365-7e36e6fec9d2,DevicePath:,},},Config:nil,},}
Nov 24 09:27:40.244: INFO: 
Logging kubelet events for node bootstrap-e2e-minion-group-fj34
Nov 24 09:27:40.292: INFO: 
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-fj34
Nov 24 09:27:40.409: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-fj34: error trying to reach service: EOF
[DeferCleanup (Each)] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin]
  tear down framework | framework.go:193
STEP: Destroying namespace "crd-publish-openapi-8760" for this suite. 11/24/22 09:27:40.409

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] works for CRD preserving unknown fields in an embedded object [Conformance] 30s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sCustomResourcePublishOpenAPI\s\[Privileged\:ClusterAdmin\]\sworks\sfor\sCRD\spreserving\sunknown\sfields\sin\san\sembedded\sobject\s\[Conformance\]$'

test/e2e/framework/framework.go:241
k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc001165950)
	test/e2e/framework/framework.go:241 +0x96f
				[BeforeEach] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin]
  set up framework | framework.go:178
STEP: Creating a kubernetes client 11/24/22 09:04:54.238
Nov 24 09:04:54.238: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Building a namespace api object, basename crd-publish-openapi 11/24/22 09:04:54.24
Nov 24 09:04:54.279: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:04:56.318: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:04:58.318: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:05:00.318: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:05:02.319: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:05:04.318: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:05:06.318: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:05:08.318: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:05:10.319: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:05:12.319: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:05:14.318: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:05:16.318: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:05:18.318: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:05:20.319: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:05:22.319: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:05:24.319: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:05:24.358: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:05:24.358: INFO: Unexpected error: 
    <*errors.errorString | 0xc000201c70>: {
        s: "timed out waiting for the condition",
    }
Nov 24 09:05:24.358: FAIL: timed out waiting for the condition

Full Stack Trace
k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc001165950)
	test/e2e/framework/framework.go:241 +0x96f
[AfterEach] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin]
  test/e2e/framework/node/init/init.go:32
Nov 24 09:05:24.358: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin]
  dump namespaces | framework.go:196
STEP: dump namespace information after failure 11/24/22 09:05:24.398
[DeferCleanup (Each)] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin]
  tear down framework | framework.go:193

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] works for multiple CRDs of different groups [Conformance] 30s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sCustomResourcePublishOpenAPI\s\[Privileged\:ClusterAdmin\]\sworks\sfor\smultiple\sCRDs\sof\sdifferent\sgroups\s\[Conformance\]$'

test/e2e/framework/framework.go:241
k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc000152960)
	test/e2e/framework/framework.go:241 +0x96f
				[BeforeEach] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin]
  set up framework | framework.go:178
STEP: Creating a kubernetes client 11/24/22 09:07:55.492
Nov 24 09:07:55.492: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Building a namespace api object, basename crd-publish-openapi 11/24/22 09:07:55.494
Nov 24 09:07:55.534: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:07:57.574: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:07:59.573: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:08:01.574: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:08:03.573: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:08:05.573: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:08:07.573: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:08:09.573: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:08:11.573: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:08:13.574: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:08:15.573: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:08:17.574: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:08:19.574: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:08:21.573: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:08:23.573: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:08:25.573: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:08:25.612: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:08:25.612: INFO: Unexpected error: 
    <*errors.errorString | 0xc0001ffa50>: {
        s: "timed out waiting for the condition",
    }
Nov 24 09:08:25.613: FAIL: timed out waiting for the condition

Full Stack Trace
k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc000152960)
	test/e2e/framework/framework.go:241 +0x96f
[AfterEach] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin]
  test/e2e/framework/node/init/init.go:32
Nov 24 09:08:25.613: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin]
  dump namespaces | framework.go:196
STEP: dump namespace information after failure 11/24/22 09:08:25.652
[DeferCleanup (Each)] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin]
  tear down framework | framework.go:193

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-api-machinery] CustomResourceValidationRules [Privileged:ClusterAdmin] MUST NOT fail validation for create of a custom resource that satisfies the x-kubernetes-validations rules 1m56s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sCustomResourceValidationRules\s\[Privileged\:ClusterAdmin\]\sMUST\sNOT\sfail\svalidation\sfor\screate\sof\sa\scustom\sresource\sthat\ssatisfies\sthe\sx\-kubernetes\-validations\srules$'

test/e2e/framework/framework.go:241
k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc000a32a50)
	test/e2e/framework/framework.go:241 +0x96f
				[BeforeEach] [sig-api-machinery] CustomResourceValidationRules [Privileged:ClusterAdmin]
  set up framework | framework.go:178
STEP: Creating a kubernetes client 11/24/22 09:38:52.663
Nov 24 09:38:52.663: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Building a namespace api object, basename crd-validation-expressions 11/24/22 09:38:52.665
Nov 24 09:39:02.723: INFO: Unexpected error while creating namespace: Internal error occurred: resource quota evaluation timed out
Nov 24 09:39:14.767: INFO: Unexpected error while creating namespace: Internal error occurred: resource quota evaluation timed out
Nov 24 09:39:26.799: INFO: Unexpected error while creating namespace: Internal error occurred: resource quota evaluation timed out
Nov 24 09:39:38.771: INFO: Unexpected error while creating namespace: Internal error occurred: resource quota evaluation timed out
Nov 24 09:39:48.813: INFO: Unexpected error while creating namespace: Internal error occurred: resource quota evaluation timed out
Nov 24 09:39:48.813: INFO: Unexpected error: 
    <*errors.errorString | 0xc000289c70>: {
        s: "timed out waiting for the condition",
    }
Nov 24 09:39:48.813: FAIL: timed out waiting for the condition

Full Stack Trace
k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc000a32a50)
	test/e2e/framework/framework.go:241 +0x96f
[AfterEach] [sig-api-machinery] CustomResourceValidationRules [Privileged:ClusterAdmin]
  test/e2e/framework/node/init/init.go:32
Nov 24 09:39:48.813: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-api-machinery] CustomResourceValidationRules [Privileged:ClusterAdmin]
  dump namespaces | framework.go:196
STEP: dump namespace information after failure 11/24/22 09:40:48.859
[DeferCleanup (Each)] [sig-api-machinery] CustomResourceValidationRules [Privileged:ClusterAdmin]
  tear down framework | framework.go:193

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-api-machinery] CustomResourceValidationRules [Privileged:ClusterAdmin] MUST fail create of a custom resource definition that contains a x-kubernetes-validations rule that refers to a property that do not exist 2m16s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sCustomResourceValidationRules\s\[Privileged\:ClusterAdmin\]\sMUST\sfail\screate\sof\sa\scustom\sresource\sdefinition\sthat\scontains\sa\sx\-kubernetes\-validations\srule\sthat\srefers\sto\sa\sproperty\sthat\sdo\snot\sexist$'

test/e2e/framework/framework.go:241
k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc000df6a50)
	test/e2e/framework/framework.go:241 +0x96f
				[BeforeEach] [sig-api-machinery] CustomResourceValidationRules [Privileged:ClusterAdmin]
  set up framework | framework.go:178
STEP: Creating a kubernetes client 11/24/22 09:26:50.58
Nov 24 09:26:50.580: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Building a namespace api object, basename crd-validation-expressions 11/24/22 09:26:50.582
Nov 24 09:28:50.669: INFO: Unexpected error: 
    <*fmt.wrapError | 0xc0014001a0>: {
        msg: "wait for service account \"default\" in namespace \"crd-validation-expressions-8806\": timed out waiting for the condition",
        err: <*errors.errorString | 0xc000289c50>{
            s: "timed out waiting for the condition",
        },
    }
Nov 24 09:28:50.669: FAIL: wait for service account "default" in namespace "crd-validation-expressions-8806": timed out waiting for the condition

Full Stack Trace
k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc000df6a50)
	test/e2e/framework/framework.go:241 +0x96f
[AfterEach] [sig-api-machinery] CustomResourceValidationRules [Privileged:ClusterAdmin]
  test/e2e/framework/node/init/init.go:32
Nov 24 09:28:50.670: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-api-machinery] CustomResourceValidationRules [Privileged:ClusterAdmin]
  dump namespaces | framework.go:196
STEP: dump namespace information after failure 11/24/22 09:29:01.348
STEP: Collecting events from namespace "crd-validation-expressions-8806". 11/24/22 09:29:01.348
STEP: Found 0 events. 11/24/22 09:29:01.392
Nov 24 09:29:02.932: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Nov 24 09:29:02.932: INFO: 
Nov 24 09:29:03.012: INFO: 
Logging node info for node bootstrap-e2e-master
Nov 24 09:29:03.076: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master    57b53f45-775d-4de5-a4ff-420df60cf61e 12044 0 2022-11-24 09:00:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-24 09:00:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-11-24 09:00:50 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-11-24 09:00:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-11-24 09:26:48 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-serial-1-6/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3858374656 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3596230656 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-24 09:00:50 +0000 UTC,LastTransitionTime:2022-11-24 09:00:50 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-24 09:26:48 +0000 UTC,LastTransitionTime:2022-11-24 09:00:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-24 09:26:48 +0000 UTC,LastTransitionTime:2022-11-24 09:00:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-24 09:26:48 +0000 UTC,LastTransitionTime:2022-11-24 09:00:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-24 09:26:48 +0000 UTC,LastTransitionTime:2022-11-24 09:00:54 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:35.233.217.30,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-jkns-gce-serial-1-6.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-jkns-gce-serial-1-6.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:2380dd218709b39effceaa3da78bc7d6,SystemUUID:2380dd21-8709-b39e-ffce-aa3da78bc7d6,BootID:8a5acb5e-406f-47f0-bc85-bed589236d7d,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.44+45279654db87f4,KubeProxyVersion:v1.27.0-alpha.0.44+45279654db87f4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:135160275,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:124989753,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:57659704,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:2c111f004bec24888d8cfa2a812a38fb8341350abac67dcd0ac64e709dfe389c registry.k8s.io/kas-network-proxy/proxy-server:v0.0.33],SizeBytes:22020129,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 24 09:29:03.076: INFO: 
Logging kubelet events for node bootstrap-e2e-master
Nov 24 09:29:03.200: INFO: 
Logging pods the kubelet thinks is on node bootstrap-e2e-master
Nov 24 09:29:03.399: INFO: kube-apiserver-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:03.399: INFO: 	Container kube-apiserver ready: false, restart count 3
Nov 24 09:29:03.399: INFO: kube-controller-manager-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:03.399: INFO: 	Container kube-controller-manager ready: false, restart count 7
Nov 24 09:29:03.399: INFO: kube-scheduler-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:03.399: INFO: 	Container kube-scheduler ready: false, restart count 7
Nov 24 09:29:03.399: INFO: etcd-server-events-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:03.399: INFO: 	Container etcd-container ready: true, restart count 3
Nov 24 09:29:03.399: INFO: etcd-server-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:03.399: INFO: 	Container etcd-container ready: true, restart count 4
Nov 24 09:29:03.399: INFO: konnectivity-server-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:03.399: INFO: 	Container konnectivity-server-container ready: true, restart count 0
Nov 24 09:29:03.399: INFO: kube-addon-manager-bootstrap-e2e-master started at 2022-11-24 09:00:06 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:03.399: INFO: 	Container kube-addon-manager ready: true, restart count 2
Nov 24 09:29:03.399: INFO: l7-lb-controller-bootstrap-e2e-master started at 2022-11-24 09:00:07 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:03.399: INFO: 	Container l7-lb-controller ready: false, restart count 7
Nov 24 09:29:03.399: INFO: metadata-proxy-v0.1-dgq6b started at 2022-11-24 09:01:06 +0000 UTC (0+2 container statuses recorded)
Nov 24 09:29:03.399: INFO: 	Container metadata-proxy ready: true, restart count 0
Nov 24 09:29:03.399: INFO: 	Container prometheus-to-sd-exporter ready: true, restart count 0
Nov 24 09:29:04.180: INFO: 
Latency metrics for node bootstrap-e2e-master
Nov 24 09:29:04.180: INFO: 
Logging node info for node bootstrap-e2e-minion-group-0xkq
Nov 24 09:29:04.310: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-0xkq    34eb6b8a-d427-45c3-aa67-9f7aa0a1f8a1 12219 0 2022-11-24 09:00:32 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-0xkq kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-0xkq topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-4020":"bootstrap-e2e-minion-group-0xkq"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-11-24 09:00:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}}}} } {kubelet Update v1 2022-11-24 09:00:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-24 09:18:36 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {node-problem-detector Update v1 2022-11-24 09:25:39 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-24 09:29:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-serial-1-6/us-west1-b/bootstrap-e2e-minion-group-0xkq,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-24 09:25:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-24 09:25:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-24 09:25:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-24 09:25:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-24 09:25:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-24 09:25:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-24 09:25:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-24 09:00:50 +0000 UTC,LastTransitionTime:2022-11-24 09:00:50 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-24 09:24:47 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-24 09:24:47 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-24 09:24:47 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-24 09:24:47 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:34.145.99.248,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-0xkq.c.k8s-jkns-gce-serial-1-6.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-0xkq.c.k8s-jkns-gce-serial-1-6.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:23bcd2ca790827437c5cec98facdba94,SystemUUID:23bcd2ca-7908-2743-7c5c-ec98facdba94,BootID:84f5ff41-fbc9-4fdb-966f-19346788bdab,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.44+45279654db87f4,KubeProxyVersion:v1.27.0-alpha.0.44+45279654db87f4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:67201224,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/debian-base@sha256:ebda8587ec0f49eb88ee3a608ef018484908cbc5aa32556a0d78356088c185d4 registry.k8s.io/debian-base:v2.0.0],SizeBytes:21093264,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-5616^f895d0cb-6bd8-11ed-82b3-fe6d40909f02 kubernetes.io/csi/csi-hostpath-ephemeral-5616^f8bc8630-6bd8-11ed-82b3-fe6d40909f02],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-5616^f895d0cb-6bd8-11ed-82b3-fe6d40909f02,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-5616^f8bc8630-6bd8-11ed-82b3-fe6d40909f02,DevicePath:,},},Config:nil,},}
Nov 24 09:29:04.310: INFO: 
Logging kubelet events for node bootstrap-e2e-minion-group-0xkq
Nov 24 09:29:04.407: INFO: 
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-0xkq
Nov 24 09:29:04.884: INFO: pod-disruption-failure-ignore-1-b8vdq started at 2022-11-24 09:17:13 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.884: INFO: 	Container c ready: false, restart count 0
Nov 24 09:29:04.884: INFO: ss2-0 started at 2022-11-24 09:18:51 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.884: INFO: 	Container webserver ready: true, restart count 2
Nov 24 09:29:04.884: INFO: hostexec-bootstrap-e2e-minion-group-0xkq-vtzpg started at 2022-11-24 09:18:35 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.884: INFO: 	Container agnhost-container ready: false, restart count 4
Nov 24 09:29:04.884: INFO: inline-volume-tester-6w8qg started at 2022-11-24 09:18:36 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.884: INFO: 	Container csi-volume-tester ready: false, restart count 0
Nov 24 09:29:04.884: INFO: pod-secrets-6ef894cf-d4cc-4c12-a50d-3e49edaec470 started at 2022-11-24 09:07:37 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:29:04.884: INFO: 	Container creates-volume-test ready: false, restart count 0
Nov 24 09:29:04.884: INFO: 	Container dels-volume-test ready: false, restart count 0
Nov 24 09:29:04.884: INFO: 	Container upds-volume-test ready: false, restart count 0
Nov 24 09:29:04.884: INFO: csi-mockplugin-attacher-0 started at 2022-11-24 09:13:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.884: INFO: 	Container csi-attacher ready: true, restart count 5
Nov 24 09:29:04.884: INFO: test-apparmor-k8mtn started at 2022-11-24 09:18:35 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.884: INFO: 	Container test ready: false, restart count 0
Nov 24 09:29:04.884: INFO: webserver-7d887d45b-b2lng started at 2022-11-24 09:10:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.884: INFO: 	Container httpd ready: true, restart count 7
Nov 24 09:29:04.884: INFO: service-deletion-pmnf7 started at 2022-11-24 09:13:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.884: INFO: 	Container service-deletion ready: false, restart count 3
Nov 24 09:29:04.884: INFO: pod-disruption-failure-ignore-1-8q4cc started at 2022-11-24 09:13:53 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.884: INFO: 	Container c ready: false, restart count 0
Nov 24 09:29:04.884: INFO: update-demo-nautilus-827pl started at 2022-11-24 09:18:35 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.884: INFO: 	Container update-demo ready: false, restart count 3
Nov 24 09:29:04.884: INFO: webserver-7d887d45b-zjrtz started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.884: INFO: 	Container httpd ready: true, restart count 3
Nov 24 09:29:04.884: INFO: pod-subpath-test-preprovisionedpv-bchr started at 2022-11-24 09:07:37 +0000 UTC (1+1 container statuses recorded)
Nov 24 09:29:04.884: INFO: 	Init container init-volume-preprovisionedpv-bchr ready: true, restart count 0
Nov 24 09:29:04.884: INFO: 	Container test-container-subpath-preprovisionedpv-bchr ready: false, restart count 0
Nov 24 09:29:04.884: INFO: sample-webhook-deployment-865554f4d9-qhln9 started at 2022-11-24 09:04:35 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.884: INFO: 	Container sample-webhook ready: true, restart count 10
Nov 24 09:29:04.884: INFO: sample-webhook-deployment-865554f4d9-shnzq started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.884: INFO: 	Container sample-webhook ready: true, restart count 2
Nov 24 09:29:04.884: INFO: external-provisioner-s6wpd started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.884: INFO: 	Container nfs-provisioner ready: true, restart count 8
Nov 24 09:29:04.884: INFO: client-containers-73020471-75dc-486c-91d8-b2150c34f574 started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.884: INFO: 	Container agnhost-container ready: false, restart count 0
Nov 24 09:29:04.884: INFO: pod-disruption-failure-ignore-2-m4qbn started at 2022-11-24 09:17:17 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.884: INFO: 	Container c ready: false, restart count 0
Nov 24 09:29:04.884: INFO: agnhost-host-aliases07dd0013-880a-43df-b65a-dd3cc866b1c6 started at 2022-11-24 09:04:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.884: INFO: 	Container agnhost-container ready: false, restart count 0
Nov 24 09:29:04.884: INFO: httpd-deployment-6859889f88-cjjj8 started at 2022-11-24 09:04:51 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.884: INFO: 	Container httpd ready: false, restart count 6
Nov 24 09:29:04.884: INFO: hostexec-bootstrap-e2e-minion-group-0xkq-gs72q started at 2022-11-24 09:06:42 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.884: INFO: 	Container agnhost-container ready: false, restart count 6
Nov 24 09:29:04.884: INFO: csi-mockplugin-0 started at 2022-11-24 09:13:37 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:29:04.884: INFO: 	Container csi-provisioner ready: true, restart count 6
Nov 24 09:29:04.884: INFO: 	Container driver-registrar ready: true, restart count 6
Nov 24 09:29:04.884: INFO: 	Container mock ready: true, restart count 6
Nov 24 09:29:04.884: INFO: pod-always-succeed1ac1248a-f95d-4ec8-add5-00fdfc91f740 started at 2022-11-24 09:04:11 +0000 UTC (1+1 container statuses recorded)
Nov 24 09:29:04.884: INFO: 	Init container foo ready: true, restart count 0
Nov 24 09:29:04.884: INFO: 	Container bar ready: false, restart count 0
Nov 24 09:29:04.884: INFO: metadata-proxy-v0.1-jg8bk started at 2022-11-24 09:00:33 +0000 UTC (0+2 container statuses recorded)
Nov 24 09:29:04.884: INFO: 	Container metadata-proxy ready: true, restart count 0
Nov 24 09:29:04.884: INFO: 	Container prometheus-to-sd-exporter ready: true, restart count 0
Nov 24 09:29:04.884: INFO: busybox-readonly-true-0c7fd3e6-417c-4909-a077-6624310b4dfb started at 2022-11-24 09:04:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.884: INFO: 	Container busybox-readonly-true-0c7fd3e6-417c-4909-a077-6624310b4dfb ready: false, restart count 0
Nov 24 09:29:04.884: INFO: busybox-e4175cec-5a98-457b-8d7a-fc687790f79e started at 2022-11-24 09:04:11 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.884: INFO: 	Container busybox ready: false, restart count 10
Nov 24 09:29:04.884: INFO: pod-disruption-failure-ignore-0-ngtgb started at 2022-11-24 09:13:53 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.884: INFO: 	Container c ready: false, restart count 0
Nov 24 09:29:04.884: INFO: hostexec-bootstrap-e2e-minion-group-0xkq-pqnxr started at 2022-11-24 09:06:47 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.884: INFO: 	Container agnhost-container ready: true, restart count 1
Nov 24 09:29:04.884: INFO: pod-subpath-test-preprovisionedpv-tmmr started at 2022-11-24 09:07:37 +0000 UTC (2+1 container statuses recorded)
Nov 24 09:29:04.884: INFO: 	Init container init-volume-preprovisionedpv-tmmr ready: true, restart count 0
Nov 24 09:29:04.884: INFO: 	Init container test-init-volume-preprovisionedpv-tmmr ready: true, restart count 0
Nov 24 09:29:04.884: INFO: 	Container test-container-subpath-preprovisionedpv-tmmr ready: false, restart count 0
Nov 24 09:29:04.884: INFO: pod-configmaps-e234b165-43bc-41ce-91d4-7789b97cbf1a started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.884: INFO: 	Container env-test ready: false, restart count 0
Nov 24 09:29:04.884: INFO: netserver-0 started at 2022-11-24 09:18:27 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.884: INFO: 	Container webserver ready: true, restart count 4
Nov 24 09:29:04.884: INFO: netserver-0 started at 2022-11-24 09:04:49 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.884: INFO: 	Container webserver ready: false, restart count 8
Nov 24 09:29:04.884: INFO: pod-disruption-failure-ignore-0-r2g6r started at 2022-11-24 09:17:13 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.884: INFO: 	Container c ready: false, restart count 0
Nov 24 09:29:04.884: INFO: csi-mockplugin-0 started at 2022-11-24 09:02:44 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:29:04.884: INFO: 	Container csi-provisioner ready: false, restart count 8
Nov 24 09:29:04.884: INFO: 	Container driver-registrar ready: false, restart count 8
Nov 24 09:29:04.884: INFO: 	Container mock ready: false, restart count 8
Nov 24 09:29:04.884: INFO: netserver-0 started at 2022-11-24 09:04:04 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.884: INFO: 	Container webserver ready: false, restart count 9
Nov 24 09:29:04.884: INFO: coredns-6d97d5ddb-q22hn started at 2022-11-24 09:00:58 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.884: INFO: 	Container coredns ready: false, restart count 9
Nov 24 09:29:04.884: INFO: test-pod-3 started at 2022-11-24 09:02:41 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.884: INFO: 	Container token-test ready: false, restart count 0
Nov 24 09:29:04.884: INFO: alpine-nnp-false-d237a6ae-3e11-402c-9f30-27adea86549e started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.884: INFO: 	Container alpine-nnp-false-d237a6ae-3e11-402c-9f30-27adea86549e ready: false, restart count 0
Nov 24 09:29:04.884: INFO: pod-disruption-failure-ignore-3-d94v4 started at 2022-11-24 09:17:17 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.884: INFO: 	Container c ready: false, restart count 0
Nov 24 09:29:04.884: INFO: csi-hostpathplugin-0 started at 2022-11-24 09:18:27 +0000 UTC (0+7 container statuses recorded)
Nov 24 09:29:04.884: INFO: 	Container csi-attacher ready: false, restart count 2
Nov 24 09:29:04.884: INFO: 	Container csi-provisioner ready: false, restart count 2
Nov 24 09:29:04.884: INFO: 	Container csi-resizer ready: false, restart count 2
Nov 24 09:29:04.884: INFO: 	Container csi-snapshotter ready: false, restart count 2
Nov 24 09:29:04.884: INFO: 	Container hostpath ready: false, restart count 2
Nov 24 09:29:04.884: INFO: 	Container liveness-probe ready: false, restart count 2
Nov 24 09:29:04.884: INFO: 	Container node-driver-registrar ready: false, restart count 3
Nov 24 09:29:04.884: INFO: kube-proxy-bootstrap-e2e-minion-group-0xkq started at 2022-11-24 09:00:32 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.884: INFO: 	Container kube-proxy ready: false, restart count 8
Nov 24 09:29:04.884: INFO: konnectivity-agent-nxcws started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.884: INFO: 	Container konnectivity-agent ready: false, restart count 8
Nov 24 09:29:04.884: INFO: sample-webhook-deployment-865554f4d9-pngsn started at 2022-11-24 09:04:04 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.884: INFO: 	Container sample-webhook ready: false, restart count 9
Nov 24 09:29:04.884: INFO: httpd started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.884: INFO: 	Container httpd ready: false, restart count 5
Nov 24 09:29:04.884: INFO: agnhost started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.884: INFO: 	Container agnhost ready: false, restart count 0
Nov 24 09:29:04.884: INFO: apparmor-loader-nf47q started at 2022-11-24 09:18:27 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:04.884: INFO: 	Container apparmor-loader ready: true, restart count 2
Nov 24 09:29:05.497: INFO: 
Latency metrics for node bootstrap-e2e-minion-group-0xkq
Nov 24 09:29:05.497: INFO: 
Logging node info for node bootstrap-e2e-minion-group-6m4q
Nov 24 09:29:05.545: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-6m4q    be4476db-4c35-4ea4-96f6-e1f0e7c12742 12084 0 2022-11-24 09:00:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-6m4q kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-6m4q topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-8753":"bootstrap-e2e-minion-group-6m4q"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-24 09:00:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-24 09:00:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-11-24 09:12:06 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {node-problem-detector Update v1 2022-11-24 09:25:43 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-24 09:27:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-serial-1-6/us-west1-b/bootstrap-e2e-minion-group-6m4q,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-24 09:25:43 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-24 09:25:43 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-24 09:25:43 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-24 09:25:43 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-24 09:25:43 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-24 09:25:43 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-24 09:25:43 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-24 09:00:50 +0000 UTC,LastTransitionTime:2022-11-24 09:00:50 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-24 09:24:48 +0000 UTC,LastTransitionTime:2022-11-24 09:00:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-24 09:24:48 +0000 UTC,LastTransitionTime:2022-11-24 09:00:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-24 09:24:48 +0000 UTC,LastTransitionTime:2022-11-24 09:00:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-24 09:24:48 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:35.247.58.118,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-6m4q.c.k8s-jkns-gce-serial-1-6.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-6m4q.c.k8s-jkns-gce-serial-1-6.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:7b2cc9e909d10f7df61b26e8aece9707,SystemUUID:7b2cc9e9-09d1-0f7d-f61b-26e8aece9707,BootID:64607970-cc6d-408c-9269-dff979065832,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.44+45279654db87f4,KubeProxyVersion:v1.27.0-alpha.0.44+45279654db87f4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:67201224,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 registry.k8s.io/sig-storage/snapshot-controller:v6.1.0],SizeBytes:22620891,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-7570^55118aeb-6bd7-11ed-8dba-2207550599a3 kubernetes.io/csi/csi-hostpath-ephemeral-8753^758a12fe-6bd7-11ed-b4fd-0e9a0f0cf363],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-7570^55118aeb-6bd7-11ed-8dba-2207550599a3,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-8753^758a12fe-6bd7-11ed-b4fd-0e9a0f0cf363,DevicePath:,},},Config:nil,},}
Nov 24 09:29:05.545: INFO: 
Logging kubelet events for node bootstrap-e2e-minion-group-6m4q
Nov 24 09:29:05.592: INFO: 
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-6m4q
Nov 24 09:29:05.694: INFO: coredns-6d97d5ddb-9z7tn started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.694: INFO: 	Container coredns ready: false, restart count 9
Nov 24 09:29:05.694: INFO: volume-snapshot-controller-0 started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.694: INFO: 	Container volume-snapshot-controller ready: false, restart count 6
Nov 24 09:29:05.694: INFO: ss2-2 started at 2022-11-24 09:18:27 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.694: INFO: 	Container webserver ready: false, restart count 4
Nov 24 09:29:05.694: INFO: liveness-285ed85f-af70-4221-a9ae-9d3784882e9c started at 2022-11-24 09:06:27 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.694: INFO: 	Container agnhost-container ready: true, restart count 3
Nov 24 09:29:05.694: INFO: pod-0 started at 2022-11-24 09:04:46 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.694: INFO: 	Container donothing ready: true, restart count 5
Nov 24 09:29:05.694: INFO: netserver-1 started at 2022-11-24 09:18:27 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.694: INFO: 	Container webserver ready: false, restart count 6
Nov 24 09:29:05.694: INFO: csi-hostpathplugin-0 started at 2022-11-24 09:07:37 +0000 UTC (0+7 container statuses recorded)
Nov 24 09:29:05.694: INFO: 	Container csi-attacher ready: true, restart count 8
Nov 24 09:29:05.694: INFO: 	Container csi-provisioner ready: true, restart count 8
Nov 24 09:29:05.694: INFO: 	Container csi-resizer ready: true, restart count 8
Nov 24 09:29:05.694: INFO: 	Container csi-snapshotter ready: true, restart count 8
Nov 24 09:29:05.694: INFO: 	Container hostpath ready: true, restart count 8
Nov 24 09:29:05.694: INFO: 	Container liveness-probe ready: true, restart count 8
Nov 24 09:29:05.694: INFO: 	Container node-driver-registrar ready: true, restart count 7
Nov 24 09:29:05.694: INFO: pvc-volume-tester-8w74v started at 2022-11-24 09:07:38 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.694: INFO: 	Container volume-tester ready: false, restart count 0
Nov 24 09:29:05.694: INFO: webserver-7d887d45b-lr79x started at 2022-11-24 09:07:41 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.694: INFO: 	Container httpd ready: false, restart count 7
Nov 24 09:29:05.694: INFO: kube-proxy-bootstrap-e2e-minion-group-6m4q started at 2022-11-24 09:00:35 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.694: INFO: 	Container kube-proxy ready: false, restart count 8
Nov 24 09:29:05.694: INFO: netserver-1 started at 2022-11-24 09:04:04 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.694: INFO: 	Container webserver ready: false, restart count 8
Nov 24 09:29:05.694: INFO: inline-volume-tester-2k2tt started at 2022-11-24 09:18:27 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.694: INFO: 	Container csi-volume-tester ready: false, restart count 0
Nov 24 09:29:05.694: INFO: csi-hostpathplugin-0 started at 2022-11-24 09:06:47 +0000 UTC (0+7 container statuses recorded)
Nov 24 09:29:05.694: INFO: 	Container csi-attacher ready: false, restart count 8
Nov 24 09:29:05.694: INFO: 	Container csi-provisioner ready: false, restart count 8
Nov 24 09:29:05.694: INFO: 	Container csi-resizer ready: false, restart count 8
Nov 24 09:29:05.694: INFO: 	Container csi-snapshotter ready: false, restart count 8
Nov 24 09:29:05.694: INFO: 	Container hostpath ready: false, restart count 8
Nov 24 09:29:05.694: INFO: 	Container liveness-probe ready: false, restart count 8
Nov 24 09:29:05.694: INFO: 	Container node-driver-registrar ready: false, restart count 7
Nov 24 09:29:05.694: INFO: my-hostname-private-ae51c3f4-8897-433b-b3ed-7b3c0ce69bc4-9dsrv started at 2022-11-24 09:18:27 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.694: INFO: 	Container my-hostname-private-ae51c3f4-8897-433b-b3ed-7b3c0ce69bc4 ready: true, restart count 4
Nov 24 09:29:05.694: INFO: webserver-pod started at 2022-11-24 09:04:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.694: INFO: 	Container agnhost ready: false, restart count 4
Nov 24 09:29:05.694: INFO: l7-default-backend-8549d69d99-762zc started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.694: INFO: 	Container default-http-backend ready: true, restart count 0
Nov 24 09:29:05.694: INFO: konnectivity-agent-k4jdw started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.694: INFO: 	Container konnectivity-agent ready: false, restart count 7
Nov 24 09:29:05.694: INFO: httpd-deployment-6859889f88-22w25 started at 2022-11-24 09:04:51 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.694: INFO: 	Container httpd ready: true, restart count 6
Nov 24 09:29:05.694: INFO: metadata-proxy-v0.1-lwtk4 started at 2022-11-24 09:00:35 +0000 UTC (0+2 container statuses recorded)
Nov 24 09:29:05.694: INFO: 	Container metadata-proxy ready: true, restart count 0
Nov 24 09:29:05.694: INFO: 	Container prometheus-to-sd-exporter ready: true, restart count 0
Nov 24 09:29:05.694: INFO: kube-dns-autoscaler-5f6455f985-hxtg5 started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.694: INFO: 	Container autoscaler ready: false, restart count 8
Nov 24 09:29:05.694: INFO: pod-configmaps-6929437e-13e1-4a93-b7fa-e8ec8d7c7138 started at 2022-11-24 09:04:04 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:29:05.694: INFO: 	Container createcm-volume-test ready: false, restart count 0
Nov 24 09:29:05.694: INFO: 	Container delcm-volume-test ready: false, restart count 0
Nov 24 09:29:05.694: INFO: 	Container updcm-volume-test ready: false, restart count 0
Nov 24 09:29:05.694: INFO: pod-client started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.694: INFO: 	Container pod-client ready: true, restart count 4
Nov 24 09:29:05.694: INFO: netserver-1 started at 2022-11-24 09:04:49 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.694: INFO: 	Container webserver ready: false, restart count 8
Nov 24 09:29:05.694: INFO: inline-volume-tester-vc928 started at 2022-11-24 09:07:38 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.694: INFO: 	Container csi-volume-tester ready: false, restart count 0
Nov 24 09:29:05.694: INFO: pod-subpath-test-secret-56vz started at 2022-11-24 09:04:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.694: INFO: 	Container test-container-subpath-secret-56vz ready: false, restart count 0
Nov 24 09:29:05.694: INFO: inline-volume-tester-rr76m started at 2022-11-24 09:07:45 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.694: INFO: 	Container csi-volume-tester ready: false, restart count 0
Nov 24 09:29:05.694: INFO: csi-mockplugin-0 started at 2022-11-24 09:06:45 +0000 UTC (0+4 container statuses recorded)
Nov 24 09:29:05.694: INFO: 	Container busybox ready: true, restart count 6
Nov 24 09:29:05.694: INFO: 	Container csi-provisioner ready: false, restart count 7
Nov 24 09:29:05.694: INFO: 	Container driver-registrar ready: false, restart count 6
Nov 24 09:29:05.694: INFO: 	Container mock ready: false, restart count 6
Nov 24 09:29:05.694: INFO: hostexec-bootstrap-e2e-minion-group-6m4q-h8v54 started at 2022-11-24 09:04:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:05.694: INFO: 	Container agnhost-container ready: true, restart count 7
Nov 24 09:29:06.230: INFO: 
Latency metrics for node bootstrap-e2e-minion-group-6m4q
Nov 24 09:29:06.230: INFO: 
Logging node info for node bootstrap-e2e-minion-group-fj34
Nov 24 09:29:06.272: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-fj34    26b0a38a-1259-4217-8b0f-bfa92e43b570 12221 0 2022-11-24 09:00:32 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-fj34 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-fj34 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-4261":"bootstrap-e2e-minion-group-fj34","csi-hostpath-ephemeral-7265":"bootstrap-e2e-minion-group-fj34","csi-mock-csi-mock-volumes-1806":"bootstrap-e2e-minion-group-fj34","csi-mock-csi-mock-volumes-9231":"bootstrap-e2e-minion-group-fj34"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-11-24 09:00:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kubelet Update v1 2022-11-24 09:00:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-24 09:10:50 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {node-problem-detector Update v1 2022-11-24 09:25:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-24 09:29:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-serial-1-6/us-west1-b/bootstrap-e2e-minion-group-fj34,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-24 09:25:40 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-24 09:25:40 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-24 09:25:40 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-24 09:25:40 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-24 09:25:40 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-24 09:25:40 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-24 09:25:40 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-24 09:00:50 +0000 UTC,LastTransitionTime:2022-11-24 09:00:50 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-24 09:24:47 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-24 09:24:47 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-24 09:24:47 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-24 09:24:47 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.82.73.153,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-fj34.c.k8s-jkns-gce-serial-1-6.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-fj34.c.k8s-jkns-gce-serial-1-6.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:557b5201a29dc5c84dc79b98af6f523a,SystemUUID:557b5201-a29d-c5c8-4dc7-9b98af6f523a,BootID:0f4289cb-5f88-4ee3-b552-b99fcc030f54,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.44+45279654db87f4,KubeProxyVersion:v1.27.0-alpha.0.44+45279654db87f4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:67201224,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:c0ddb4794bc8a3631e3373015f913c00b230ee54f87bde9ade195b3a3415c60f registry.k8s.io/build-image/distroless-iptables:v0.1.2],SizeBytes:7685585,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-1806^5a1ffb25-6bd7-11ed-9365-7e36e6fec9d2 kubernetes.io/csi/csi-mock-csi-mock-volumes-9231^cbf4a4b9-6bd6-11ed-88e7-326e345b4078],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-9231^cbf4a4b9-6bd6-11ed-88e7-326e345b4078,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-1806^5a1ffb25-6bd7-11ed-9365-7e36e6fec9d2,DevicePath:,},},Config:nil,},}
Nov 24 09:29:06.273: INFO: 
Logging kubelet events for node bootstrap-e2e-minion-group-fj34
Nov 24 09:29:06.321: INFO: 
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-fj34
Nov 24 09:29:06.449: INFO: csi-mockplugin-attacher-0 started at 2022-11-24 09:02:44 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:06.449: INFO: 	Container csi-attacher ready: true, restart count 7
Nov 24 09:29:06.449: INFO: update-demo-nautilus-56j4t started at 2022-11-24 09:18:35 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:06.449: INFO: 	Container update-demo ready: true, restart count 3
Nov 24 09:29:06.449: INFO: test-pod-2 started at 2022-11-24 09:02:40 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:06.449: INFO: 	Container token-test ready: false, restart count 0
Nov 24 09:29:06.449: INFO: csi-hostpathplugin-0 started at 2022-11-24 09:03:06 +0000 UTC (0+7 container statuses recorded)
Nov 24 09:29:06.449: INFO: 	Container csi-attacher ready: false, restart count 5
Nov 24 09:29:06.449: INFO: 	Container csi-provisioner ready: false, restart count 5
Nov 24 09:29:06.449: INFO: 	Container csi-resizer ready: false, restart count 5
Nov 24 09:29:06.449: INFO: 	Container csi-snapshotter ready: false, restart count 5
Nov 24 09:29:06.449: INFO: 	Container hostpath ready: false, restart count 5
Nov 24 09:29:06.449: INFO: 	Container liveness-probe ready: false, restart count 5
Nov 24 09:29:06.449: INFO: 	Container node-driver-registrar ready: false, restart count 5
Nov 24 09:29:06.449: INFO: hostexec-bootstrap-e2e-minion-group-fj34-z4nnm started at 2022-11-24 09:06:46 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:06.449: INFO: 	Container agnhost-container ready: true, restart count 6
Nov 24 09:29:06.449: INFO: pod-subpath-test-inlinevolume-mcdr started at 2022-11-24 09:04:49 +0000 UTC (2+1 container statuses recorded)
Nov 24 09:29:06.449: INFO: 	Init container init-volume-inlinevolume-mcdr ready: true, restart count 0
Nov 24 09:29:06.449: INFO: 	Init container test-init-volume-inlinevolume-mcdr ready: true, restart count 0
Nov 24 09:29:06.449: INFO: 	Container test-container-subpath-inlinevolume-mcdr ready: false, restart count 0
Nov 24 09:29:06.449: INFO: test-container-pod started at 2022-11-24 09:24:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:06.449: INFO: 	Container webserver ready: true, restart count 1
Nov 24 09:29:06.449: INFO: test-pod-1 started at 2022-11-24 09:02:40 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:06.449: INFO: 	Container token-test ready: false, restart count 0
Nov 24 09:29:06.449: INFO: hostexec-bootstrap-e2e-minion-group-fj34-9j92x started at 2022-11-24 09:04:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:06.449: INFO: 	Container agnhost-container ready: true, restart count 5
Nov 24 09:29:06.449: INFO: httpd-deployment-6859889f88-whrb9 started at 2022-11-24 09:05:53 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:06.449: INFO: 	Container httpd ready: false, restart count 6
Nov 24 09:29:06.449: INFO: csi-mockplugin-0 started at 2022-11-24 09:06:32 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:29:06.449: INFO: 	Container csi-provisioner ready: true, restart count 7
Nov 24 09:29:06.449: INFO: 	Container driver-registrar ready: true, restart count 7
Nov 24 09:29:06.449: INFO: 	Container mock ready: true, restart count 7
Nov 24 09:29:06.449: INFO: webserver-7d887d45b-g8gjr started at 2022-11-24 09:07:41 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:06.449: INFO: 	Container httpd ready: true, restart count 7
Nov 24 09:29:06.449: INFO: metrics-server-v0.5.2-867b8754b9-lprlm started at 2022-11-24 09:01:14 +0000 UTC (0+2 container statuses recorded)
Nov 24 09:29:06.449: INFO: 	Container metrics-server ready: false, restart count 8
Nov 24 09:29:06.449: INFO: 	Container metrics-server-nanny ready: false, restart count 8
Nov 24 09:29:06.449: INFO: netserver-2 started at 2022-11-24 09:04:04 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:06.449: INFO: 	Container webserver ready: false, restart count 6
Nov 24 09:29:06.449: INFO: csi-mockplugin-0 started at 2022-11-24 09:02:44 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:29:06.449: INFO: 	Container csi-provisioner ready: false, restart count 5
Nov 24 09:29:06.449: INFO: 	Container driver-registrar ready: false, restart count 5
Nov 24 09:29:06.449: INFO: 	Container mock ready: false, restart count 5
Nov 24 09:29:06.449: INFO: execpodpxn7d started at 2022-11-24 09:18:55 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:06.449: INFO: 	Container agnhost-container ready: true, restart count 1
Nov 24 09:29:06.449: INFO: netserver-2 started at 2022-11-24 09:04:49 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:06.449: INFO: 	Container webserver ready: false, restart count 8
Nov 24 09:29:06.449: INFO: csi-mockplugin-attacher-0 started at 2022-11-24 09:02:44 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:06.449: INFO: 	Container csi-attacher ready: false, restart count 6
Nov 24 09:29:06.449: INFO: external-provisioner-br7l6 started at 2022-11-24 09:13:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:06.449: INFO: 	Container nfs-provisioner ready: true, restart count 6
Nov 24 09:29:06.449: INFO: csi-hostpathplugin-0 started at 2022-11-24 09:18:54 +0000 UTC (0+7 container statuses recorded)
Nov 24 09:29:06.449: INFO: 	Container csi-attacher ready: true, restart count 0
Nov 24 09:29:06.449: INFO: 	Container csi-provisioner ready: true, restart count 0
Nov 24 09:29:06.449: INFO: 	Container csi-resizer ready: true, restart count 0
Nov 24 09:29:06.449: INFO: 	Container csi-snapshotter ready: true, restart count 0
Nov 24 09:29:06.449: INFO: 	Container hostpath ready: true, restart count 0
Nov 24 09:29:06.449: INFO: 	Container liveness-probe ready: true, restart count 0
Nov 24 09:29:06.449: INFO: 	Container node-driver-registrar ready: true, restart count 0
Nov 24 09:29:06.449: INFO: konnectivity-agent-jjqhp started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:06.449: INFO: 	Container konnectivity-agent ready: true, restart count 8
Nov 24 09:29:06.449: INFO: pod-subpath-test-preprovisionedpv-bvlk started at 2022-11-24 09:07:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:06.449: INFO: 	Container test-container-subpath-preprovisionedpv-bvlk ready: false, restart count 0
Nov 24 09:29:06.449: INFO: csi-hostpathplugin-0 started at 2022-11-24 09:18:45 +0000 UTC (0+7 container statuses recorded)
Nov 24 09:29:06.449: INFO: 	Container csi-attacher ready: true, restart count 0
Nov 24 09:29:06.449: INFO: 	Container csi-provisioner ready: true, restart count 0
Nov 24 09:29:06.449: INFO: 	Container csi-resizer ready: true, restart count 0
Nov 24 09:29:06.449: INFO: 	Container csi-snapshotter ready: true, restart count 0
Nov 24 09:29:06.449: INFO: 	Container hostpath ready: true, restart count 0
Nov 24 09:29:06.449: INFO: 	Container liveness-probe ready: true, restart count 0
Nov 24 09:29:06.449: INFO: 	Container node-driver-registrar ready: true, restart count 0
Nov 24 09:29:06.449: INFO: host-test-container-pod started at 2022-11-24 09:24:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:06.449: INFO: 	Container agnhost-container ready: true, restart count 1
Nov 24 09:29:06.449: INFO: netserver-2 started at 2022-11-24 09:18:27 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:06.449: INFO: 	Container webserver ready: false, restart count 4
Nov 24 09:29:06.449: INFO: ss2-1 started at 2022-11-24 09:18:38 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:06.449: INFO: 	Container webserver ready: false, restart count 6
Nov 24 09:29:06.449: INFO: kube-proxy-bootstrap-e2e-minion-group-fj34 started at 2022-11-24 09:00:32 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:06.449: INFO: 	Container kube-proxy ready: false, restart count 9
Nov 24 09:29:06.449: INFO: metadata-proxy-v0.1-rtz4q started at 2022-11-24 09:00:33 +0000 UTC (0+2 container statuses recorded)
Nov 24 09:29:06.449: INFO: 	Container metadata-proxy ready: true, restart count 0
Nov 24 09:29:06.450: INFO: 	Container prometheus-to-sd-exporter ready: true, restart count 0
Nov 24 09:29:06.450: INFO: pvc-volume-tester-5zg8r started at 2022-11-24 09:03:02 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:06.450: INFO: 	Container volume-tester ready: false, restart count 0
Nov 24 09:29:06.450: INFO: pvc-volume-tester-txtfw started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:06.450: INFO: 	Container volume-tester ready: false, restart count 0
Nov 24 09:29:06.450: INFO: csi-mockplugin-attacher-0 started at 2022-11-24 09:06:32 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:06.450: INFO: 	Container csi-attacher ready: true, restart count 8
Nov 24 09:29:06.450: INFO: inline-volume-tester-2dgl7 started at 2022-11-24 09:18:54 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:06.450: INFO: 	Container csi-volume-tester ready: false, restart count 0
Nov 24 09:29:06.450: INFO: csi-mockplugin-0 started at 2022-11-24 09:02:44 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:29:06.450: INFO: 	Container csi-provisioner ready: true, restart count 8
Nov 24 09:29:06.450: INFO: 	Container driver-registrar ready: true, restart count 8
Nov 24 09:29:06.450: INFO: 	Container mock ready: true, restart count 8
Nov 24 09:29:06.450: INFO: csi-mockplugin-resizer-0 started at 2022-11-24 09:02:44 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:29:06.450: INFO: 	Container csi-resizer ready: true, restart count 6
Nov 24 09:29:07.130: INFO: 
Latency metrics for node bootstrap-e2e-minion-group-fj34
[DeferCleanup (Each)] [sig-api-machinery] CustomResourceValidationRules [Privileged:ClusterAdmin]
  tear down framework | framework.go:193
STEP: Destroying namespace "crd-validation-expressions-8806" for this suite. 11/24/22 09:29:07.13

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-api-machinery] Discovery should accurately determine present and missing resources 2m2s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sDiscovery\sshould\saccurately\sdetermine\spresent\sand\smissing\sresources$'

test/e2e/framework/framework.go:241
k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc000d9c3c0)
	test/e2e/framework/framework.go:241 +0x96f
				[BeforeEach] [sig-api-machinery] Discovery
  set up framework | framework.go:178
STEP: Creating a kubernetes client 11/24/22 09:13:59.139
Nov 24 09:13:59.139: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Building a namespace api object, basename discovery 11/24/22 09:13:59.141
Nov 24 09:15:59.213: INFO: Unexpected error: 
    <*fmt.wrapError | 0xc0052fa000>: {
        msg: "wait for service account \"default\" in namespace \"discovery-7587\": timed out waiting for the condition",
        err: <*errors.errorString | 0xc0001ffa30>{
            s: "timed out waiting for the condition",
        },
    }
Nov 24 09:15:59.214: FAIL: wait for service account "default" in namespace "discovery-7587": timed out waiting for the condition

Full Stack Trace
k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc000d9c3c0)
	test/e2e/framework/framework.go:241 +0x96f
[AfterEach] [sig-api-machinery] Discovery
  test/e2e/framework/node/init/init.go:32
Nov 24 09:15:59.214: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-api-machinery] Discovery
  dump namespaces | framework.go:196
STEP: dump namespace information after failure 11/24/22 09:15:59.26
STEP: Collecting events from namespace "discovery-7587". 11/24/22 09:15:59.26
STEP: Found 0 events. 11/24/22 09:15:59.301
Nov 24 09:15:59.351: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Nov 24 09:15:59.351: INFO: 
Nov 24 09:15:59.396: INFO: 
Logging node info for node bootstrap-e2e-master
Nov 24 09:15:59.439: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master    57b53f45-775d-4de5-a4ff-420df60cf61e 7511 0 2022-11-24 09:00:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-24 09:00:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-11-24 09:00:50 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-11-24 09:00:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-11-24 09:11:34 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-serial-1-6/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3858374656 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3596230656 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-24 09:00:50 +0000 UTC,LastTransitionTime:2022-11-24 09:00:50 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-24 09:11:34 +0000 UTC,LastTransitionTime:2022-11-24 09:00:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-24 09:11:34 +0000 UTC,LastTransitionTime:2022-11-24 09:00:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-24 09:11:34 +0000 UTC,LastTransitionTime:2022-11-24 09:00:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-24 09:11:34 +0000 UTC,LastTransitionTime:2022-11-24 09:00:54 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:35.233.217.30,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-jkns-gce-serial-1-6.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-jkns-gce-serial-1-6.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:2380dd218709b39effceaa3da78bc7d6,SystemUUID:2380dd21-8709-b39e-ffce-aa3da78bc7d6,BootID:8a5acb5e-406f-47f0-bc85-bed589236d7d,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.44+45279654db87f4,KubeProxyVersion:v1.27.0-alpha.0.44+45279654db87f4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:135160275,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:124989753,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:57659704,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:2c111f004bec24888d8cfa2a812a38fb8341350abac67dcd0ac64e709dfe389c registry.k8s.io/kas-network-proxy/proxy-server:v0.0.33],SizeBytes:22020129,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 24 09:15:59.440: INFO: 
Logging kubelet events for node bootstrap-e2e-master
Nov 24 09:15:59.494: INFO: 
Logging pods the kubelet thinks is on node bootstrap-e2e-master
Nov 24 09:15:59.551: INFO: etcd-server-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:15:59.551: INFO: 	Container etcd-container ready: true, restart count 2
Nov 24 09:15:59.551: INFO: konnectivity-server-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:15:59.551: INFO: 	Container konnectivity-server-container ready: true, restart count 0
Nov 24 09:15:59.551: INFO: kube-addon-manager-bootstrap-e2e-master started at 2022-11-24 09:00:06 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:15:59.551: INFO: 	Container kube-addon-manager ready: true, restart count 1
Nov 24 09:15:59.551: INFO: l7-lb-controller-bootstrap-e2e-master started at 2022-11-24 09:00:07 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:15:59.551: INFO: 	Container l7-lb-controller ready: false, restart count 5
Nov 24 09:15:59.551: INFO: metadata-proxy-v0.1-dgq6b started at 2022-11-24 09:01:06 +0000 UTC (0+2 container statuses recorded)
Nov 24 09:15:59.551: INFO: 	Container metadata-proxy ready: true, restart count 0
Nov 24 09:15:59.551: INFO: 	Container prometheus-to-sd-exporter ready: true, restart count 0
Nov 24 09:15:59.551: INFO: etcd-server-events-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:15:59.551: INFO: 	Container etcd-container ready: true, restart count 3
Nov 24 09:15:59.551: INFO: kube-controller-manager-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:15:59.551: INFO: 	Container kube-controller-manager ready: false, restart count 5
Nov 24 09:15:59.551: INFO: kube-scheduler-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:15:59.551: INFO: 	Container kube-scheduler ready: false, restart count 5
Nov 24 09:15:59.551: INFO: kube-apiserver-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:15:59.551: INFO: 	Container kube-apiserver ready: true, restart count 2
Nov 24 09:15:59.786: INFO: 
Latency metrics for node bootstrap-e2e-master
Nov 24 09:15:59.786: INFO: 
Logging node info for node bootstrap-e2e-minion-group-0xkq
Nov 24 09:15:59.834: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-0xkq    34eb6b8a-d427-45c3-aa67-9f7aa0a1f8a1 9775 0 2022-11-24 09:00:32 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-0xkq kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-0xkq topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-4020":"bootstrap-e2e-minion-group-0xkq"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-11-24 09:00:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}}}} } {kubelet Update v1 2022-11-24 09:00:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-24 09:00:50 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-11-24 09:14:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {node-problem-detector Update v1 2022-11-24 09:15:38 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-serial-1-6/us-west1-b/bootstrap-e2e-minion-group-0xkq,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-24 09:15:38 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-24 09:15:38 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-24 09:15:38 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-24 09:15:38 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-24 09:15:38 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-24 09:15:38 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-24 09:15:38 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-24 09:00:50 +0000 UTC,LastTransitionTime:2022-11-24 09:00:50 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-24 09:14:08 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-24 09:14:08 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-24 09:14:08 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-24 09:14:08 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:34.145.99.248,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-0xkq.c.k8s-jkns-gce-serial-1-6.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-0xkq.c.k8s-jkns-gce-serial-1-6.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:23bcd2ca790827437c5cec98facdba94,SystemUUID:23bcd2ca-7908-2743-7c5c-ec98facdba94,BootID:84f5ff41-fbc9-4fdb-966f-19346788bdab,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.44+45279654db87f4,KubeProxyVersion:v1.27.0-alpha.0.44+45279654db87f4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:67201224,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/debian-base@sha256:ebda8587ec0f49eb88ee3a608ef018484908cbc5aa32556a0d78356088c185d4 registry.k8s.io/debian-base:v2.0.0],SizeBytes:21093264,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 24 09:15:59.834: INFO: 
Logging kubelet events for node bootstrap-e2e-minion-group-0xkq
Nov 24 09:15:59.880: INFO: 
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-0xkq
Nov 24 09:15:59.958: INFO: external-provisioner-s6wpd started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:15:59.958: INFO: 	Container nfs-provisioner ready: false, restart count 5
Nov 24 09:15:59.958: INFO: client-containers-73020471-75dc-486c-91d8-b2150c34f574 started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:15:59.958: INFO: 	Container agnhost-container ready: false, restart count 0
Nov 24 09:15:59.958: INFO: explicit-nonroot-uid started at 2022-11-24 09:13:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:15:59.958: INFO: 	Container explicit-nonroot-uid ready: false, restart count 0
Nov 24 09:15:59.958: INFO: agnhost-host-aliases07dd0013-880a-43df-b65a-dd3cc866b1c6 started at 2022-11-24 09:04:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:15:59.958: INFO: 	Container agnhost-container ready: false, restart count 0
Nov 24 09:15:59.958: INFO: httpd-deployment-6859889f88-cjjj8 started at 2022-11-24 09:04:51 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:15:59.958: INFO: 	Container httpd ready: true, restart count 5
Nov 24 09:15:59.958: INFO: hostexec-bootstrap-e2e-minion-group-0xkq-gs72q started at 2022-11-24 09:06:42 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:15:59.958: INFO: 	Container agnhost-container ready: false, restart count 4
Nov 24 09:15:59.958: INFO: sample-webhook-deployment-865554f4d9-shnzq started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:15:59.958: INFO: 	Container sample-webhook ready: true, restart count 0
Nov 24 09:15:59.958: INFO: pod-always-succeed1ac1248a-f95d-4ec8-add5-00fdfc91f740 started at 2022-11-24 09:04:11 +0000 UTC (1+1 container statuses recorded)
Nov 24 09:15:59.958: INFO: 	Init container foo ready: true, restart count 0
Nov 24 09:15:59.958: INFO: 	Container bar ready: false, restart count 0
Nov 24 09:15:59.958: INFO: netserver-0 started at 2022-11-24 09:11:28 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:15:59.958: INFO: 	Container webserver ready: true, restart count 3
Nov 24 09:15:59.958: INFO: metadata-proxy-v0.1-jg8bk started at 2022-11-24 09:00:33 +0000 UTC (0+2 container statuses recorded)
Nov 24 09:15:59.958: INFO: 	Container metadata-proxy ready: true, restart count 0
Nov 24 09:15:59.958: INFO: 	Container prometheus-to-sd-exporter ready: true, restart count 0
Nov 24 09:15:59.958: INFO: busybox-readonly-true-0c7fd3e6-417c-4909-a077-6624310b4dfb started at 2022-11-24 09:04:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:15:59.958: INFO: 	Container busybox-readonly-true-0c7fd3e6-417c-4909-a077-6624310b4dfb ready: false, restart count 0
Nov 24 09:15:59.958: INFO: busybox-e4175cec-5a98-457b-8d7a-fc687790f79e started at 2022-11-24 09:04:11 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:15:59.958: INFO: 	Container busybox ready: false, restart count 6
Nov 24 09:15:59.958: INFO: csi-mockplugin-0 started at 2022-11-24 09:13:37 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:15:59.958: INFO: 	Container csi-provisioner ready: true, restart count 0
Nov 24 09:15:59.958: INFO: 	Container driver-registrar ready: true, restart count 0
Nov 24 09:15:59.958: INFO: 	Container mock ready: true, restart count 0
Nov 24 09:15:59.958: INFO: nfs-server started at 2022-11-24 09:13:52 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:15:59.958: INFO: 	Container nfs-server ready: false, restart count 2
Nov 24 09:15:59.958: INFO: pod-disruption-failure-ignore-0-ngtgb started at 2022-11-24 09:13:53 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:15:59.958: INFO: 	Container c ready: false, restart count 0
Nov 24 09:15:59.958: INFO: pod-subpath-test-preprovisionedpv-tmmr started at 2022-11-24 09:07:37 +0000 UTC (2+1 container statuses recorded)
Nov 24 09:15:59.958: INFO: 	Init container init-volume-preprovisionedpv-tmmr ready: true, restart count 0
Nov 24 09:15:59.958: INFO: 	Init container test-init-volume-preprovisionedpv-tmmr ready: true, restart count 0
Nov 24 09:15:59.958: INFO: 	Container test-container-subpath-preprovisionedpv-tmmr ready: false, restart count 0
Nov 24 09:15:59.958: INFO: pod-configmaps-e234b165-43bc-41ce-91d4-7789b97cbf1a started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:15:59.958: INFO: 	Container env-test ready: false, restart count 0
Nov 24 09:15:59.958: INFO: netserver-0 started at 2022-11-24 09:04:49 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:15:59.958: INFO: 	Container webserver ready: false, restart count 6
Nov 24 09:15:59.958: INFO: csi-mockplugin-0 started at 2022-11-24 09:02:44 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:15:59.958: INFO: 	Container csi-provisioner ready: false, restart count 6
Nov 24 09:15:59.958: INFO: 	Container driver-registrar ready: false, restart count 6
Nov 24 09:15:59.958: INFO: 	Container mock ready: false, restart count 6
Nov 24 09:15:59.958: INFO: hostexec-bootstrap-e2e-minion-group-0xkq-pqnxr started at 2022-11-24 09:06:47 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:15:59.958: INFO: 	Container agnhost-container ready: true, restart count 0
Nov 24 09:15:59.958: INFO: coredns-6d97d5ddb-q22hn started at 2022-11-24 09:00:58 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:15:59.958: INFO: 	Container coredns ready: false, restart count 7
Nov 24 09:15:59.958: INFO: external-provisioner-nzpx5 started at 2022-11-24 09:13:56 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:15:59.958: INFO: 	Container nfs-provisioner ready: true, restart count 0
Nov 24 09:15:59.958: INFO: test-pod-3 started at 2022-11-24 09:02:41 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:15:59.958: INFO: 	Container token-test ready: false, restart count 0
Nov 24 09:15:59.958: INFO: netserver-0 started at 2022-11-24 09:04:04 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:15:59.958: INFO: 	Container webserver ready: false, restart count 7
Nov 24 09:15:59.958: INFO: alpine-nnp-false-d237a6ae-3e11-402c-9f30-27adea86549e started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:15:59.958: INFO: 	Container alpine-nnp-false-d237a6ae-3e11-402c-9f30-27adea86549e ready: false, restart count 0
Nov 24 09:15:59.958: INFO: kube-proxy-bootstrap-e2e-minion-group-0xkq started at 2022-11-24 09:00:32 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:15:59.958: INFO: 	Container kube-proxy ready: false, restart count 6
Nov 24 09:15:59.958: INFO: konnectivity-agent-nxcws started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:15:59.958: INFO: 	Container konnectivity-agent ready: false, restart count 6
Nov 24 09:15:59.958: INFO: sample-webhook-deployment-865554f4d9-pngsn started at 2022-11-24 09:04:04 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:15:59.958: INFO: 	Container sample-webhook ready: false, restart count 6
Nov 24 09:15:59.958: INFO: ss2-0 started at 2022-11-24 09:11:28 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:15:59.958: INFO: 	Container webserver ready: true, restart count 2
Nov 24 09:15:59.958: INFO: httpd started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:15:59.958: INFO: 	Container httpd ready: true, restart count 2
Nov 24 09:15:59.958: INFO: agnhost started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:15:59.958: INFO: 	Container agnhost ready: false, restart count 0
Nov 24 09:15:59.958: INFO: busybox-privileged-true-6d8d86a8-006d-4ef1-a653-81a0fa7dd7d8 started at 2022-11-24 09:13:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:15:59.958: INFO: 	Container busybox-privileged-true-6d8d86a8-006d-4ef1-a653-81a0fa7dd7d8 ready: false, restart count 0
Nov 24 09:15:59.958: INFO: pod-secrets-6ef894cf-d4cc-4c12-a50d-3e49edaec470 started at 2022-11-24 09:07:37 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:15:59.958: INFO: 	Container creates-volume-test ready: false, restart count 0
Nov 24 09:15:59.958: INFO: 	Container dels-volume-test ready: false, restart count 0
Nov 24 09:15:59.958: INFO: 	Container upds-volume-test ready: false, restart count 0
Nov 24 09:15:59.958: INFO: external-provisioner-f4vcp started at 2022-11-24 09:13:55 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:15:59.958: INFO: 	Container nfs-provisioner ready: true, restart count 1
Nov 24 09:15:59.958: INFO: csi-mockplugin-attacher-0 started at 2022-11-24 09:13:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:15:59.958: INFO: 	Container csi-attacher ready: true, restart count 0
Nov 24 09:15:59.958: INFO: webserver-7d887d45b-b2lng started at 2022-11-24 09:10:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:15:59.958: INFO: 	Container httpd ready: true, restart count 5
Nov 24 09:15:59.958: INFO: service-deletion-pmnf7 started at 2022-11-24 09:13:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:15:59.958: INFO: 	Container service-deletion ready: true, restart count 1
Nov 24 09:15:59.958: INFO: pod-disruption-failure-ignore-1-8q4cc started at 2022-11-24 09:13:53 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:15:59.958: INFO: 	Container c ready: false, restart count 0
Nov 24 09:15:59.958: INFO: webserver-7d887d45b-zjrtz started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:15:59.958: INFO: 	Container httpd ready: true, restart count 3
Nov 24 09:15:59.958: INFO: pod-subpath-test-preprovisionedpv-bchr started at 2022-11-24 09:07:37 +0000 UTC (1+1 container statuses recorded)
Nov 24 09:15:59.958: INFO: 	Init container init-volume-preprovisionedpv-bchr ready: true, restart count 0
Nov 24 09:15:59.958: INFO: 	Container test-container-subpath-preprovisionedpv-bchr ready: false, restart count 0
Nov 24 09:15:59.958: INFO: sample-webhook-deployment-865554f4d9-qhln9 started at 2022-11-24 09:04:35 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:15:59.958: INFO: 	Container sample-webhook ready: false, restart count 4
Nov 24 09:15:59.958: INFO: pod-0 started at 2022-11-24 09:13:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:15:59.958: INFO: 	Container donothing ready: true, restart count 1
Nov 24 09:15:59.958: INFO: affinity-nodeport-vs2hc started at 2022-11-24 09:11:11 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:15:59.958: INFO: 	Container affinity-nodeport ready: true, restart count 0
Nov 24 09:16:00.203: INFO: 
Latency metrics for node bootstrap-e2e-minion-group-0xkq
Nov 24 09:16:00.203: INFO: 
Logging node info for node bootstrap-e2e-minion-group-6m4q
Nov 24 09:16:00.273: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-6m4q    be4476db-4c35-4ea4-96f6-e1f0e7c12742 9795 0 2022-11-24 09:00:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-6m4q kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-6m4q topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-8753":"bootstrap-e2e-minion-group-6m4q","csi-hostpath-volume-expand-5590":"bootstrap-e2e-minion-group-6m4q","csi-mock-csi-mock-volumes-4705":"bootstrap-e2e-minion-group-6m4q"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-24 09:00:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-24 09:00:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-11-24 09:12:06 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2022-11-24 09:14:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {node-problem-detector Update v1 2022-11-24 09:15:42 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-serial-1-6/us-west1-b/bootstrap-e2e-minion-group-6m4q,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-24 09:15:42 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-24 09:15:42 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-24 09:15:42 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-24 09:15:42 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-24 09:15:42 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-24 09:15:42 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-24 09:15:42 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-24 09:00:50 +0000 UTC,LastTransitionTime:2022-11-24 09:00:50 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-24 09:12:05 +0000 UTC,LastTransitionTime:2022-11-24 09:00:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-24 09:12:05 +0000 UTC,LastTransitionTime:2022-11-24 09:00:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-24 09:12:05 +0000 UTC,LastTransitionTime:2022-11-24 09:00:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-24 09:12:05 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:35.247.58.118,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-6m4q.c.k8s-jkns-gce-serial-1-6.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-6m4q.c.k8s-jkns-gce-serial-1-6.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:7b2cc9e909d10f7df61b26e8aece9707,SystemUUID:7b2cc9e9-09d1-0f7d-f61b-26e8aece9707,BootID:64607970-cc6d-408c-9269-dff979065832,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.44+45279654db87f4,KubeProxyVersion:v1.27.0-alpha.0.44+45279654db87f4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:67201224,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 registry.k8s.io/sig-storage/snapshot-controller:v6.1.0],SizeBytes:22620891,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-7570^55118aeb-6bd7-11ed-8dba-2207550599a3 kubernetes.io/csi/csi-hostpath-ephemeral-8753^758a12fe-6bd7-11ed-b4fd-0e9a0f0cf363],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-7570^55118aeb-6bd7-11ed-8dba-2207550599a3,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-8753^758a12fe-6bd7-11ed-b4fd-0e9a0f0cf363,DevicePath:,},},Config:nil,},}
Nov 24 09:16:00.274: INFO: 
Logging kubelet events for node bootstrap-e2e-minion-group-6m4q
Nov 24 09:16:00.318: INFO: 
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-6m4q
Nov 24 09:16:00.387: INFO: csi-hostpathplugin-0 started at 2022-11-24 09:06:47 +0000 UTC (0+7 container statuses recorded)
Nov 24 09:16:00.387: INFO: 	Container csi-attacher ready: true, restart count 6
Nov 24 09:16:00.387: INFO: 	Container csi-provisioner ready: true, restart count 6
Nov 24 09:16:00.387: INFO: 	Container csi-resizer ready: true, restart count 6
Nov 24 09:16:00.387: INFO: 	Container csi-snapshotter ready: true, restart count 6
Nov 24 09:16:00.387: INFO: 	Container hostpath ready: true, restart count 6
Nov 24 09:16:00.387: INFO: 	Container liveness-probe ready: true, restart count 6
Nov 24 09:16:00.387: INFO: 	Container node-driver-registrar ready: false, restart count 5
Nov 24 09:16:00.387: INFO: csi-hostpathplugin-0 started at 2022-11-24 09:07:37 +0000 UTC (0+7 container statuses recorded)
Nov 24 09:16:00.387: INFO: 	Container csi-attacher ready: true, restart count 2
Nov 24 09:16:00.387: INFO: 	Container csi-provisioner ready: true, restart count 2
Nov 24 09:16:00.387: INFO: 	Container csi-resizer ready: true, restart count 2
Nov 24 09:16:00.387: INFO: 	Container csi-snapshotter ready: true, restart count 2
Nov 24 09:16:00.387: INFO: 	Container hostpath ready: true, restart count 2
Nov 24 09:16:00.387: INFO: 	Container liveness-probe ready: true, restart count 2
Nov 24 09:16:00.387: INFO: 	Container node-driver-registrar ready: true, restart count 2
Nov 24 09:16:00.387: INFO: csi-hostpathplugin-0 started at 2022-11-24 09:07:37 +0000 UTC (0+7 container statuses recorded)
Nov 24 09:16:00.387: INFO: 	Container csi-attacher ready: true, restart count 6
Nov 24 09:16:00.387: INFO: 	Container csi-provisioner ready: true, restart count 6
Nov 24 09:16:00.387: INFO: 	Container csi-resizer ready: true, restart count 6
Nov 24 09:16:00.387: INFO: 	Container csi-snapshotter ready: true, restart count 6
Nov 24 09:16:00.387: INFO: 	Container hostpath ready: true, restart count 6
Nov 24 09:16:00.387: INFO: 	Container liveness-probe ready: true, restart count 6
Nov 24 09:16:00.387: INFO: 	Container node-driver-registrar ready: true, restart count 5
Nov 24 09:16:00.387: INFO: pvc-volume-tester-8w74v started at 2022-11-24 09:07:38 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:16:00.387: INFO: 	Container volume-tester ready: false, restart count 0
Nov 24 09:16:00.387: INFO: webserver-7d887d45b-lr79x started at 2022-11-24 09:07:41 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:16:00.387: INFO: 	Container httpd ready: false, restart count 3
Nov 24 09:16:00.387: INFO: kube-proxy-bootstrap-e2e-minion-group-6m4q started at 2022-11-24 09:00:35 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:16:00.387: INFO: 	Container kube-proxy ready: false, restart count 6
Nov 24 09:16:00.387: INFO: netserver-1 started at 2022-11-24 09:04:04 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:16:00.387: INFO: 	Container webserver ready: false, restart count 6
Nov 24 09:16:00.387: INFO: csi-mockplugin-0 started at 2022-11-24 09:11:32 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:16:00.387: INFO: 	Container csi-provisioner ready: true, restart count 1
Nov 24 09:16:00.387: INFO: 	Container driver-registrar ready: true, restart count 1
Nov 24 09:16:00.387: INFO: 	Container mock ready: true, restart count 1
Nov 24 09:16:00.387: INFO: konnectivity-agent-k4jdw started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:16:00.387: INFO: 	Container konnectivity-agent ready: false, restart count 5
Nov 24 09:16:00.387: INFO: httpd-deployment-6859889f88-22w25 started at 2022-11-24 09:04:51 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:16:00.387: INFO: 	Container httpd ready: false, restart count 3
Nov 24 09:16:00.387: INFO: dns-test-12556b73-2082-4058-ba43-d395fc7ea91b started at 2022-11-24 09:11:00 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:16:00.387: INFO: 	Container jessie-querier ready: true, restart count 3
Nov 24 09:16:00.387: INFO: 	Container querier ready: true, restart count 3
Nov 24 09:16:00.387: INFO: 	Container webserver ready: true, restart count 3
Nov 24 09:16:00.387: INFO: webserver-pod started at 2022-11-24 09:04:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:16:00.387: INFO: 	Container agnhost ready: false, restart count 2
Nov 24 09:16:00.387: INFO: l7-default-backend-8549d69d99-762zc started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:16:00.387: INFO: 	Container default-http-backend ready: true, restart count 0
Nov 24 09:16:00.387: INFO: pod-configmaps-6929437e-13e1-4a93-b7fa-e8ec8d7c7138 started at 2022-11-24 09:04:04 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:16:00.387: INFO: 	Container createcm-volume-test ready: false, restart count 0
Nov 24 09:16:00.387: INFO: 	Container delcm-volume-test ready: false, restart count 0
Nov 24 09:16:00.387: INFO: 	Container updcm-volume-test ready: false, restart count 0
Nov 24 09:16:00.387: INFO: pod-client started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:16:00.387: INFO: 	Container pod-client ready: true, restart count 1
Nov 24 09:16:00.387: INFO: metadata-proxy-v0.1-lwtk4 started at 2022-11-24 09:00:35 +0000 UTC (0+2 container statuses recorded)
Nov 24 09:16:00.387: INFO: 	Container metadata-proxy ready: true, restart count 0
Nov 24 09:16:00.387: INFO: 	Container prometheus-to-sd-exporter ready: true, restart count 0
Nov 24 09:16:00.387: INFO: kube-dns-autoscaler-5f6455f985-hxtg5 started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:16:00.387: INFO: 	Container autoscaler ready: false, restart count 6
Nov 24 09:16:00.387: INFO: pod-subpath-test-secret-56vz started at 2022-11-24 09:04:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:16:00.387: INFO: 	Container test-container-subpath-secret-56vz ready: false, restart count 0
Nov 24 09:16:00.387: INFO: inline-volume-tester-rr76m started at 2022-11-24 09:07:45 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:16:00.387: INFO: 	Container csi-volume-tester ready: false, restart count 0
Nov 24 09:16:00.387: INFO: hostexec-bootstrap-e2e-minion-group-6m4q-j7rxh started at 2022-11-24 09:13:55 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:16:00.387: INFO: 	Container agnhost-container ready: true, restart count 0
Nov 24 09:16:00.387: INFO: netserver-1 started at 2022-11-24 09:04:49 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:16:00.387: INFO: 	Container webserver ready: false, restart count 5
Nov 24 09:16:00.387: INFO: inline-volume-tester-vc928 started at 2022-11-24 09:07:38 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:16:00.387: INFO: 	Container csi-volume-tester ready: true, restart count 0
Nov 24 09:16:00.387: INFO: csi-mockplugin-0 started at 2022-11-24 09:06:45 +0000 UTC (0+4 container statuses recorded)
Nov 24 09:16:00.387: INFO: 	Container busybox ready: false, restart count 3
Nov 24 09:16:00.387: INFO: 	Container csi-provisioner ready: false, restart count 4
Nov 24 09:16:00.387: INFO: 	Container driver-registrar ready: false, restart count 4
Nov 24 09:16:00.387: INFO: 	Container mock ready: false, restart count 4
Nov 24 09:16:00.387: INFO: ss2-2 started at 2022-11-24 09:13:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:16:00.387: INFO: 	Container webserver ready: true, restart count 0
Nov 24 09:16:00.387: INFO: hostexec-bootstrap-e2e-minion-group-6m4q-h8v54 started at 2022-11-24 09:04:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:16:00.387: INFO: 	Container agnhost-container ready: true, restart count 4
Nov 24 09:16:00.387: INFO: csi-hostpathplugin-0 started at 2022-11-24 09:02:44 +0000 UTC (0+7 container statuses recorded)
Nov 24 09:16:00.387: INFO: 	Container csi-attacher ready: false, restart count 6
Nov 24 09:16:00.387: INFO: 	Container csi-provisioner ready: false, restart count 6
Nov 24 09:16:00.387: INFO: 	Container csi-resizer ready: false, restart count 6
Nov 24 09:16:00.387: INFO: 	Container csi-snapshotter ready: false, restart count 6
Nov 24 09:16:00.387: INFO: 	Container hostpath ready: false, restart count 6
Nov 24 09:16:00.387: INFO: 	Container liveness-probe ready: false, restart count 6
Nov 24 09:16:00.387: INFO: 	Container node-driver-registrar ready: false, restart count 6
Nov 24 09:16:00.387: INFO: liveness-285ed85f-af70-4221-a9ae-9d3784882e9c started at 2022-11-24 09:06:27 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:16:00.387: INFO: 	Container agnhost-container ready: true, restart count 1
Nov 24 09:16:00.387: INFO: affinity-nodeport-cn5lz started at 2022-11-24 09:11:11 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:16:00.387: INFO: 	Container affinity-nodeport ready: true, restart count 0
Nov 24 09:16:00.387: INFO: csi-mockplugin-attacher-0 started at 2022-11-24 09:11:32 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:16:00.387: INFO: 	Container csi-attacher ready: true, restart count 3
Nov 24 09:16:00.387: INFO: coredns-6d97d5ddb-9z7tn started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:16:00.387: INFO: 	Container coredns ready: false, restart count 6
Nov 24 09:16:00.387: INFO: volume-snapshot-controller-0 started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:16:00.387: INFO: 	Container volume-snapshot-controller ready: true, restart count 3
Nov 24 09:16:00.387: INFO: pod-0 started at 2022-11-24 09:04:46 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:16:00.387: INFO: 	Container donothing ready: true, restart count 4
Nov 24 09:16:00.387: INFO: netserver-1 started at 2022-11-24 09:11:28 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:16:00.387: INFO: 	Container webserver ready: true, restart count 3
Nov 24 09:16:00.710: INFO: 
Latency metrics for node bootstrap-e2e-minion-group-6m4q
Nov 24 09:16:00.710: INFO: 
Logging node info for node bootstrap-e2e-minion-group-fj34
Nov 24 09:16:00.753: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-fj34    26b0a38a-1259-4217-8b0f-bfa92e43b570 9777 0 2022-11-24 09:00:32 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-fj34 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-fj34 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-9395":"bootstrap-e2e-minion-group-fj34","csi-mock-csi-mock-volumes-1806":"bootstrap-e2e-minion-group-fj34","csi-mock-csi-mock-volumes-9231":"bootstrap-e2e-minion-group-fj34","csi-mock-csi-mock-volumes-9394":"bootstrap-e2e-minion-group-fj34"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-11-24 09:00:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kubelet Update v1 2022-11-24 09:00:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-24 09:10:50 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2022-11-24 09:15:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {node-problem-detector Update v1 2022-11-24 09:15:39 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-serial-1-6/us-west1-b/bootstrap-e2e-minion-group-fj34,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-24 09:15:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-24 09:15:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-24 09:15:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-24 09:15:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-24 09:15:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-24 09:15:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-24 09:15:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-24 09:00:50 +0000 UTC,LastTransitionTime:2022-11-24 09:00:50 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-24 09:14:08 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-24 09:14:08 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-24 09:14:08 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-24 09:14:08 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.82.73.153,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-fj34.c.k8s-jkns-gce-serial-1-6.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-fj34.c.k8s-jkns-gce-serial-1-6.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:557b5201a29dc5c84dc79b98af6f523a,SystemUUID:557b5201-a29d-c5c8-4dc7-9b98af6f523a,BootID:0f4289cb-5f88-4ee3-b552-b99fcc030f54,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.44+45279654db87f4,KubeProxyVersion:v1.27.0-alpha.0.44+45279654db87f4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:67201224,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:c0ddb4794bc8a3631e3373015f913c00b230ee54f87bde9ade195b3a3415c60f registry.k8s.io/build-image/distroless-iptables:v0.1.2],SizeBytes:7685585,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-1806^5a1ffb25-6bd7-11ed-9365-7e36e6fec9d2 kubernetes.io/csi/csi-mock-csi-mock-volumes-9231^cbf4a4b9-6bd6-11ed-88e7-326e345b4078],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-9231^cbf4a4b9-6bd6-11ed-88e7-326e345b4078,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-1806^5a1ffb25-6bd7-11ed-9365-7e36e6fec9d2,DevicePath:,},},Config:nil,},}
Nov 24 09:16:00.753: INFO: 
Logging kubelet events for node bootstrap-e2e-minion-group-fj34
Nov 24 09:16:00.799: INFO: 
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-fj34
Nov 24 09:16:01.010: INFO: dns-test-b905b98f-f49c-4646-a804-ea7e4c577ec7 started at 2022-11-24 09:13:37 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:16:01.010: INFO: 	Container jessie-querier ready: true, restart count 1
Nov 24 09:16:01.010: INFO: 	Container querier ready: true, restart count 1
Nov 24 09:16:01.010: INFO: 	Container webserver ready: true, restart count 1
Nov 24 09:16:01.010: INFO: verify-service-up-host-exec-pod started at 2022-11-24 09:13:59 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:16:01.010: INFO: 	Container agnhost-container ready: true, restart count 1
Nov 24 09:16:01.010: INFO: test-pod-2 started at 2022-11-24 09:02:40 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:16:01.010: INFO: 	Container token-test ready: false, restart count 0
Nov 24 09:16:01.010: INFO: csi-hostpathplugin-0 started at 2022-11-24 09:03:06 +0000 UTC (0+7 container statuses recorded)
Nov 24 09:16:01.010: INFO: 	Container csi-attacher ready: true, restart count 3
Nov 24 09:16:01.010: INFO: 	Container csi-provisioner ready: true, restart count 3
Nov 24 09:16:01.010: INFO: 	Container csi-resizer ready: true, restart count 3
Nov 24 09:16:01.010: INFO: 	Container csi-snapshotter ready: true, restart count 3
Nov 24 09:16:01.010: INFO: 	Container hostpath ready: true, restart count 3
Nov 24 09:16:01.010: INFO: 	Container liveness-probe ready: true, restart count 3
Nov 24 09:16:01.010: INFO: 	Container node-driver-registrar ready: true, restart count 3
Nov 24 09:16:01.010: INFO: hostexec-bootstrap-e2e-minion-group-fj34-z4nnm started at 2022-11-24 09:06:46 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:16:01.010: INFO: 	Container agnhost-container ready: false, restart count 5
Nov 24 09:16:01.010: INFO: pod-subpath-test-inlinevolume-mcdr started at 2022-11-24 09:04:49 +0000 UTC (2+1 container statuses recorded)
Nov 24 09:16:01.010: INFO: 	Init container init-volume-inlinevolume-mcdr ready: true, restart count 0
Nov 24 09:16:01.010: INFO: 	Init container test-init-volume-inlinevolume-mcdr ready: true, restart count 0
Nov 24 09:16:01.010: INFO: 	Container test-container-subpath-inlinevolume-mcdr ready: false, restart count 0
Nov 24 09:16:01.010: INFO: test-container-pod started at 2022-11-24 09:13:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:16:01.010: INFO: 	Container webserver ready: true, restart count 0
Nov 24 09:16:01.010: INFO: pod-adoption started at 2022-11-24 09:13:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:16:01.010: INFO: 	Container pod-adoption ready: true, restart count 1
Nov 24 09:16:01.010: INFO: test-pod-1 started at 2022-11-24 09:02:40 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:16:01.010: INFO: 	Container token-test ready: false, restart count 0
Nov 24 09:16:01.010: INFO: hostexec-bootstrap-e2e-minion-group-fj34-9j92x started at 2022-11-24 09:04:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:16:01.010: INFO: 	Container agnhost-container ready: true, restart count 4
Nov 24 09:16:01.010: INFO: httpd-deployment-6859889f88-whrb9 started at 2022-11-24 09:05:53 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:16:01.010: INFO: 	Container httpd ready: false, restart count 3
Nov 24 09:16:01.010: INFO: csi-mockplugin-0 started at 2022-11-24 09:06:32 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:16:01.010: INFO: 	Container csi-provisioner ready: true, restart count 5
Nov 24 09:16:01.010: INFO: 	Container driver-registrar ready: true, restart count 5
Nov 24 09:16:01.010: INFO: 	Container mock ready: true, restart count 5
Nov 24 09:16:01.010: INFO: webserver-7d887d45b-g8gjr started at 2022-11-24 09:07:41 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:16:01.010: INFO: 	Container httpd ready: true, restart count 6
Nov 24 09:16:01.010: INFO: metrics-server-v0.5.2-867b8754b9-lprlm started at 2022-11-24 09:01:14 +0000 UTC (0+2 container statuses recorded)
Nov 24 09:16:01.010: INFO: 	Container metrics-server ready: false, restart count 6
Nov 24 09:16:01.010: INFO: 	Container metrics-server-nanny ready: false, restart count 6
Nov 24 09:16:01.010: INFO: netserver-2 started at 2022-11-24 09:04:04 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:16:01.010: INFO: 	Container webserver ready: false, restart count 3
Nov 24 09:16:01.010: INFO: csi-mockplugin-0 started at 2022-11-24 09:02:44 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:16:01.010: INFO: 	Container csi-provisioner ready: true, restart count 3
Nov 24 09:16:01.010: INFO: 	Container driver-registrar ready: true, restart count 3
Nov 24 09:16:01.010: INFO: 	Container mock ready: true, restart count 3
Nov 24 09:16:01.010: INFO: netserver-2 started at 2022-11-24 09:04:49 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:16:01.010: INFO: 	Container webserver ready: true, restart count 6
Nov 24 09:16:01.010: INFO: csi-mockplugin-attacher-0 started at 2022-11-24 09:02:44 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:16:01.010: INFO: 	Container csi-attacher ready: true, restart count 3
Nov 24 09:16:01.010: INFO: external-provisioner-br7l6 started at 2022-11-24 09:13:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:16:01.010: INFO: 	Container nfs-provisioner ready: false, restart count 2
Nov 24 09:16:01.010: INFO: konnectivity-agent-jjqhp started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:16:01.010: INFO: 	Container konnectivity-agent ready: true, restart count 6
Nov 24 09:16:01.010: INFO: pod-subpath-test-preprovisionedpv-bvlk started at 2022-11-24 09:07:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:16:01.010: INFO: 	Container test-container-subpath-preprovisionedpv-bvlk ready: false, restart count 0
Nov 24 09:16:01.010: INFO: verify-service-up-exec-pod-f2qr5 started at 2022-11-24 09:14:03 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:16:01.010: INFO: 	Container agnhost-container ready: true, restart count 0
Nov 24 09:16:01.010: INFO: kube-proxy-bootstrap-e2e-minion-group-fj34 started at 2022-11-24 09:00:32 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:16:01.010: INFO: 	Container kube-proxy ready: false, restart count 6
Nov 24 09:16:01.010: INFO: metadata-proxy-v0.1-rtz4q started at 2022-11-24 09:00:33 +0000 UTC (0+2 container statuses recorded)
Nov 24 09:16:01.010: INFO: 	Container metadata-proxy ready: true, restart count 0
Nov 24 09:16:01.010: INFO: 	Container prometheus-to-sd-exporter ready: true, restart count 0
Nov 24 09:16:01.010: INFO: pvc-volume-tester-5zg8r started at 2022-11-24 09:03:02 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:16:01.010: INFO: 	Container volume-tester ready: false, restart count 0
Nov 24 09:16:01.010: INFO: pvc-volume-tester-txtfw started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:16:01.010: INFO: 	Container volume-tester ready: false, restart count 0
Nov 24 09:16:01.010: INFO: csi-mockplugin-attacher-0 started at 2022-11-24 09:06:32 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:16:01.010: INFO: 	Container csi-attacher ready: false, restart count 5
Nov 24 09:16:01.010: INFO: netserver-2 started at 2022-11-24 09:11:29 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:16:01.010: INFO: 	Container webserver ready: true, restart count 1
Nov 24 09:16:01.010: INFO: ss2-1 started at 2022-11-24 09:11:32 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:16:01.010: INFO: 	Container webserver ready: true, restart count 3
Nov 24 09:16:01.010: INFO: csi-mockplugin-0 started at 2022-11-24 09:02:44 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:16:01.010: INFO: 	Container csi-provisioner ready: true, restart count 6
Nov 24 09:16:01.010: INFO: 	Container driver-registrar ready: true, restart count 6
Nov 24 09:16:01.010: INFO: 	Container mock ready: true, restart count 6
Nov 24 09:16:01.010: INFO: csi-mockplugin-resizer-0 started at 2022-11-24 09:02:44 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:16:01.010: INFO: 	Container csi-resizer ready: true, restart count 3
Nov 24 09:16:01.010: INFO: pod-2 started at 2022-11-24 09:13:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:16:01.010: INFO: 	Container donothing ready: true, restart count 0
Nov 24 09:16:01.010: INFO: hostexec started at 2022-11-24 09:11:35 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:16:01.010: INFO: 	Container agnhost-container ready: false, restart count 3
Nov 24 09:16:01.010: INFO: webhook-to-be-mutated started at 2022-11-24 09:13:54 +0000 UTC (1+1 container statuses recorded)
Nov 24 09:16:01.010: INFO: 	Init container webhook-added-init-container ready: false, restart count 0
Nov 24 09:16:01.010: INFO: 	Container example ready: false, restart count 0
Nov 24 09:16:01.010: INFO: csi-mockplugin-attacher-0 started at 2022-11-24 09:02:44 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:16:01.010: INFO: 	Container csi-attacher ready: false, restart count 4
Nov 24 09:16:01.010: INFO: pod-1 started at 2022-11-24 09:13:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:16:01.010: INFO: 	Container donothing ready: true, restart count 2
Nov 24 09:16:01.010: INFO: affinity-nodeport-ctqn8 started at 2022-11-24 09:11:11 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:16:01.010: INFO: 	Container affinity-nodeport ready: true, restart count 1
Nov 24 09:16:01.010: INFO: test-recreate-deployment-cff6dc657-bx9rn started at 2022-11-24 09:13:54 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:16:01.010: INFO: 	Container httpd ready: true, restart count 2
Nov 24 09:16:01.347: INFO: 
Latency metrics for node bootstrap-e2e-minion-group-fj34
[DeferCleanup (Each)] [sig-api-machinery] Discovery
  tear down framework | framework.go:193
STEP: Destroying namespace "discovery-7587" for this suite. 11/24/22 09:16:01.347

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-api-machinery] Discovery should validate PreferredVersion for each APIGroup [Conformance] 1m56s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sDiscovery\sshould\svalidate\sPreferredVersion\sfor\seach\sAPIGroup\s\[Conformance\]$'

test/e2e/framework/framework.go:241
k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc000370780)
	test/e2e/framework/framework.go:241 +0x96f
				[BeforeEach] [sig-api-machinery] Discovery
  set up framework | framework.go:178
STEP: Creating a kubernetes client 11/24/22 09:40:48.867
Nov 24 09:40:48.867: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Building a namespace api object, basename discovery 11/24/22 09:40:48.869
Nov 24 09:40:58.910: INFO: Unexpected error while creating namespace: Internal error occurred: resource quota evaluation timed out
Nov 24 09:41:10.951: INFO: Unexpected error while creating namespace: Internal error occurred: resource quota evaluation timed out
Nov 24 09:41:22.952: INFO: Unexpected error while creating namespace: Internal error occurred: resource quota evaluation timed out
Nov 24 09:41:34.951: INFO: Unexpected error while creating namespace: Internal error occurred: resource quota evaluation timed out
Nov 24 09:41:44.992: INFO: Unexpected error while creating namespace: Internal error occurred: resource quota evaluation timed out
Nov 24 09:41:44.992: INFO: Unexpected error: 
    <*errors.errorString | 0xc000201c70>: {
        s: "timed out waiting for the condition",
    }
Nov 24 09:41:44.992: FAIL: timed out waiting for the condition

Full Stack Trace
k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc000370780)
	test/e2e/framework/framework.go:241 +0x96f
[AfterEach] [sig-api-machinery] Discovery
  test/e2e/framework/node/init/init.go:32
Nov 24 09:41:44.993: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-api-machinery] Discovery
  dump namespaces | framework.go:196
STEP: dump namespace information after failure 11/24/22 09:42:45.033
[DeferCleanup (Each)] [sig-api-machinery] Discovery
  tear down framework | framework.go:193

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-api-machinery] Garbage collector should delete jobs and pods created by cronjob 3m29s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sGarbage\scollector\sshould\sdelete\sjobs\sand\spods\screated\sby\scronjob$'

test/e2e/apimachinery/garbage_collector.go:1174
k8s.io/kubernetes/test/e2e/apimachinery.glob..func13.11()
	test/e2e/apimachinery/garbage_collector.go:1174 +0x477
				[BeforeEach] [sig-api-machinery] Garbage collector
  set up framework | framework.go:178
STEP: Creating a kubernetes client 11/24/22 09:29:46.041
Nov 24 09:29:46.041: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Building a namespace api object, basename gc 11/24/22 09:29:46.042
STEP: Waiting for a default service account to be provisioned in namespace 11/24/22 09:30:40.505
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 11/24/22 09:30:40.586
[BeforeEach] [sig-api-machinery] Garbage collector
  test/e2e/framework/metrics/init/init.go:31
[It] should delete jobs and pods created by cronjob
  test/e2e/apimachinery/garbage_collector.go:1145
STEP: Create the cronjob 11/24/22 09:30:50.196
STEP: Wait for the CronJob to create new Job 11/24/22 09:30:50.348
STEP: Delete the cronjob 11/24/22 09:31:00.601
STEP: Verify if cronjob does not leave jobs nor pods behind 11/24/22 09:31:00.72
STEP: expected 0 pods, got 1 pods 11/24/22 09:31:01.116
Nov 24 09:32:02.524: FAIL: Failed to wait for all jobs and pods to be deleted: failed to list pods: Get "https://35.233.217.30/api/v1/namespaces/gc-8753/pods": stream error: stream ID 193; INTERNAL_ERROR; received from peer

Full Stack Trace
k8s.io/kubernetes/test/e2e/apimachinery.glob..func13.11()
	test/e2e/apimachinery/garbage_collector.go:1174 +0x477
[AfterEach] [sig-api-machinery] Garbage collector
  test/e2e/framework/node/init/init.go:32
Nov 24 09:32:02.525: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-api-machinery] Garbage collector
  test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-api-machinery] Garbage collector
  dump namespaces | framework.go:196
STEP: dump namespace information after failure 11/24/22 09:33:02.566
STEP: Collecting events from namespace "gc-8753". 11/24/22 09:33:02.566
STEP: Found 5 events. 11/24/22 09:33:02.618
Nov 24 09:33:02.618: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for simple-27821371-wqn68: { } Scheduled: Successfully assigned gc-8753/simple-27821371-wqn68 to bootstrap-e2e-minion-group-6m4q
Nov 24 09:33:02.618: INFO: At 2022-11-24 09:31:00 +0000 UTC - event for simple: {cronjob-controller } SuccessfulCreate: Created job simple-27821371
Nov 24 09:33:02.618: INFO: At 2022-11-24 09:31:00 +0000 UTC - event for simple-27821371: {job-controller } SuccessfulCreate: Created pod: simple-27821371-wqn68
Nov 24 09:33:02.618: INFO: At 2022-11-24 09:31:01 +0000 UTC - event for simple-27821371-wqn68: {kubelet bootstrap-e2e-minion-group-6m4q} FailedMount: MountVolume.SetUp failed for volume "kube-api-access-vlwbq" : failed to fetch token: pods "simple-27821371-wqn68" not found
Nov 24 09:33:02.618: INFO: At 2022-11-24 09:31:02 +0000 UTC - event for simple-27821371-wqn68: {kubelet bootstrap-e2e-minion-group-6m4q} FailedMount: MountVolume.SetUp failed for volume "kube-api-access-vlwbq" : failed to fetch token: serviceaccounts "default" is forbidden: User "system:node:bootstrap-e2e-minion-group-6m4q" cannot create resource "serviceaccounts/token" in API group "" in the namespace "gc-8753": no relationship found between node 'bootstrap-e2e-minion-group-6m4q' and this object
Nov 24 09:33:02.674: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Nov 24 09:33:02.674: INFO: 
Nov 24 09:33:06.945: INFO: 
Logging node info for node bootstrap-e2e-master
Nov 24 09:33:07.008: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master    57b53f45-775d-4de5-a4ff-420df60cf61e 13536 0 2022-11-24 09:00:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-24 09:00:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-11-24 09:00:50 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-11-24 09:00:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-11-24 09:33:06 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-serial-1-6/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3858374656 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3596230656 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-24 09:00:50 +0000 UTC,LastTransitionTime:2022-11-24 09:00:50 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-24 09:33:06 +0000 UTC,LastTransitionTime:2022-11-24 09:00:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-24 09:33:06 +0000 UTC,LastTransitionTime:2022-11-24 09:00:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-24 09:33:06 +0000 UTC,LastTransitionTime:2022-11-24 09:00:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-24 09:33:06 +0000 UTC,LastTransitionTime:2022-11-24 09:00:54 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:35.233.217.30,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-jkns-gce-serial-1-6.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-jkns-gce-serial-1-6.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:2380dd218709b39effceaa3da78bc7d6,SystemUUID:2380dd21-8709-b39e-ffce-aa3da78bc7d6,BootID:8a5acb5e-406f-47f0-bc85-bed589236d7d,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.44+45279654db87f4,KubeProxyVersion:v1.27.0-alpha.0.44+45279654db87f4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:135160275,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:124989753,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:57659704,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:2c111f004bec24888d8cfa2a812a38fb8341350abac67dcd0ac64e709dfe389c registry.k8s.io/kas-network-proxy/proxy-server:v0.0.33],SizeBytes:22020129,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 24 09:33:07.009: INFO: 
Logging kubelet events for node bootstrap-e2e-master
Nov 24 09:33:07.101: INFO: 
Logging pods the kubelet thinks is on node bootstrap-e2e-master
Nov 24 09:33:07.202: INFO: kube-apiserver-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:07.202: INFO: 	Container kube-apiserver ready: true, restart count 3
Nov 24 09:33:07.202: INFO: kube-controller-manager-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:07.202: INFO: 	Container kube-controller-manager ready: false, restart count 8
Nov 24 09:33:07.202: INFO: kube-scheduler-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:07.202: INFO: 	Container kube-scheduler ready: false, restart count 8
Nov 24 09:33:07.202: INFO: etcd-server-events-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:07.202: INFO: 	Container etcd-container ready: true, restart count 3
Nov 24 09:33:07.202: INFO: etcd-server-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:07.202: INFO: 	Container etcd-container ready: true, restart count 5
Nov 24 09:33:07.202: INFO: konnectivity-server-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:07.202: INFO: 	Container konnectivity-server-container ready: true, restart count 0
Nov 24 09:33:07.202: INFO: kube-addon-manager-bootstrap-e2e-master started at 2022-11-24 09:00:06 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:07.202: INFO: 	Container kube-addon-manager ready: true, restart count 3
Nov 24 09:33:07.202: INFO: l7-lb-controller-bootstrap-e2e-master started at 2022-11-24 09:00:07 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:07.202: INFO: 	Container l7-lb-controller ready: false, restart count 8
Nov 24 09:33:07.202: INFO: metadata-proxy-v0.1-dgq6b started at 2022-11-24 09:01:06 +0000 UTC (0+2 container statuses recorded)
Nov 24 09:33:07.202: INFO: 	Container metadata-proxy ready: true, restart count 0
Nov 24 09:33:07.202: INFO: 	Container prometheus-to-sd-exporter ready: true, restart count 0
Nov 24 09:33:07.479: INFO: 
Latency metrics for node bootstrap-e2e-master
Nov 24 09:33:07.479: INFO: 
Logging node info for node bootstrap-e2e-minion-group-0xkq
Nov 24 09:33:07.531: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-0xkq    34eb6b8a-d427-45c3-aa67-9f7aa0a1f8a1 13547 0 2022-11-24 09:00:32 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-0xkq kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-0xkq topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-5616":"bootstrap-e2e-minion-group-0xkq","csi-mock-csi-mock-volumes-8812":"bootstrap-e2e-minion-group-0xkq"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-11-24 09:00:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}}}} } {kubelet Update v1 2022-11-24 09:00:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-24 09:18:36 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {node-problem-detector Update v1 2022-11-24 09:30:39 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-24 09:33:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-serial-1-6/us-west1-b/bootstrap-e2e-minion-group-0xkq,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-24 09:30:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-24 09:30:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-24 09:30:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-24 09:30:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-24 09:30:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-24 09:30:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-24 09:30:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-24 09:00:50 +0000 UTC,LastTransitionTime:2022-11-24 09:00:50 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-24 09:29:53 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-24 09:29:53 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-24 09:29:53 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-24 09:29:53 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:34.145.99.248,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-0xkq.c.k8s-jkns-gce-serial-1-6.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-0xkq.c.k8s-jkns-gce-serial-1-6.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:23bcd2ca790827437c5cec98facdba94,SystemUUID:23bcd2ca-7908-2743-7c5c-ec98facdba94,BootID:84f5ff41-fbc9-4fdb-966f-19346788bdab,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.44+45279654db87f4,KubeProxyVersion:v1.27.0-alpha.0.44+45279654db87f4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:67201224,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/debian-base@sha256:ebda8587ec0f49eb88ee3a608ef018484908cbc5aa32556a0d78356088c185d4 registry.k8s.io/debian-base:v2.0.0],SizeBytes:21093264,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-5616^f895d0cb-6bd8-11ed-82b3-fe6d40909f02 kubernetes.io/csi/csi-hostpath-ephemeral-5616^f8bc8630-6bd8-11ed-82b3-fe6d40909f02],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-5616^f895d0cb-6bd8-11ed-82b3-fe6d40909f02,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-5616^f8bc8630-6bd8-11ed-82b3-fe6d40909f02,DevicePath:,},},Config:nil,},}
Nov 24 09:33:07.531: INFO: 
Logging kubelet events for node bootstrap-e2e-minion-group-0xkq
Nov 24 09:33:07.651: INFO: 
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-0xkq
Nov 24 09:33:08.119: INFO: netserver-0 started at 2022-11-24 09:04:04 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:08.119: INFO: 	Container webserver ready: false, restart count 10
Nov 24 09:33:08.119: INFO: csi-hostpathplugin-0 started at 2022-11-24 09:18:27 +0000 UTC (0+7 container statuses recorded)
Nov 24 09:33:08.119: INFO: 	Container csi-attacher ready: true, restart count 4
Nov 24 09:33:08.119: INFO: 	Container csi-provisioner ready: true, restart count 4
Nov 24 09:33:08.119: INFO: 	Container csi-resizer ready: true, restart count 4
Nov 24 09:33:08.119: INFO: 	Container csi-snapshotter ready: true, restart count 4
Nov 24 09:33:08.119: INFO: 	Container hostpath ready: true, restart count 4
Nov 24 09:33:08.119: INFO: 	Container liveness-probe ready: true, restart count 4
Nov 24 09:33:08.119: INFO: 	Container node-driver-registrar ready: true, restart count 4
Nov 24 09:33:08.119: INFO: kube-proxy-bootstrap-e2e-minion-group-0xkq started at 2022-11-24 09:00:32 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:08.119: INFO: 	Container kube-proxy ready: true, restart count 9
Nov 24 09:33:08.119: INFO: sample-webhook-deployment-865554f4d9-pngsn started at 2022-11-24 09:04:04 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:08.119: INFO: 	Container sample-webhook ready: true, restart count 10
Nov 24 09:33:08.119: INFO: csi-mockplugin-0 started at 2022-11-24 09:30:42 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:33:08.119: INFO: 	Container csi-provisioner ready: true, restart count 1
Nov 24 09:33:08.119: INFO: 	Container driver-registrar ready: true, restart count 1
Nov 24 09:33:08.119: INFO: 	Container mock ready: true, restart count 1
Nov 24 09:33:08.119: INFO: alpine-nnp-false-d237a6ae-3e11-402c-9f30-27adea86549e started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:08.119: INFO: 	Container alpine-nnp-false-d237a6ae-3e11-402c-9f30-27adea86549e ready: false, restart count 0
Nov 24 09:33:08.119: INFO: httpd started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:08.119: INFO: 	Container httpd ready: true, restart count 6
Nov 24 09:33:08.119: INFO: pod-secrets-6ef894cf-d4cc-4c12-a50d-3e49edaec470 started at 2022-11-24 09:07:37 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:33:08.119: INFO: 	Container creates-volume-test ready: false, restart count 0
Nov 24 09:33:08.119: INFO: 	Container dels-volume-test ready: false, restart count 0
Nov 24 09:33:08.119: INFO: 	Container upds-volume-test ready: false, restart count 0
Nov 24 09:33:08.119: INFO: ss2-0 started at 2022-11-24 09:18:51 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:08.119: INFO: 	Container webserver ready: true, restart count 2
Nov 24 09:33:08.119: INFO: inline-volume-tester-6w8qg started at 2022-11-24 09:18:36 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:08.119: INFO: 	Container csi-volume-tester ready: false, restart count 0
Nov 24 09:33:08.119: INFO: webserver-7d887d45b-zjrtz started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:08.119: INFO: 	Container httpd ready: true, restart count 3
Nov 24 09:33:08.119: INFO: sample-webhook-deployment-865554f4d9-qhln9 started at 2022-11-24 09:04:35 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:08.119: INFO: 	Container sample-webhook ready: false, restart count 10
Nov 24 09:33:08.119: INFO: test-apparmor-k8mtn started at 2022-11-24 09:18:35 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:08.119: INFO: 	Container test ready: false, restart count 0
Nov 24 09:33:08.119: INFO: pod-release-nm995 started at 2022-11-24 09:30:54 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:08.119: INFO: 	Container pod-release ready: false, restart count 0
Nov 24 09:33:08.119: INFO: pod-service-account-nomountsa-mountspec started at 2022-11-24 09:30:54 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:08.119: INFO: 	Container token-test ready: false, restart count 0
Nov 24 09:33:08.119: INFO: pod-terminate-status-2-1 started at <nil> (0+0 container statuses recorded)
Nov 24 09:33:08.119: INFO: httpd-deployment-6859889f88-cjjj8 started at 2022-11-24 09:04:51 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:08.119: INFO: 	Container httpd ready: true, restart count 7
Nov 24 09:33:08.119: INFO: external-provisioner-s6wpd started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:08.119: INFO: 	Container nfs-provisioner ready: true, restart count 8
Nov 24 09:33:08.119: INFO: pod-service-account-defaultsa started at 2022-11-24 09:30:54 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:08.119: INFO: 	Container token-test ready: true, restart count 0
Nov 24 09:33:08.119: INFO: pod-service-account-mountsa-mountspec started at 2022-11-24 09:30:54 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:08.119: INFO: 	Container token-test ready: false, restart count 0
Nov 24 09:33:08.119: INFO: busybox-readonly-true-0c7fd3e6-417c-4909-a077-6624310b4dfb started at 2022-11-24 09:04:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:08.119: INFO: 	Container busybox-readonly-true-0c7fd3e6-417c-4909-a077-6624310b4dfb ready: false, restart count 0
Nov 24 09:33:08.119: INFO: up-down-1-2f5z5 started at 2022-11-24 09:30:54 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:08.119: INFO: 	Container up-down-1 ready: true, restart count 0
Nov 24 09:33:08.119: INFO: pod-always-succeed1ac1248a-f95d-4ec8-add5-00fdfc91f740 started at 2022-11-24 09:04:11 +0000 UTC (1+1 container statuses recorded)
Nov 24 09:33:08.119: INFO: 	Init container foo ready: true, restart count 0
Nov 24 09:33:08.119: INFO: 	Container bar ready: false, restart count 0
Nov 24 09:33:08.119: INFO: pod-configmaps-e234b165-43bc-41ce-91d4-7789b97cbf1a started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:08.119: INFO: 	Container env-test ready: false, restart count 0
Nov 24 09:33:08.119: INFO: netserver-0 started at 2022-11-24 09:18:27 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:08.119: INFO: 	Container webserver ready: false, restart count 4
Nov 24 09:33:08.119: INFO: pod-service-account-mountsa started at 2022-11-24 09:30:54 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:08.119: INFO: 	Container token-test ready: false, restart count 0
Nov 24 09:33:08.119: INFO: netserver-0 started at 2022-11-24 09:04:49 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:08.119: INFO: 	Container webserver ready: false, restart count 9
Nov 24 09:33:08.119: INFO: pod-disruption-failure-ignore-0-r2g6r started at 2022-11-24 09:17:13 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:08.119: INFO: 	Container c ready: false, restart count 0
Nov 24 09:33:08.119: INFO: hostexec-bootstrap-e2e-minion-group-0xkq-pqnxr started at 2022-11-24 09:06:47 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:08.119: INFO: 	Container agnhost-container ready: true, restart count 3
Nov 24 09:33:08.119: INFO: pod-subpath-test-preprovisionedpv-tmmr started at 2022-11-24 09:07:37 +0000 UTC (2+1 container statuses recorded)
Nov 24 09:33:08.119: INFO: 	Init container init-volume-preprovisionedpv-tmmr ready: true, restart count 0
Nov 24 09:33:08.119: INFO: 	Init container test-init-volume-preprovisionedpv-tmmr ready: true, restart count 0
Nov 24 09:33:08.119: INFO: 	Container test-container-subpath-preprovisionedpv-tmmr ready: false, restart count 0
Nov 24 09:33:08.119: INFO: coredns-6d97d5ddb-q22hn started at 2022-11-24 09:00:58 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:08.119: INFO: 	Container coredns ready: false, restart count 10
Nov 24 09:33:08.119: INFO: test-pod-3 started at 2022-11-24 09:02:41 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:08.119: INFO: 	Container token-test ready: false, restart count 0
Nov 24 09:33:08.119: INFO: pod-service-account-nomountsa-nomountspec started at 2022-11-24 09:30:55 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:08.119: INFO: 	Container token-test ready: false, restart count 0
Nov 24 09:33:08.119: INFO: konnectivity-agent-nxcws started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:08.119: INFO: 	Container konnectivity-agent ready: false, restart count 8
Nov 24 09:33:08.119: INFO: pod-disruption-failure-ignore-3-d94v4 started at 2022-11-24 09:17:17 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:08.119: INFO: 	Container c ready: false, restart count 0
Nov 24 09:33:08.119: INFO: agnhost started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:08.119: INFO: 	Container agnhost ready: false, restart count 0
Nov 24 09:33:08.119: INFO: apparmor-loader-nf47q started at 2022-11-24 09:18:27 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:08.119: INFO: 	Container apparmor-loader ready: true, restart count 4
Nov 24 09:33:08.119: INFO: pod-handle-http-request started at 2022-11-24 09:30:56 +0000 UTC (0+2 container statuses recorded)
Nov 24 09:33:08.119: INFO: 	Container container-handle-http-request ready: true, restart count 0
Nov 24 09:33:08.119: INFO: 	Container container-handle-https-request ready: true, restart count 0
Nov 24 09:33:08.119: INFO: csi-mockplugin-attacher-0 started at 2022-11-24 09:30:42 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:08.119: INFO: 	Container csi-attacher ready: true, restart count 1
Nov 24 09:33:08.119: INFO: pod-disruption-failure-ignore-1-b8vdq started at 2022-11-24 09:17:13 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:08.119: INFO: 	Container c ready: false, restart count 0
Nov 24 09:33:08.119: INFO: hostexec-bootstrap-e2e-minion-group-0xkq-vtzpg started at 2022-11-24 09:18:35 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:08.119: INFO: 	Container agnhost-container ready: true, restart count 5
Nov 24 09:33:08.119: INFO: simpletest.rc-7x898 started at 2022-11-24 09:30:56 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:08.119: INFO: 	Container nginx ready: true, restart count 0
Nov 24 09:33:08.119: INFO: pod-subpath-test-preprovisionedpv-bchr started at 2022-11-24 09:07:37 +0000 UTC (1+1 container statuses recorded)
Nov 24 09:33:08.119: INFO: 	Init container init-volume-preprovisionedpv-bchr ready: true, restart count 0
Nov 24 09:33:08.119: INFO: 	Container test-container-subpath-preprovisionedpv-bchr ready: false, restart count 0
Nov 24 09:33:08.119: INFO: webserver-7d887d45b-b2lng started at 2022-11-24 09:10:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:08.119: INFO: 	Container httpd ready: true, restart count 7
Nov 24 09:33:08.119: INFO: pod-disruption-failure-ignore-1-8q4cc started at 2022-11-24 09:13:53 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:08.119: INFO: 	Container c ready: false, restart count 0
Nov 24 09:33:08.119: INFO: hostexec-bootstrap-e2e-minion-group-0xkq-l5lfz started at 2022-11-24 09:30:40 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:08.119: INFO: 	Container agnhost-container ready: true, restart count 1
Nov 24 09:33:08.119: INFO: pod-disruption-failure-ignore-2-m4qbn started at 2022-11-24 09:17:17 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:08.119: INFO: 	Container c ready: false, restart count 0
Nov 24 09:33:08.119: INFO: agnhost-host-aliases07dd0013-880a-43df-b65a-dd3cc866b1c6 started at 2022-11-24 09:04:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:08.119: INFO: 	Container agnhost-container ready: false, restart count 0
Nov 24 09:33:08.119: INFO: hostexec-bootstrap-e2e-minion-group-0xkq-gs72q started at 2022-11-24 09:06:42 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:08.119: INFO: 	Container agnhost-container ready: false, restart count 7
Nov 24 09:33:08.119: INFO: sample-webhook-deployment-865554f4d9-shnzq started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:08.119: INFO: 	Container sample-webhook ready: true, restart count 2
Nov 24 09:33:08.119: INFO: client-containers-73020471-75dc-486c-91d8-b2150c34f574 started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:08.119: INFO: 	Container agnhost-container ready: false, restart count 0
Nov 24 09:33:08.119: INFO: metadata-proxy-v0.1-jg8bk started at 2022-11-24 09:00:33 +0000 UTC (0+2 container statuses recorded)
Nov 24 09:33:08.119: INFO: 	Container metadata-proxy ready: true, restart count 0
Nov 24 09:33:08.119: INFO: 	Container prometheus-to-sd-exporter ready: true, restart count 0
Nov 24 09:33:08.119: INFO: busybox-e4175cec-5a98-457b-8d7a-fc687790f79e started at 2022-11-24 09:04:11 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:08.119: INFO: 	Container busybox ready: false, restart count 10
Nov 24 09:33:08.119: INFO: pod-disruption-failure-ignore-0-ngtgb started at 2022-11-24 09:13:53 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:08.119: INFO: 	Container c ready: false, restart count 0
Nov 24 09:33:08.119: INFO: csi-mockplugin-0 started at 2022-11-24 09:02:44 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:33:08.119: INFO: 	Container csi-provisioner ready: true, restart count 9
Nov 24 09:33:08.119: INFO: 	Container driver-registrar ready: true, restart count 9
Nov 24 09:33:08.119: INFO: 	Container mock ready: true, restart count 9
Nov 24 09:33:09.766: INFO: 
Latency metrics for node bootstrap-e2e-minion-group-0xkq
Nov 24 09:33:09.766: INFO: 
Logging node info for node bootstrap-e2e-minion-group-6m4q
Nov 24 09:33:09.813: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-6m4q    be4476db-4c35-4ea4-96f6-e1f0e7c12742 13541 0 2022-11-24 09:00:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-6m4q kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-6m4q topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-8753":"bootstrap-e2e-minion-group-6m4q","csi-hostpath-volume-expand-4427":"bootstrap-e2e-minion-group-6m4q","csi-mock-csi-mock-volumes-6588":"bootstrap-e2e-minion-group-6m4q"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-24 09:00:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-24 09:00:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-11-24 09:30:39 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {node-problem-detector Update v1 2022-11-24 09:30:43 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-24 09:33:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-serial-1-6/us-west1-b/bootstrap-e2e-minion-group-6m4q,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-24 09:30:43 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-24 09:30:43 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-24 09:30:43 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-24 09:30:43 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-24 09:30:43 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-24 09:30:43 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-24 09:30:43 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-24 09:00:50 +0000 UTC,LastTransitionTime:2022-11-24 09:00:50 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-24 09:33:06 +0000 UTC,LastTransitionTime:2022-11-24 09:00:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-24 09:33:06 +0000 UTC,LastTransitionTime:2022-11-24 09:00:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-24 09:33:06 +0000 UTC,LastTransitionTime:2022-11-24 09:00:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-24 09:33:06 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:35.247.58.118,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-6m4q.c.k8s-jkns-gce-serial-1-6.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-6m4q.c.k8s-jkns-gce-serial-1-6.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:7b2cc9e909d10f7df61b26e8aece9707,SystemUUID:7b2cc9e9-09d1-0f7d-f61b-26e8aece9707,BootID:64607970-cc6d-408c-9269-dff979065832,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.44+45279654db87f4,KubeProxyVersion:v1.27.0-alpha.0.44+45279654db87f4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:67201224,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 registry.k8s.io/sig-storage/snapshot-controller:v6.1.0],SizeBytes:22620891,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-7570^55118aeb-6bd7-11ed-8dba-2207550599a3 kubernetes.io/csi/csi-hostpath-ephemeral-8753^758a12fe-6bd7-11ed-b4fd-0e9a0f0cf363],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-8753^758a12fe-6bd7-11ed-b4fd-0e9a0f0cf363,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-7570^55118aeb-6bd7-11ed-8dba-2207550599a3,DevicePath:,},},Config:nil,},}
Nov 24 09:33:09.814: INFO: 
Logging kubelet events for node bootstrap-e2e-minion-group-6m4q
Nov 24 09:33:09.962: INFO: 
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-6m4q
Nov 24 09:33:10.747: INFO: pvc-volume-tester-8w74v started at 2022-11-24 09:07:38 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.747: INFO: 	Container volume-tester ready: false, restart count 0
Nov 24 09:33:10.747: INFO: webserver-7d887d45b-lr79x started at 2022-11-24 09:07:41 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.747: INFO: 	Container httpd ready: false, restart count 7
Nov 24 09:33:10.747: INFO: kube-proxy-bootstrap-e2e-minion-group-6m4q started at 2022-11-24 09:00:35 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.747: INFO: 	Container kube-proxy ready: false, restart count 8
Nov 24 09:33:10.747: INFO: netserver-1 started at 2022-11-24 09:04:04 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.747: INFO: 	Container webserver ready: false, restart count 9
Nov 24 09:33:10.747: INFO: inline-volume-tester-2k2tt started at 2022-11-24 09:18:27 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.747: INFO: 	Container csi-volume-tester ready: false, restart count 0
Nov 24 09:33:10.747: INFO: csi-hostpathplugin-0 started at 2022-11-24 09:06:47 +0000 UTC (0+7 container statuses recorded)
Nov 24 09:33:10.747: INFO: 	Container csi-attacher ready: false, restart count 8
Nov 24 09:33:10.747: INFO: 	Container csi-provisioner ready: false, restart count 8
Nov 24 09:33:10.747: INFO: 	Container csi-resizer ready: false, restart count 8
Nov 24 09:33:10.747: INFO: 	Container csi-snapshotter ready: false, restart count 8
Nov 24 09:33:10.747: INFO: 	Container hostpath ready: false, restart count 8
Nov 24 09:33:10.747: INFO: 	Container liveness-probe ready: false, restart count 8
Nov 24 09:33:10.747: INFO: 	Container node-driver-registrar ready: false, restart count 8
Nov 24 09:33:10.747: INFO: csi-mockplugin-0 started at 2022-11-24 09:30:45 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:33:10.747: INFO: 	Container csi-provisioner ready: true, restart count 0
Nov 24 09:33:10.747: INFO: 	Container driver-registrar ready: true, restart count 0
Nov 24 09:33:10.747: INFO: 	Container mock ready: true, restart count 0
Nov 24 09:33:10.747: INFO: csi-hostpathplugin-0 started at 2022-11-24 09:07:37 +0000 UTC (0+7 container statuses recorded)
Nov 24 09:33:10.747: INFO: 	Container csi-attacher ready: true, restart count 8
Nov 24 09:33:10.747: INFO: 	Container csi-provisioner ready: true, restart count 8
Nov 24 09:33:10.747: INFO: 	Container csi-resizer ready: true, restart count 8
Nov 24 09:33:10.747: INFO: 	Container csi-snapshotter ready: true, restart count 8
Nov 24 09:33:10.747: INFO: 	Container hostpath ready: true, restart count 8
Nov 24 09:33:10.747: INFO: 	Container liveness-probe ready: true, restart count 8
Nov 24 09:33:10.747: INFO: 	Container node-driver-registrar ready: true, restart count 7
Nov 24 09:33:10.747: INFO: pod-service-account-nomountsa started at 2022-11-24 09:30:54 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.747: INFO: 	Container token-test ready: false, restart count 0
Nov 24 09:33:10.747: INFO: pod-service-account-defaultsa-mountspec started at 2022-11-24 09:30:54 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.747: INFO: 	Container token-test ready: false, restart count 0
Nov 24 09:33:10.747: INFO: pod-service-account-mountsa-nomountspec started at 2022-11-24 09:30:55 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.747: INFO: 	Container token-test ready: false, restart count 0
Nov 24 09:33:10.747: INFO: webserver-pod started at 2022-11-24 09:04:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.747: INFO: 	Container agnhost ready: true, restart count 5
Nov 24 09:33:10.747: INFO: l7-default-backend-8549d69d99-762zc started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.747: INFO: 	Container default-http-backend ready: true, restart count 0
Nov 24 09:33:10.747: INFO: konnectivity-agent-k4jdw started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.747: INFO: 	Container konnectivity-agent ready: false, restart count 8
Nov 24 09:33:10.747: INFO: httpd-deployment-6859889f88-22w25 started at 2022-11-24 09:04:51 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.747: INFO: 	Container httpd ready: false, restart count 6
Nov 24 09:33:10.747: INFO: my-hostname-private-ae51c3f4-8897-433b-b3ed-7b3c0ce69bc4-9dsrv started at 2022-11-24 09:18:27 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.747: INFO: 	Container my-hostname-private-ae51c3f4-8897-433b-b3ed-7b3c0ce69bc4 ready: true, restart count 5
Nov 24 09:33:10.747: INFO: metadata-proxy-v0.1-lwtk4 started at 2022-11-24 09:00:35 +0000 UTC (0+2 container statuses recorded)
Nov 24 09:33:10.747: INFO: 	Container metadata-proxy ready: true, restart count 0
Nov 24 09:33:10.747: INFO: 	Container prometheus-to-sd-exporter ready: true, restart count 0
Nov 24 09:33:10.747: INFO: kube-dns-autoscaler-5f6455f985-hxtg5 started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.747: INFO: 	Container autoscaler ready: false, restart count 9
Nov 24 09:33:10.747: INFO: pod-configmaps-6929437e-13e1-4a93-b7fa-e8ec8d7c7138 started at 2022-11-24 09:04:04 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:33:10.747: INFO: 	Container createcm-volume-test ready: false, restart count 0
Nov 24 09:33:10.747: INFO: 	Container delcm-volume-test ready: false, restart count 0
Nov 24 09:33:10.747: INFO: 	Container updcm-volume-test ready: false, restart count 0
Nov 24 09:33:10.747: INFO: pod-client started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.747: INFO: 	Container pod-client ready: false, restart count 5
Nov 24 09:33:10.747: INFO: external-provisioner-7zgkv started at 2022-11-24 09:30:57 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.747: INFO: 	Container nfs-provisioner ready: true, restart count 0
Nov 24 09:33:10.747: INFO: csi-hostpathplugin-0 started at 2022-11-24 09:30:59 +0000 UTC (0+7 container statuses recorded)
Nov 24 09:33:10.747: INFO: 	Container csi-attacher ready: true, restart count 1
Nov 24 09:33:10.747: INFO: 	Container csi-provisioner ready: true, restart count 1
Nov 24 09:33:10.747: INFO: 	Container csi-resizer ready: true, restart count 1
Nov 24 09:33:10.747: INFO: 	Container csi-snapshotter ready: true, restart count 1
Nov 24 09:33:10.747: INFO: 	Container hostpath ready: true, restart count 1
Nov 24 09:33:10.747: INFO: 	Container liveness-probe ready: true, restart count 1
Nov 24 09:33:10.747: INFO: 	Container node-driver-registrar ready: true, restart count 1
Nov 24 09:33:10.747: INFO: pod-release-42mdk started at 2022-11-24 09:31:00 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.747: INFO: 	Container pod-release ready: false, restart count 0
Nov 24 09:33:10.747: INFO: netserver-1 started at 2022-11-24 09:04:49 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.747: INFO: 	Container webserver ready: false, restart count 8
Nov 24 09:33:10.747: INFO: inline-volume-tester-vc928 started at 2022-11-24 09:07:38 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.747: INFO: 	Container csi-volume-tester ready: false, restart count 0
Nov 24 09:33:10.747: INFO: pod-subpath-test-secret-56vz started at 2022-11-24 09:04:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.747: INFO: 	Container test-container-subpath-secret-56vz ready: false, restart count 0
Nov 24 09:33:10.747: INFO: inline-volume-tester-rr76m started at 2022-11-24 09:07:45 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.747: INFO: 	Container csi-volume-tester ready: false, restart count 0
Nov 24 09:33:10.747: INFO: csi-mockplugin-attacher-0 started at 2022-11-24 09:30:45 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.747: INFO: 	Container csi-attacher ready: true, restart count 0
Nov 24 09:33:10.747: INFO: simpletest.rc-gpbmh started at 2022-11-24 09:30:56 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.747: INFO: 	Container nginx ready: true, restart count 0
Nov 24 09:33:10.747: INFO: csi-mockplugin-0 started at 2022-11-24 09:06:45 +0000 UTC (0+4 container statuses recorded)
Nov 24 09:33:10.747: INFO: 	Container busybox ready: false, restart count 6
Nov 24 09:33:10.747: INFO: 	Container csi-provisioner ready: false, restart count 7
Nov 24 09:33:10.747: INFO: 	Container driver-registrar ready: false, restart count 7
Nov 24 09:33:10.747: INFO: 	Container mock ready: false, restart count 7
Nov 24 09:33:10.747: INFO: hostexec-bootstrap-e2e-minion-group-6m4q-qcs7x started at 2022-11-24 09:30:53 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.747: INFO: 	Container agnhost-container ready: true, restart count 0
Nov 24 09:33:10.747: INFO: up-down-1-zxx6f started at 2022-11-24 09:30:54 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.747: INFO: 	Container up-down-1 ready: true, restart count 0
Nov 24 09:33:10.747: INFO: hostexec-bootstrap-e2e-minion-group-6m4q-h8v54 started at 2022-11-24 09:04:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.747: INFO: 	Container agnhost-container ready: true, restart count 7
Nov 24 09:33:10.747: INFO: pod-service-account-defaultsa-nomountspec started at 2022-11-24 09:30:55 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.747: INFO: 	Container token-test ready: true, restart count 0
Nov 24 09:33:10.747: INFO: coredns-6d97d5ddb-9z7tn started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.747: INFO: 	Container coredns ready: false, restart count 10
Nov 24 09:33:10.747: INFO: volume-snapshot-controller-0 started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.747: INFO: 	Container volume-snapshot-controller ready: true, restart count 7
Nov 24 09:33:10.747: INFO: ss2-2 started at 2022-11-24 09:18:27 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.747: INFO: 	Container webserver ready: false, restart count 5
Nov 24 09:33:10.747: INFO: liveness-285ed85f-af70-4221-a9ae-9d3784882e9c started at 2022-11-24 09:06:27 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.747: INFO: 	Container agnhost-container ready: true, restart count 4
Nov 24 09:33:10.747: INFO: pod-0 started at 2022-11-24 09:04:46 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.747: INFO: 	Container donothing ready: true, restart count 5
Nov 24 09:33:10.747: INFO: netserver-1 started at 2022-11-24 09:18:27 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.747: INFO: 	Container webserver ready: false, restart count 7
Nov 24 09:33:10.747: INFO: pod-client started at 2022-11-24 09:33:02 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.747: INFO: 	Container pod-client ready: false, restart count 0
Nov 24 09:33:12.913: INFO: 
Latency metrics for node bootstrap-e2e-minion-group-6m4q
Nov 24 09:33:12.913: INFO: 
Logging node info for node bootstrap-e2e-minion-group-fj34
Nov 24 09:33:12.959: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-fj34    26b0a38a-1259-4217-8b0f-bfa92e43b570 13594 0 2022-11-24 09:00:32 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-fj34 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-fj34 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-4261":"bootstrap-e2e-minion-group-fj34","csi-hostpath-ephemeral-4353":"bootstrap-e2e-minion-group-fj34","csi-hostpath-ephemeral-9395":"bootstrap-e2e-minion-group-fj34","csi-mock-csi-mock-volumes-9394":"bootstrap-e2e-minion-group-fj34"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-11-24 09:00:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kubelet Update v1 2022-11-24 09:00:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-24 09:10:50 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {node-problem-detector Update v1 2022-11-24 09:30:41 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-24 09:33:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-serial-1-6/us-west1-b/bootstrap-e2e-minion-group-fj34,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-24 09:30:41 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-24 09:30:41 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-24 09:30:41 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-24 09:30:41 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-24 09:30:41 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-24 09:30:41 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-24 09:30:41 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-24 09:00:50 +0000 UTC,LastTransitionTime:2022-11-24 09:00:50 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-24 09:33:05 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-24 09:33:05 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-24 09:33:05 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-24 09:33:05 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.82.73.153,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-fj34.c.k8s-jkns-gce-serial-1-6.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-fj34.c.k8s-jkns-gce-serial-1-6.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:557b5201a29dc5c84dc79b98af6f523a,SystemUUID:557b5201-a29d-c5c8-4dc7-9b98af6f523a,BootID:0f4289cb-5f88-4ee3-b552-b99fcc030f54,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.44+45279654db87f4,KubeProxyVersion:v1.27.0-alpha.0.44+45279654db87f4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:67201224,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:c0ddb4794bc8a3631e3373015f913c00b230ee54f87bde9ade195b3a3415c60f registry.k8s.io/build-image/distroless-iptables:v0.1.2],SizeBytes:7685585,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-1806^5a1ffb25-6bd7-11ed-9365-7e36e6fec9d2 kubernetes.io/csi/csi-mock-csi-mock-volumes-9231^cbf4a4b9-6bd6-11ed-88e7-326e345b4078],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-9231^cbf4a4b9-6bd6-11ed-88e7-326e345b4078,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-1806^5a1ffb25-6bd7-11ed-9365-7e36e6fec9d2,DevicePath:,},},Config:nil,},}
Nov 24 09:33:12.960: INFO: 
Logging kubelet events for node bootstrap-e2e-minion-group-fj34
Nov 24 09:33:13.009: INFO: 
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-fj34
Nov 24 09:33:13.094: INFO: test-pod-1 started at 2022-11-24 09:02:40 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.094: INFO: 	Container token-test ready: false, restart count 0
Nov 24 09:33:13.094: INFO: hostexec-bootstrap-e2e-minion-group-fj34-9j92x started at 2022-11-24 09:04:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.094: INFO: 	Container agnhost-container ready: true, restart count 5
Nov 24 09:33:13.094: INFO: httpd-deployment-6859889f88-whrb9 started at 2022-11-24 09:05:53 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.094: INFO: 	Container httpd ready: false, restart count 7
Nov 24 09:33:13.094: INFO: csi-mockplugin-0 started at 2022-11-24 09:06:32 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:33:13.094: INFO: 	Container csi-provisioner ready: false, restart count 7
Nov 24 09:33:13.094: INFO: 	Container driver-registrar ready: false, restart count 7
Nov 24 09:33:13.094: INFO: 	Container mock ready: false, restart count 7
Nov 24 09:33:13.094: INFO: webserver-7d887d45b-g8gjr started at 2022-11-24 09:07:41 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.094: INFO: 	Container httpd ready: false, restart count 7
Nov 24 09:33:13.094: INFO: test-host-network-pod started at 2022-11-24 09:30:47 +0000 UTC (0+2 container statuses recorded)
Nov 24 09:33:13.094: INFO: 	Container busybox-1 ready: false, restart count 2
Nov 24 09:33:13.094: INFO: 	Container busybox-2 ready: false, restart count 2
Nov 24 09:33:13.094: INFO: metrics-server-v0.5.2-867b8754b9-lprlm started at 2022-11-24 09:01:14 +0000 UTC (0+2 container statuses recorded)
Nov 24 09:33:13.094: INFO: 	Container metrics-server ready: false, restart count 9
Nov 24 09:33:13.094: INFO: 	Container metrics-server-nanny ready: false, restart count 9
Nov 24 09:33:13.094: INFO: netserver-2 started at 2022-11-24 09:04:04 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.094: INFO: 	Container webserver ready: true, restart count 7
Nov 24 09:33:13.094: INFO: csi-mockplugin-0 started at 2022-11-24 09:02:44 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:33:13.094: INFO: 	Container csi-provisioner ready: true, restart count 6
Nov 24 09:33:13.094: INFO: 	Container driver-registrar ready: true, restart count 6
Nov 24 09:33:13.094: INFO: 	Container mock ready: true, restart count 6
Nov 24 09:33:13.094: INFO: execpodpxn7d started at 2022-11-24 09:18:55 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.094: INFO: 	Container agnhost-container ready: true, restart count 1
Nov 24 09:33:13.094: INFO: netserver-2 started at 2022-11-24 09:04:49 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.094: INFO: 	Container webserver ready: true, restart count 9
Nov 24 09:33:13.094: INFO: csi-mockplugin-attacher-0 started at 2022-11-24 09:02:44 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.094: INFO: 	Container csi-attacher ready: true, restart count 7
Nov 24 09:33:13.094: INFO: external-provisioner-br7l6 started at 2022-11-24 09:13:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.094: INFO: 	Container nfs-provisioner ready: false, restart count 6
Nov 24 09:33:13.094: INFO: csi-hostpathplugin-0 started at 2022-11-24 09:18:54 +0000 UTC (0+7 container statuses recorded)
Nov 24 09:33:13.094: INFO: 	Container csi-attacher ready: true, restart count 1
Nov 24 09:33:13.094: INFO: 	Container csi-provisioner ready: true, restart count 1
Nov 24 09:33:13.094: INFO: 	Container csi-resizer ready: true, restart count 1
Nov 24 09:33:13.094: INFO: 	Container csi-snapshotter ready: true, restart count 1
Nov 24 09:33:13.094: INFO: 	Container hostpath ready: true, restart count 1
Nov 24 09:33:13.094: INFO: 	Container liveness-probe ready: true, restart count 1
Nov 24 09:33:13.094: INFO: 	Container node-driver-registrar ready: true, restart count 1
Nov 24 09:33:13.094: INFO: labelsupdate8c301c33-dc6a-450c-b014-b58592fac366 started at 2022-11-24 09:30:43 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.094: INFO: 	Container client-container ready: false, restart count 0
Nov 24 09:33:13.094: INFO: up-down-1-l6klw started at 2022-11-24 09:30:54 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.094: INFO: 	Container up-down-1 ready: true, restart count 2
Nov 24 09:33:13.094: INFO: konnectivity-agent-jjqhp started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.094: INFO: 	Container konnectivity-agent ready: false, restart count 8
Nov 24 09:33:13.094: INFO: pod-subpath-test-preprovisionedpv-bvlk started at 2022-11-24 09:07:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.094: INFO: 	Container test-container-subpath-preprovisionedpv-bvlk ready: false, restart count 0
Nov 24 09:33:13.094: INFO: host-test-container-pod started at 2022-11-24 09:24:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.094: INFO: 	Container agnhost-container ready: true, restart count 1
Nov 24 09:33:13.094: INFO: ss2-1 started at 2022-11-24 09:18:38 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.094: INFO: 	Container webserver ready: true, restart count 7
Nov 24 09:33:13.094: INFO: kube-proxy-bootstrap-e2e-minion-group-fj34 started at 2022-11-24 09:00:32 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.094: INFO: 	Container kube-proxy ready: false, restart count 9
Nov 24 09:33:13.094: INFO: metadata-proxy-v0.1-rtz4q started at 2022-11-24 09:00:33 +0000 UTC (0+2 container statuses recorded)
Nov 24 09:33:13.094: INFO: 	Container metadata-proxy ready: true, restart count 0
Nov 24 09:33:13.094: INFO: 	Container prometheus-to-sd-exporter ready: true, restart count 0
Nov 24 09:33:13.094: INFO: pvc-volume-tester-5zg8r started at 2022-11-24 09:03:02 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.094: INFO: 	Container volume-tester ready: false, restart count 0
Nov 24 09:33:13.094: INFO: pvc-volume-tester-txtfw started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.094: INFO: 	Container volume-tester ready: false, restart count 0
Nov 24 09:33:13.094: INFO: csi-mockplugin-attacher-0 started at 2022-11-24 09:06:32 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.094: INFO: 	Container csi-attacher ready: false, restart count 10
Nov 24 09:33:13.094: INFO: backofflimit-nvwhc started at 2022-11-24 09:30:44 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.094: INFO: 	Container c ready: false, restart count 0
Nov 24 09:33:13.094: INFO: netserver-2 started at 2022-11-24 09:18:27 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.094: INFO: 	Container webserver ready: false, restart count 5
Nov 24 09:33:13.094: INFO: pod-1 started at 2022-11-24 09:30:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.094: INFO: 	Container agnhost-container ready: false, restart count 0
Nov 24 09:33:13.094: INFO: csi-mockplugin-0 started at 2022-11-24 09:02:44 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:33:13.094: INFO: 	Container csi-provisioner ready: false, restart count 8
Nov 24 09:33:13.094: INFO: 	Container driver-registrar ready: false, restart count 8
Nov 24 09:33:13.094: INFO: 	Container mock ready: false, restart count 8
Nov 24 09:33:13.094: INFO: csi-mockplugin-resizer-0 started at 2022-11-24 09:02:44 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.094: INFO: 	Container csi-resizer ready: true, restart count 7
Nov 24 09:33:13.094: INFO: csi-hostpathplugin-0 started at 2022-11-24 09:30:57 +0000 UTC (0+7 container statuses recorded)
Nov 24 09:33:13.094: INFO: 	Container csi-attacher ready: true, restart count 4
Nov 24 09:33:13.094: INFO: 	Container csi-provisioner ready: true, restart count 4
Nov 24 09:33:13.094: INFO: 	Container csi-resizer ready: true, restart count 4
Nov 24 09:33:13.094: INFO: 	Container csi-snapshotter ready: true, restart count 4
Nov 24 09:33:13.094: INFO: 	Container hostpath ready: true, restart count 4
Nov 24 09:33:13.094: INFO: 	Container liveness-probe ready: true, restart count 4
Nov 24 09:33:13.094: INFO: 	Container node-driver-registrar ready: true, restart count 4
Nov 24 09:33:13.094: INFO: hostexec-bootstrap-e2e-minion-group-fj34-z7grr started at 2022-11-24 09:30:53 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.094: INFO: 	Container agnhost-container ready: true, restart count 3
Nov 24 09:33:13.094: INFO: csi-mockplugin-attacher-0 started at 2022-11-24 09:02:44 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.094: INFO: 	Container csi-attacher ready: false, restart count 7
Nov 24 09:33:13.094: INFO: test-pod started at 2022-11-24 09:30:45 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:33:13.094: INFO: 	Container busybox-1 ready: true, restart count 0
Nov 24 09:33:13.094: INFO: 	Container busybox-2 ready: true, restart count 0
Nov 24 09:33:13.094: INFO: 	Container busybox-3 ready: true, restart count 0
Nov 24 09:33:13.094: INFO: update-demo-nautilus-56j4t started at 2022-11-24 09:18:35 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.094: INFO: 	Container update-demo ready: true, restart count 4
Nov 24 09:33:13.094: INFO: apparmor-loader-lq5ht started at 2022-11-24 09:30:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.094: INFO: 	Container apparmor-loader ready: true, restart count 0
Nov 24 09:33:13.094: INFO: csi-hostpathplugin-0 started at 2022-11-24 09:30:51 +0000 UTC (0+7 container statuses recorded)
Nov 24 09:33:13.094: INFO: 	Container csi-attacher ready: true, restart count 2
Nov 24 09:33:13.094: INFO: 	Container csi-provisioner ready: true, restart count 2
Nov 24 09:33:13.094: INFO: 	Container csi-resizer ready: true, restart count 2
Nov 24 09:33:13.094: INFO: 	Container csi-snapshotter ready: true, restart count 2
Nov 24 09:33:13.094: INFO: 	Container hostpath ready: true, restart count 2
Nov 24 09:33:13.094: INFO: 	Container liveness-probe ready: true, restart count 2
Nov 24 09:33:13.094: INFO: 	Container node-driver-registrar ready: true, restart count 2
Nov 24 09:33:13.094: INFO: test-pod-2 started at 2022-11-24 09:02:40 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.094: INFO: 	Container token-test ready: false, restart count 0
Nov 24 09:33:13.094: INFO: csi-hostpathplugin-0 started at 2022-11-24 09:03:06 +0000 UTC (0+7 container statuses recorded)
Nov 24 09:33:13.094: INFO: 	Container csi-attacher ready: true, restart count 6
Nov 24 09:33:13.094: INFO: 	Container csi-provisioner ready: true, restart count 6
Nov 24 09:33:13.094: INFO: 	Container csi-resizer ready: true, restart count 6
Nov 24 09:33:13.094: INFO: 	Container csi-snapshotter ready: true, restart count 6
Nov 24 09:33:13.094: INFO: 	Container hostpath ready: true, restart count 6
Nov 24 09:33:13.094: INFO: 	Container liveness-probe ready: true, restart count 6
Nov 24 09:33:13.094: INFO: 	Container node-driver-registrar ready: true, restart count 6
Nov 24 09:33:13.094: INFO: hostexec-bootstrap-e2e-minion-group-fj34-z4nnm started at 2022-11-24 09:06:46 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.094: INFO: 	Container agnhost-container ready: true, restart count 9
Nov 24 09:33:13.094: INFO: pod-subpath-test-inlinevolume-mcdr started at 2022-11-24 09:04:49 +0000 UTC (2+1 container statuses recorded)
Nov 24 09:33:13.094: INFO: 	Init container init-volume-inlinevolume-mcdr ready: true, restart count 0
Nov 24 09:33:13.094: INFO: 	Init container test-init-volume-inlinevolume-mcdr ready: true, restart count 0
Nov 24 09:33:13.094: INFO: 	Container test-container-subpath-inlinevolume-mcdr ready: false, restart count 0
Nov 24 09:33:13.094: INFO: test-container-pod started at 2022-11-24 09:24:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.094: INFO: 	Container webserver ready: true, restart count 2
Nov 24 09:33:13.094: INFO: hostexec-bootstrap-e2e-minion-group-fj34-2qzg9 started at 2022-11-24 09:30:53 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.094: INFO: 	Container agnhost-container ready: true, restart count 2
Nov 24 09:33:15.574: INFO: 
Latency metrics for node bootstrap-e2e-minion-group-fj34
[DeferCleanup (Each)] [sig-api-machinery] Garbage collector
  tear down framework | framework.go:193
STEP: Destroying namespace "gc-8753" for this suite. 11/24/22 09:33:15.575

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-api-machinery] Garbage collector should not be blocked by dependency circle [Conformance] 30s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sGarbage\scollector\sshould\snot\sbe\sblocked\sby\sdependency\scircle\s\[Conformance\]$'

test/e2e/framework/framework.go:241
k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc000152ff0)
	test/e2e/framework/framework.go:241 +0x96f
				[BeforeEach] [sig-api-machinery] Garbage collector
  set up framework | framework.go:178
STEP: Creating a kubernetes client 11/24/22 09:24:51.157
Nov 24 09:24:51.157: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Building a namespace api object, basename gc 11/24/22 09:24:51.158
Nov 24 09:24:51.198: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:24:53.238: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:24:55.237: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:24:57.238: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:24:59.238: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:25:01.238: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:25:03.237: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:25:05.237: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:25:07.237: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:25:09.238: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:25:11.238: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:25:13.237: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:25:15.238: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:25:17.237: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:25:19.238: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:25:21.237: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:25:21.277: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:25:21.277: INFO: Unexpected error: 
    <*errors.errorString | 0xc0001ffa50>: {
        s: "timed out waiting for the condition",
    }
Nov 24 09:25:21.277: FAIL: timed out waiting for the condition

Full Stack Trace
k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc000152ff0)
	test/e2e/framework/framework.go:241 +0x96f
[AfterEach] [sig-api-machinery] Garbage collector
  test/e2e/framework/node/init/init.go:32
Nov 24 09:25:21.277: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-api-machinery] Garbage collector
  dump namespaces | framework.go:196
STEP: dump namespace information after failure 11/24/22 09:25:21.317
[DeferCleanup (Each)] [sig-api-machinery] Garbage collector
  tear down framework | framework.go:193

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-api-machinery] Garbage collector should not delete dependents that have both valid owner and owner that's waiting for dependents to be deleted [Conformance] 2m21s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sGarbage\scollector\sshould\snot\sdelete\sdependents\sthat\shave\sboth\svalid\sowner\sand\sowner\sthat\'s\swaiting\sfor\sdependents\sto\sbe\sdeleted\s\[Conformance\]$'

test/e2e/framework/framework.go:241
k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc000d9c690)
	test/e2e/framework/framework.go:241 +0x96f
				[BeforeEach] [sig-api-machinery] Garbage collector
  set up framework | framework.go:178
STEP: Creating a kubernetes client 11/24/22 09:25:19.658
Nov 24 09:25:19.658: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Building a namespace api object, basename gc 11/24/22 09:25:19.66
Nov 24 09:25:19.699: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:25:21.739: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:25:23.739: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:25:25.739: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:25:27.739: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:25:29.739: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:25:31.739: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:27:37.267: INFO: Unexpected error: 
    <*fmt.wrapError | 0xc0052fa060>: {
        msg: "wait for service account \"default\" in namespace \"gc-2598\": timed out waiting for the condition",
        err: <*errors.errorString | 0xc0001ffa30>{
            s: "timed out waiting for the condition",
        },
    }
Nov 24 09:27:37.267: FAIL: wait for service account "default" in namespace "gc-2598": timed out waiting for the condition

Full Stack Trace
k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc000d9c690)
	test/e2e/framework/framework.go:241 +0x96f
[AfterEach] [sig-api-machinery] Garbage collector
  test/e2e/framework/node/init/init.go:32
Nov 24 09:27:37.267: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-api-machinery] Garbage collector
  dump namespaces | framework.go:196
STEP: dump namespace information after failure 11/24/22 09:27:37.352
STEP: Collecting events from namespace "gc-2598". 11/24/22 09:27:37.352
STEP: Found 0 events. 11/24/22 09:27:37.393
Nov 24 09:27:37.433: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Nov 24 09:27:37.433: INFO: 
Nov 24 09:27:37.480: INFO: 
Logging node info for node bootstrap-e2e-master
Nov 24 09:27:37.525: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master    57b53f45-775d-4de5-a4ff-420df60cf61e 12044 0 2022-11-24 09:00:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-24 09:00:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-11-24 09:00:50 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-11-24 09:00:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-11-24 09:26:48 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-serial-1-6/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3858374656 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3596230656 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-24 09:00:50 +0000 UTC,LastTransitionTime:2022-11-24 09:00:50 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-24 09:26:48 +0000 UTC,LastTransitionTime:2022-11-24 09:00:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-24 09:26:48 +0000 UTC,LastTransitionTime:2022-11-24 09:00:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-24 09:26:48 +0000 UTC,LastTransitionTime:2022-11-24 09:00:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-24 09:26:48 +0000 UTC,LastTransitionTime:2022-11-24 09:00:54 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:35.233.217.30,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-jkns-gce-serial-1-6.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-jkns-gce-serial-1-6.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:2380dd218709b39effceaa3da78bc7d6,SystemUUID:2380dd21-8709-b39e-ffce-aa3da78bc7d6,BootID:8a5acb5e-406f-47f0-bc85-bed589236d7d,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.44+45279654db87f4,KubeProxyVersion:v1.27.0-alpha.0.44+45279654db87f4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:135160275,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:124989753,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:57659704,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:2c111f004bec24888d8cfa2a812a38fb8341350abac67dcd0ac64e709dfe389c registry.k8s.io/kas-network-proxy/proxy-server:v0.0.33],SizeBytes:22020129,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 24 09:27:37.525: INFO: 
Logging kubelet events for node bootstrap-e2e-master
Nov 24 09:27:37.588: INFO: 
Logging pods the kubelet thinks is on node bootstrap-e2e-master
Nov 24 09:27:37.697: INFO: kube-apiserver-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:37.697: INFO: 	Container kube-apiserver ready: true, restart count 3
Nov 24 09:27:37.697: INFO: kube-controller-manager-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:37.697: INFO: 	Container kube-controller-manager ready: false, restart count 7
Nov 24 09:27:37.697: INFO: kube-scheduler-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:37.697: INFO: 	Container kube-scheduler ready: false, restart count 7
Nov 24 09:27:37.697: INFO: etcd-server-events-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:37.697: INFO: 	Container etcd-container ready: true, restart count 3
Nov 24 09:27:37.697: INFO: etcd-server-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:37.697: INFO: 	Container etcd-container ready: true, restart count 3
Nov 24 09:27:37.697: INFO: konnectivity-server-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:37.697: INFO: 	Container konnectivity-server-container ready: true, restart count 0
Nov 24 09:27:37.697: INFO: kube-addon-manager-bootstrap-e2e-master started at 2022-11-24 09:00:06 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:37.697: INFO: 	Container kube-addon-manager ready: true, restart count 2
Nov 24 09:27:37.697: INFO: l7-lb-controller-bootstrap-e2e-master started at 2022-11-24 09:00:07 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:37.697: INFO: 	Container l7-lb-controller ready: false, restart count 7
Nov 24 09:27:37.697: INFO: metadata-proxy-v0.1-dgq6b started at 2022-11-24 09:01:06 +0000 UTC (0+2 container statuses recorded)
Nov 24 09:27:37.697: INFO: 	Container metadata-proxy ready: true, restart count 0
Nov 24 09:27:37.697: INFO: 	Container prometheus-to-sd-exporter ready: true, restart count 0
Nov 24 09:27:38.636: INFO: 
Latency metrics for node bootstrap-e2e-master
Nov 24 09:27:38.636: INFO: 
Logging node info for node bootstrap-e2e-minion-group-0xkq
Nov 24 09:27:38.732: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-0xkq    34eb6b8a-d427-45c3-aa67-9f7aa0a1f8a1 11953 0 2022-11-24 09:00:32 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-0xkq kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-0xkq topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-5616":"bootstrap-e2e-minion-group-0xkq","csi-mock-csi-mock-volumes-4020":"bootstrap-e2e-minion-group-0xkq"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-11-24 09:00:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}}}} } {kubelet Update v1 2022-11-24 09:00:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-24 09:18:36 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {node-problem-detector Update v1 2022-11-24 09:25:39 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-24 09:25:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-serial-1-6/us-west1-b/bootstrap-e2e-minion-group-0xkq,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-24 09:25:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-24 09:25:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-24 09:25:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-24 09:25:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-24 09:25:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-24 09:25:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-24 09:25:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-24 09:00:50 +0000 UTC,LastTransitionTime:2022-11-24 09:00:50 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-24 09:24:47 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-24 09:24:47 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-24 09:24:47 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-24 09:24:47 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:34.145.99.248,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-0xkq.c.k8s-jkns-gce-serial-1-6.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-0xkq.c.k8s-jkns-gce-serial-1-6.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:23bcd2ca790827437c5cec98facdba94,SystemUUID:23bcd2ca-7908-2743-7c5c-ec98facdba94,BootID:84f5ff41-fbc9-4fdb-966f-19346788bdab,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.44+45279654db87f4,KubeProxyVersion:v1.27.0-alpha.0.44+45279654db87f4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:67201224,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/debian-base@sha256:ebda8587ec0f49eb88ee3a608ef018484908cbc5aa32556a0d78356088c185d4 registry.k8s.io/debian-base:v2.0.0],SizeBytes:21093264,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-5616^f895d0cb-6bd8-11ed-82b3-fe6d40909f02 kubernetes.io/csi/csi-hostpath-ephemeral-5616^f8bc8630-6bd8-11ed-82b3-fe6d40909f02],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-5616^f895d0cb-6bd8-11ed-82b3-fe6d40909f02,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-5616^f8bc8630-6bd8-11ed-82b3-fe6d40909f02,DevicePath:,},},Config:nil,},}
Nov 24 09:27:38.733: INFO: 
Logging kubelet events for node bootstrap-e2e-minion-group-0xkq
Nov 24 09:27:38.792: INFO: 
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-0xkq
Nov 24 09:27:39.179: INFO: csi-mockplugin-attacher-0 started at 2022-11-24 09:13:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.179: INFO: 	Container csi-attacher ready: false, restart count 4
Nov 24 09:27:39.179: INFO: pod-disruption-failure-ignore-1-b8vdq started at 2022-11-24 09:17:13 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.179: INFO: 	Container c ready: false, restart count 0
Nov 24 09:27:39.179: INFO: ss2-0 started at 2022-11-24 09:18:51 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.179: INFO: 	Container webserver ready: true, restart count 2
Nov 24 09:27:39.179: INFO: hostexec-bootstrap-e2e-minion-group-0xkq-vtzpg started at 2022-11-24 09:18:35 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.179: INFO: 	Container agnhost-container ready: false, restart count 4
Nov 24 09:27:39.179: INFO: inline-volume-tester-6w8qg started at 2022-11-24 09:18:36 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.179: INFO: 	Container csi-volume-tester ready: false, restart count 0
Nov 24 09:27:39.179: INFO: pod-secrets-6ef894cf-d4cc-4c12-a50d-3e49edaec470 started at 2022-11-24 09:07:37 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:27:39.179: INFO: 	Container creates-volume-test ready: false, restart count 0
Nov 24 09:27:39.179: INFO: 	Container dels-volume-test ready: false, restart count 0
Nov 24 09:27:39.179: INFO: 	Container upds-volume-test ready: false, restart count 0
Nov 24 09:27:39.179: INFO: external-provisioner-f4vcp started at 2022-11-24 09:13:55 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.179: INFO: 	Container nfs-provisioner ready: true, restart count 4
Nov 24 09:27:39.179: INFO: sample-webhook-deployment-865554f4d9-qhln9 started at 2022-11-24 09:04:35 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.179: INFO: 	Container sample-webhook ready: false, restart count 9
Nov 24 09:27:39.179: INFO: test-apparmor-k8mtn started at 2022-11-24 09:18:35 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.179: INFO: 	Container test ready: false, restart count 0
Nov 24 09:27:39.179: INFO: webserver-7d887d45b-b2lng started at 2022-11-24 09:10:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.179: INFO: 	Container httpd ready: false, restart count 6
Nov 24 09:27:39.179: INFO: service-deletion-pmnf7 started at 2022-11-24 09:13:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.179: INFO: 	Container service-deletion ready: true, restart count 3
Nov 24 09:27:39.179: INFO: pod-disruption-failure-ignore-1-8q4cc started at 2022-11-24 09:13:53 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.179: INFO: 	Container c ready: false, restart count 0
Nov 24 09:27:39.179: INFO: update-demo-nautilus-827pl started at 2022-11-24 09:18:35 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.179: INFO: 	Container update-demo ready: true, restart count 3
Nov 24 09:27:39.179: INFO: webserver-7d887d45b-zjrtz started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.179: INFO: 	Container httpd ready: true, restart count 3
Nov 24 09:27:39.179: INFO: pod-subpath-test-preprovisionedpv-bchr started at 2022-11-24 09:07:37 +0000 UTC (1+1 container statuses recorded)
Nov 24 09:27:39.179: INFO: 	Init container init-volume-preprovisionedpv-bchr ready: true, restart count 0
Nov 24 09:27:39.179: INFO: 	Container test-container-subpath-preprovisionedpv-bchr ready: false, restart count 0
Nov 24 09:27:39.179: INFO: hostexec-bootstrap-e2e-minion-group-0xkq-gs72q started at 2022-11-24 09:06:42 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.179: INFO: 	Container agnhost-container ready: false, restart count 6
Nov 24 09:27:39.179: INFO: sample-webhook-deployment-865554f4d9-shnzq started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.179: INFO: 	Container sample-webhook ready: true, restart count 2
Nov 24 09:27:39.179: INFO: external-provisioner-s6wpd started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.179: INFO: 	Container nfs-provisioner ready: true, restart count 6
Nov 24 09:27:39.179: INFO: client-containers-73020471-75dc-486c-91d8-b2150c34f574 started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.179: INFO: 	Container agnhost-container ready: false, restart count 0
Nov 24 09:27:39.179: INFO: pod-disruption-failure-ignore-2-m4qbn started at 2022-11-24 09:17:17 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.179: INFO: 	Container c ready: false, restart count 0
Nov 24 09:27:39.179: INFO: agnhost-host-aliases07dd0013-880a-43df-b65a-dd3cc866b1c6 started at 2022-11-24 09:04:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.179: INFO: 	Container agnhost-container ready: false, restart count 0
Nov 24 09:27:39.179: INFO: httpd-deployment-6859889f88-cjjj8 started at 2022-11-24 09:04:51 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.179: INFO: 	Container httpd ready: false, restart count 6
Nov 24 09:27:39.179: INFO: busybox-e4175cec-5a98-457b-8d7a-fc687790f79e started at 2022-11-24 09:04:11 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.179: INFO: 	Container busybox ready: false, restart count 10
Nov 24 09:27:39.179: INFO: csi-mockplugin-0 started at 2022-11-24 09:13:37 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:27:39.179: INFO: 	Container csi-provisioner ready: true, restart count 6
Nov 24 09:27:39.179: INFO: 	Container driver-registrar ready: true, restart count 6
Nov 24 09:27:39.179: INFO: 	Container mock ready: true, restart count 6
Nov 24 09:27:39.179: INFO: pod-always-succeed1ac1248a-f95d-4ec8-add5-00fdfc91f740 started at 2022-11-24 09:04:11 +0000 UTC (1+1 container statuses recorded)
Nov 24 09:27:39.179: INFO: 	Init container foo ready: true, restart count 0
Nov 24 09:27:39.179: INFO: 	Container bar ready: false, restart count 0
Nov 24 09:27:39.179: INFO: metadata-proxy-v0.1-jg8bk started at 2022-11-24 09:00:33 +0000 UTC (0+2 container statuses recorded)
Nov 24 09:27:39.179: INFO: 	Container metadata-proxy ready: true, restart count 0
Nov 24 09:27:39.179: INFO: 	Container prometheus-to-sd-exporter ready: true, restart count 0
Nov 24 09:27:39.179: INFO: busybox-readonly-true-0c7fd3e6-417c-4909-a077-6624310b4dfb started at 2022-11-24 09:04:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.179: INFO: 	Container busybox-readonly-true-0c7fd3e6-417c-4909-a077-6624310b4dfb ready: false, restart count 0
Nov 24 09:27:39.179: INFO: pod-disruption-failure-ignore-0-ngtgb started at 2022-11-24 09:13:53 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.179: INFO: 	Container c ready: false, restart count 0
Nov 24 09:27:39.179: INFO: csi-mockplugin-0 started at 2022-11-24 09:02:44 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:27:39.179: INFO: 	Container csi-provisioner ready: false, restart count 8
Nov 24 09:27:39.179: INFO: 	Container driver-registrar ready: false, restart count 8
Nov 24 09:27:39.179: INFO: 	Container mock ready: false, restart count 8
Nov 24 09:27:39.179: INFO: hostexec-bootstrap-e2e-minion-group-0xkq-pqnxr started at 2022-11-24 09:06:47 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.179: INFO: 	Container agnhost-container ready: true, restart count 1
Nov 24 09:27:39.179: INFO: pod-subpath-test-preprovisionedpv-tmmr started at 2022-11-24 09:07:37 +0000 UTC (2+1 container statuses recorded)
Nov 24 09:27:39.179: INFO: 	Init container init-volume-preprovisionedpv-tmmr ready: true, restart count 0
Nov 24 09:27:39.179: INFO: 	Init container test-init-volume-preprovisionedpv-tmmr ready: true, restart count 0
Nov 24 09:27:39.179: INFO: 	Container test-container-subpath-preprovisionedpv-tmmr ready: false, restart count 0
Nov 24 09:27:39.179: INFO: pod-configmaps-e234b165-43bc-41ce-91d4-7789b97cbf1a started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.179: INFO: 	Container env-test ready: false, restart count 0
Nov 24 09:27:39.179: INFO: netserver-0 started at 2022-11-24 09:18:27 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.179: INFO: 	Container webserver ready: true, restart count 4
Nov 24 09:27:39.179: INFO: netserver-0 started at 2022-11-24 09:04:49 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.179: INFO: 	Container webserver ready: false, restart count 8
Nov 24 09:27:39.179: INFO: pod-disruption-failure-ignore-0-r2g6r started at 2022-11-24 09:17:13 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.179: INFO: 	Container c ready: false, restart count 0
Nov 24 09:27:39.179: INFO: test-pod-3 started at 2022-11-24 09:02:41 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.179: INFO: 	Container token-test ready: false, restart count 0
Nov 24 09:27:39.179: INFO: netserver-0 started at 2022-11-24 09:04:04 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.179: INFO: 	Container webserver ready: false, restart count 9
Nov 24 09:27:39.179: INFO: coredns-6d97d5ddb-q22hn started at 2022-11-24 09:00:58 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.179: INFO: 	Container coredns ready: false, restart count 9
Nov 24 09:27:39.179: INFO: external-provisioner-nzpx5 started at 2022-11-24 09:13:56 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.179: INFO: 	Container nfs-provisioner ready: true, restart count 2
Nov 24 09:27:39.179: INFO: sample-webhook-deployment-865554f4d9-pngsn started at 2022-11-24 09:04:04 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.179: INFO: 	Container sample-webhook ready: false, restart count 9
Nov 24 09:27:39.179: INFO: alpine-nnp-false-d237a6ae-3e11-402c-9f30-27adea86549e started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.179: INFO: 	Container alpine-nnp-false-d237a6ae-3e11-402c-9f30-27adea86549e ready: false, restart count 0
Nov 24 09:27:39.179: INFO: pod-disruption-failure-ignore-3-d94v4 started at 2022-11-24 09:17:17 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.179: INFO: 	Container c ready: false, restart count 0
Nov 24 09:27:39.179: INFO: csi-hostpathplugin-0 started at 2022-11-24 09:18:27 +0000 UTC (0+7 container statuses recorded)
Nov 24 09:27:39.179: INFO: 	Container csi-attacher ready: true, restart count 2
Nov 24 09:27:39.179: INFO: 	Container csi-provisioner ready: true, restart count 2
Nov 24 09:27:39.179: INFO: 	Container csi-resizer ready: true, restart count 2
Nov 24 09:27:39.179: INFO: 	Container csi-snapshotter ready: true, restart count 2
Nov 24 09:27:39.179: INFO: 	Container hostpath ready: true, restart count 2
Nov 24 09:27:39.179: INFO: 	Container liveness-probe ready: true, restart count 2
Nov 24 09:27:39.179: INFO: 	Container node-driver-registrar ready: true, restart count 3
Nov 24 09:27:39.179: INFO: kube-proxy-bootstrap-e2e-minion-group-0xkq started at 2022-11-24 09:00:32 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.179: INFO: 	Container kube-proxy ready: false, restart count 8
Nov 24 09:27:39.179: INFO: konnectivity-agent-nxcws started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.179: INFO: 	Container konnectivity-agent ready: true, restart count 8
Nov 24 09:27:39.179: INFO: apparmor-loader-nf47q started at 2022-11-24 09:18:27 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.179: INFO: 	Container apparmor-loader ready: true, restart count 2
Nov 24 09:27:39.179: INFO: httpd started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.179: INFO: 	Container httpd ready: false, restart count 5
Nov 24 09:27:39.179: INFO: agnhost started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:27:39.179: INFO: 	Container agnhost ready: false, restart count 0
Nov 24 09:27:40.257: INFO: 
Latency metrics for node bootstrap-e2e-minion-group-0xkq
Nov 24 09:27:40.257: INFO: 
Logging node info for node bootstrap-e2e-minion-group-6m4q
Nov 24 09:27:40.305: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-6m4q    be4476db-4c35-4ea4-96f6-e1f0e7c12742 12084 0 2022-11-24 09:00:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-6m4q kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-6m4q topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-8753":"bootstrap-e2e-minion-group-6m4q"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-24 09:00:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-24 09:00:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-11-24 09:12:06 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {node-problem-detector Update v1 2022-11-24 09:25:43 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-24 09:27:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-serial-1-6/us-west1-b/bootstrap-e2e-minion-group-6m4q,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-24 09:25:43 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-24 09:25:43 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-24 09:25:43 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-24 09:25:43 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-24 09:25:43 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-24 09:25:43 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-24 09:25:43 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-24 09:00:50 +0000 UTC,LastTransitionTime:2022-11-24 09:00:50 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-24 09:24:48 +0000 UTC,LastTransitionTime:2022-11-24 09:00:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-24 09:24:48 +0000 UTC,LastTransitionTime:2022-11-24 09:00:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-24 09:24:48 +0000 UTC,LastTransitionTime:2022-11-24 09:00:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-24 09:24:48 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:35.247.58.118,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-6m4q.c.k8s-jkns-gce-serial-1-6.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-6m4q.c.k8s-jkns-gce-serial-1-6.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:7b2cc9e909d10f7df61b26e8aece9707,SystemUUID:7b2cc9e9-09d1-0f7d-f61b-26e8aece9707,BootID:64607970-cc6d-408c-9269-dff979065832,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.44+45279654db87f4,KubeProxyVersion:v1.27.0-alpha.0.44+45279654db87f4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:67201224,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 registry.k8s.io/sig-storage/snapshot-controller:v6.1.0],SizeBytes:22620891,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-7570^55118aeb-6bd7-11ed-8dba-2207550599a3 kubernetes.io/csi/csi-hostpath-ephemeral-8753^758a12fe-6bd7-11ed-b4fd-0e9a0f0cf363],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-7570^55118aeb-6bd7-11ed-8dba-2207550599a3,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-8753^758a12fe-6bd7-11ed-b4fd-0e9a0f0cf363,DevicePath:,},},Config:nil,},}
Nov 24 09:27:40.305: INFO: 
Logging kubelet events for node bootstrap-e2e-minion-group-6m4q
Nov 24 09:27:40.377: INFO: 
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-6m4q
Nov 24 09:27:40.463: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-6m4q: error trying to reach service: No agent available
Nov 24 09:27:40.463: INFO: 
Logging node info for node bootstrap-e2e-minion-group-fj34
Nov 24 09:27:40.511: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-fj34    26b0a38a-1259-4217-8b0f-bfa92e43b570 12120 0 2022-11-24 09:00:32 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-fj34 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-fj34 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-4261":"bootstrap-e2e-minion-group-fj34","csi-hostpath-ephemeral-7265":"bootstrap-e2e-minion-group-fj34","csi-mock-csi-mock-volumes-1806":"bootstrap-e2e-minion-group-fj34","csi-mock-csi-mock-volumes-9231":"bootstrap-e2e-minion-group-fj34"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-11-24 09:00:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kubelet Update v1 2022-11-24 09:00:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-24 09:10:50 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {node-problem-detector Update v1 2022-11-24 09:25:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-24 09:27:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-serial-1-6/us-west1-b/bootstrap-e2e-minion-group-fj34,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-24 09:25:40 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-24 09:25:40 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-24 09:25:40 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-24 09:25:40 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-24 09:25:40 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-24 09:25:40 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-24 09:25:40 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-24 09:00:50 +0000 UTC,LastTransitionTime:2022-11-24 09:00:50 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-24 09:24:47 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-24 09:24:47 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-24 09:24:47 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-24 09:24:47 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.82.73.153,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-fj34.c.k8s-jkns-gce-serial-1-6.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-fj34.c.k8s-jkns-gce-serial-1-6.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:557b5201a29dc5c84dc79b98af6f523a,SystemUUID:557b5201-a29d-c5c8-4dc7-9b98af6f523a,BootID:0f4289cb-5f88-4ee3-b552-b99fcc030f54,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.44+45279654db87f4,KubeProxyVersion:v1.27.0-alpha.0.44+45279654db87f4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:67201224,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:c0ddb4794bc8a3631e3373015f913c00b230ee54f87bde9ade195b3a3415c60f registry.k8s.io/build-image/distroless-iptables:v0.1.2],SizeBytes:7685585,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-1806^5a1ffb25-6bd7-11ed-9365-7e36e6fec9d2 kubernetes.io/csi/csi-mock-csi-mock-volumes-9231^cbf4a4b9-6bd6-11ed-88e7-326e345b4078],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-9231^cbf4a4b9-6bd6-11ed-88e7-326e345b4078,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-1806^5a1ffb25-6bd7-11ed-9365-7e36e6fec9d2,DevicePath:,},},Config:nil,},}
Nov 24 09:27:40.512: INFO: 
Logging kubelet events for node bootstrap-e2e-minion-group-fj34
Nov 24 09:27:40.569: INFO: 
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-fj34
Nov 24 09:27:40.627: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-fj34: error trying to reach service: No agent available
[DeferCleanup (Each)] [sig-api-machinery] Garbage collector
  tear down framework | framework.go:193
STEP: Destroying namespace "gc-2598" for this suite. 11/24/22 09:27:40.627

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-api-machinery] Garbage collector should orphan RS created by deployment when deleteOptions.PropagationPolicy is Orphan [Conformance] 1m56s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sGarbage\scollector\sshould\sorphan\sRS\screated\sby\sdeployment\swhen\sdeleteOptions\.PropagationPolicy\sis\sOrphan\s\[Conformance\]$'

test/e2e/framework/framework.go:241
k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc00064eff0)
	test/e2e/framework/framework.go:241 +0x96f
				[BeforeEach] [sig-api-machinery] Garbage collector
  set up framework | framework.go:178
STEP: Creating a kubernetes client 11/24/22 09:38:52.674
Nov 24 09:38:52.675: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Building a namespace api object, basename gc 11/24/22 09:38:52.681
Nov 24 09:39:02.743: INFO: Unexpected error while creating namespace: Internal error occurred: resource quota evaluation timed out
Nov 24 09:39:14.785: INFO: Unexpected error while creating namespace: Internal error occurred: resource quota evaluation timed out
Nov 24 09:39:26.799: INFO: Unexpected error while creating namespace: Internal error occurred: resource quota evaluation timed out
Nov 24 09:39:38.785: INFO: Unexpected error while creating namespace: Internal error occurred: resource quota evaluation timed out
Nov 24 09:39:48.827: INFO: Unexpected error while creating namespace: Internal error occurred: resource quota evaluation timed out
Nov 24 09:39:48.827: INFO: Unexpected error: 
    <*errors.errorString | 0xc0001ffa30>: {
        s: "timed out waiting for the condition",
    }
Nov 24 09:39:48.827: FAIL: timed out waiting for the condition

Full Stack Trace
k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc00064eff0)
	test/e2e/framework/framework.go:241 +0x96f
[AfterEach] [sig-api-machinery] Garbage collector
  test/e2e/framework/node/init/init.go:32
Nov 24 09:39:48.827: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-api-machinery] Garbage collector
  dump namespaces | framework.go:196
STEP: dump namespace information after failure 11/24/22 09:40:48.868
[DeferCleanup (Each)] [sig-api-machinery] Garbage collector
  tear down framework | framework.go:193

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-api-machinery] Garbage collector should orphan pods created by rc if deleteOptions.OrphanDependents is nil 2m21s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sGarbage\scollector\sshould\sorphan\spods\screated\sby\src\sif\sdeleteOptions\.OrphanDependents\sis\snil$'

test/e2e/apimachinery/garbage_collector.go:475
k8s.io/kubernetes/test/e2e/apimachinery.glob..func13.3()
	test/e2e/apimachinery/garbage_collector.go:475 +0x4d1
				[BeforeEach] [sig-api-machinery] Garbage collector
  set up framework | framework.go:178
STEP: Creating a kubernetes client 11/24/22 09:30:54.788
Nov 24 09:30:54.788: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Building a namespace api object, basename gc 11/24/22 09:30:54.79
STEP: Waiting for a default service account to be provisioned in namespace 11/24/22 09:30:55.132
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 11/24/22 09:30:55.283
[BeforeEach] [sig-api-machinery] Garbage collector
  test/e2e/framework/metrics/init/init.go:31
[It] should orphan pods created by rc if deleteOptions.OrphanDependents is nil
  test/e2e/apimachinery/garbage_collector.go:439
STEP: create the rc 11/24/22 09:30:55.448
STEP: delete the rc 11/24/22 09:31:00.734
STEP: wait for 30 seconds to see if the garbage collector mistakenly deletes the pods 11/24/22 09:31:00.958
Nov 24 09:32:31.000: FAIL: Failed to list pods: Get "https://35.233.217.30/api/v1/namespaces/gc-1117/pods": stream error: stream ID 195; INTERNAL_ERROR; received from peer

Full Stack Trace
k8s.io/kubernetes/test/e2e/apimachinery.glob..func13.3()
	test/e2e/apimachinery/garbage_collector.go:475 +0x4d1
[AfterEach] [sig-api-machinery] Garbage collector
  test/e2e/framework/node/init/init.go:32
Nov 24 09:32:31.001: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-api-machinery] Garbage collector
  test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-api-machinery] Garbage collector
  dump namespaces | framework.go:196
STEP: dump namespace information after failure 11/24/22 09:33:06.955
STEP: Collecting events from namespace "gc-1117". 11/24/22 09:33:06.955
STEP: Found 15 events. 11/24/22 09:33:07.014
Nov 24 09:33:07.014: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for simpletest.rc-7x898: { } Scheduled: Successfully assigned gc-1117/simpletest.rc-7x898 to bootstrap-e2e-minion-group-0xkq
Nov 24 09:33:07.014: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for simpletest.rc-gpbmh: { } Scheduled: Successfully assigned gc-1117/simpletest.rc-gpbmh to bootstrap-e2e-minion-group-6m4q
Nov 24 09:33:07.014: INFO: At 2022-11-24 09:30:55 +0000 UTC - event for simpletest.rc: {replication-controller } SuccessfulCreate: Created pod: simpletest.rc-gpbmh
Nov 24 09:33:07.014: INFO: At 2022-11-24 09:30:55 +0000 UTC - event for simpletest.rc: {replication-controller } SuccessfulCreate: Created pod: simpletest.rc-7x898
Nov 24 09:33:07.014: INFO: At 2022-11-24 09:30:57 +0000 UTC - event for simpletest.rc-gpbmh: {kubelet bootstrap-e2e-minion-group-6m4q} Pulling: Pulling image "registry.k8s.io/e2e-test-images/nginx:1.14-4"
Nov 24 09:33:07.014: INFO: At 2022-11-24 09:30:59 +0000 UTC - event for simpletest.rc-gpbmh: {kubelet bootstrap-e2e-minion-group-6m4q} Started: Started container nginx
Nov 24 09:33:07.014: INFO: At 2022-11-24 09:30:59 +0000 UTC - event for simpletest.rc-gpbmh: {kubelet bootstrap-e2e-minion-group-6m4q} Pulled: Successfully pulled image "registry.k8s.io/e2e-test-images/nginx:1.14-4" in 1.352372415s (1.35242478s including waiting)
Nov 24 09:33:07.014: INFO: At 2022-11-24 09:30:59 +0000 UTC - event for simpletest.rc-gpbmh: {kubelet bootstrap-e2e-minion-group-6m4q} Created: Created container nginx
Nov 24 09:33:07.014: INFO: At 2022-11-24 09:31:00 +0000 UTC - event for simpletest.rc-7x898: {kubelet bootstrap-e2e-minion-group-0xkq} Started: Started container nginx
Nov 24 09:33:07.014: INFO: At 2022-11-24 09:31:00 +0000 UTC - event for simpletest.rc-7x898: {kubelet bootstrap-e2e-minion-group-0xkq} Created: Created container nginx
Nov 24 09:33:07.014: INFO: At 2022-11-24 09:31:00 +0000 UTC - event for simpletest.rc-7x898: {kubelet bootstrap-e2e-minion-group-0xkq} Pulled: Container image "registry.k8s.io/e2e-test-images/nginx:1.14-4" already present on machine
Nov 24 09:33:07.014: INFO: At 2022-11-24 09:32:03 +0000 UTC - event for simpletest.rc-gpbmh: {kubelet bootstrap-e2e-minion-group-6m4q} Killing: Stopping container nginx
Nov 24 09:33:07.014: INFO: At 2022-11-24 09:32:04 +0000 UTC - event for simpletest.rc-gpbmh: {kubelet bootstrap-e2e-minion-group-6m4q} SandboxChanged: Pod sandbox changed, it will be killed and re-created.
Nov 24 09:33:07.014: INFO: At 2022-11-24 09:32:04 +0000 UTC - event for simpletest.rc-gpbmh: {kubelet bootstrap-e2e-minion-group-6m4q} Pulled: Container image "registry.k8s.io/e2e-test-images/nginx:1.14-4" already present on machine
Nov 24 09:33:07.014: INFO: At 2022-11-24 09:32:06 +0000 UTC - event for simpletest.rc-gpbmh: {kubelet bootstrap-e2e-minion-group-6m4q} BackOff: Back-off restarting failed container nginx in pod simpletest.rc-gpbmh_gc-1117(4a2bc7e1-2eca-436c-8ab0-7cf7d6a07037)
Nov 24 09:33:07.118: INFO: POD                  NODE                             PHASE    GRACE  CONDITIONS
Nov 24 09:33:07.118: INFO: simpletest.rc-7x898  bootstrap-e2e-minion-group-0xkq  Running         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-11-24 09:30:56 +0000 UTC  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-11-24 09:31:01 +0000 UTC  } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-11-24 09:31:01 +0000 UTC  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-11-24 09:30:55 +0000 UTC  }]
Nov 24 09:33:07.118: INFO: simpletest.rc-gpbmh  bootstrap-e2e-minion-group-6m4q  Running         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-11-24 09:30:56 +0000 UTC  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-11-24 09:30:59 +0000 UTC  } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-11-24 09:30:59 +0000 UTC  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-11-24 09:30:56 +0000 UTC  }]
Nov 24 09:33:07.118: INFO: 
Nov 24 09:33:08.545: INFO: 
Logging node info for node bootstrap-e2e-master
Nov 24 09:33:08.611: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master    57b53f45-775d-4de5-a4ff-420df60cf61e 13536 0 2022-11-24 09:00:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-24 09:00:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-11-24 09:00:50 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-11-24 09:00:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-11-24 09:33:06 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-serial-1-6/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3858374656 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3596230656 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-24 09:00:50 +0000 UTC,LastTransitionTime:2022-11-24 09:00:50 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-24 09:33:06 +0000 UTC,LastTransitionTime:2022-11-24 09:00:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-24 09:33:06 +0000 UTC,LastTransitionTime:2022-11-24 09:00:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-24 09:33:06 +0000 UTC,LastTransitionTime:2022-11-24 09:00:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-24 09:33:06 +0000 UTC,LastTransitionTime:2022-11-24 09:00:54 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:35.233.217.30,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-jkns-gce-serial-1-6.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-jkns-gce-serial-1-6.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:2380dd218709b39effceaa3da78bc7d6,SystemUUID:2380dd21-8709-b39e-ffce-aa3da78bc7d6,BootID:8a5acb5e-406f-47f0-bc85-bed589236d7d,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.44+45279654db87f4,KubeProxyVersion:v1.27.0-alpha.0.44+45279654db87f4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:135160275,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:124989753,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:57659704,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:2c111f004bec24888d8cfa2a812a38fb8341350abac67dcd0ac64e709dfe389c registry.k8s.io/kas-network-proxy/proxy-server:v0.0.33],SizeBytes:22020129,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 24 09:33:08.612: INFO: 
Logging kubelet events for node bootstrap-e2e-master
Nov 24 09:33:08.671: INFO: 
Logging pods the kubelet thinks is on node bootstrap-e2e-master
Nov 24 09:33:08.872: INFO: etcd-server-events-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:08.872: INFO: 	Container etcd-container ready: true, restart count 3
Nov 24 09:33:08.872: INFO: etcd-server-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:08.872: INFO: 	Container etcd-container ready: true, restart count 5
Nov 24 09:33:08.872: INFO: konnectivity-server-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:08.872: INFO: 	Container konnectivity-server-container ready: true, restart count 0
Nov 24 09:33:08.872: INFO: kube-addon-manager-bootstrap-e2e-master started at 2022-11-24 09:00:06 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:08.872: INFO: 	Container kube-addon-manager ready: true, restart count 3
Nov 24 09:33:08.872: INFO: l7-lb-controller-bootstrap-e2e-master started at 2022-11-24 09:00:07 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:08.872: INFO: 	Container l7-lb-controller ready: false, restart count 8
Nov 24 09:33:08.872: INFO: metadata-proxy-v0.1-dgq6b started at 2022-11-24 09:01:06 +0000 UTC (0+2 container statuses recorded)
Nov 24 09:33:08.872: INFO: 	Container metadata-proxy ready: true, restart count 0
Nov 24 09:33:08.872: INFO: 	Container prometheus-to-sd-exporter ready: true, restart count 0
Nov 24 09:33:08.872: INFO: kube-apiserver-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:08.872: INFO: 	Container kube-apiserver ready: true, restart count 3
Nov 24 09:33:08.872: INFO: kube-controller-manager-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:08.872: INFO: 	Container kube-controller-manager ready: false, restart count 8
Nov 24 09:33:08.872: INFO: kube-scheduler-bootstrap-e2e-master started at 2022-11-24 08:59:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:08.872: INFO: 	Container kube-scheduler ready: false, restart count 8
Nov 24 09:33:09.752: INFO: 
Latency metrics for node bootstrap-e2e-master
Nov 24 09:33:09.752: INFO: 
Logging node info for node bootstrap-e2e-minion-group-0xkq
Nov 24 09:33:09.793: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-0xkq    34eb6b8a-d427-45c3-aa67-9f7aa0a1f8a1 13560 0 2022-11-24 09:00:32 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-0xkq kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-0xkq topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-5616":"bootstrap-e2e-minion-group-0xkq","csi-mock-csi-mock-volumes-8441":"bootstrap-e2e-minion-group-0xkq","csi-mock-csi-mock-volumes-8812":"bootstrap-e2e-minion-group-0xkq"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-11-24 09:00:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}}}} } {kubelet Update v1 2022-11-24 09:00:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-24 09:18:36 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {node-problem-detector Update v1 2022-11-24 09:30:39 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-24 09:33:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-serial-1-6/us-west1-b/bootstrap-e2e-minion-group-0xkq,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-24 09:30:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-24 09:30:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-24 09:30:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-24 09:30:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-24 09:30:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-24 09:30:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-24 09:30:39 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-24 09:00:50 +0000 UTC,LastTransitionTime:2022-11-24 09:00:50 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-24 09:29:53 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-24 09:29:53 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-24 09:29:53 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-24 09:29:53 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:34.145.99.248,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-0xkq.c.k8s-jkns-gce-serial-1-6.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-0xkq.c.k8s-jkns-gce-serial-1-6.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:23bcd2ca790827437c5cec98facdba94,SystemUUID:23bcd2ca-7908-2743-7c5c-ec98facdba94,BootID:84f5ff41-fbc9-4fdb-966f-19346788bdab,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.44+45279654db87f4,KubeProxyVersion:v1.27.0-alpha.0.44+45279654db87f4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:67201224,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/debian-base@sha256:ebda8587ec0f49eb88ee3a608ef018484908cbc5aa32556a0d78356088c185d4 registry.k8s.io/debian-base:v2.0.0],SizeBytes:21093264,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-5616^f895d0cb-6bd8-11ed-82b3-fe6d40909f02 kubernetes.io/csi/csi-hostpath-ephemeral-5616^f8bc8630-6bd8-11ed-82b3-fe6d40909f02],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-5616^f895d0cb-6bd8-11ed-82b3-fe6d40909f02,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-5616^f8bc8630-6bd8-11ed-82b3-fe6d40909f02,DevicePath:,},},Config:nil,},}
Nov 24 09:33:09.794: INFO: 
Logging kubelet events for node bootstrap-e2e-minion-group-0xkq
Nov 24 09:33:09.926: INFO: 
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-0xkq
Nov 24 09:33:10.520: INFO: pod-secrets-6ef894cf-d4cc-4c12-a50d-3e49edaec470 started at 2022-11-24 09:07:37 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:33:10.520: INFO: 	Container creates-volume-test ready: false, restart count 0
Nov 24 09:33:10.520: INFO: 	Container dels-volume-test ready: false, restart count 0
Nov 24 09:33:10.520: INFO: 	Container upds-volume-test ready: false, restart count 0
Nov 24 09:33:10.520: INFO: ss2-0 started at 2022-11-24 09:18:51 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.520: INFO: 	Container webserver ready: true, restart count 2
Nov 24 09:33:10.520: INFO: inline-volume-tester-6w8qg started at 2022-11-24 09:18:36 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.520: INFO: 	Container csi-volume-tester ready: false, restart count 0
Nov 24 09:33:10.520: INFO: webserver-7d887d45b-zjrtz started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.520: INFO: 	Container httpd ready: true, restart count 3
Nov 24 09:33:10.520: INFO: sample-webhook-deployment-865554f4d9-qhln9 started at 2022-11-24 09:04:35 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.520: INFO: 	Container sample-webhook ready: false, restart count 10
Nov 24 09:33:10.520: INFO: test-apparmor-k8mtn started at 2022-11-24 09:18:35 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.520: INFO: 	Container test ready: false, restart count 0
Nov 24 09:33:10.520: INFO: pod-release-nm995 started at 2022-11-24 09:30:54 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.520: INFO: 	Container pod-release ready: false, restart count 0
Nov 24 09:33:10.520: INFO: httpd-deployment-6859889f88-cjjj8 started at 2022-11-24 09:04:51 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.520: INFO: 	Container httpd ready: true, restart count 7
Nov 24 09:33:10.520: INFO: external-provisioner-s6wpd started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.520: INFO: 	Container nfs-provisioner ready: true, restart count 8
Nov 24 09:33:10.520: INFO: pod-service-account-defaultsa started at 2022-11-24 09:30:54 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.520: INFO: 	Container token-test ready: true, restart count 0
Nov 24 09:33:10.520: INFO: pod-service-account-mountsa-mountspec started at 2022-11-24 09:30:54 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.520: INFO: 	Container token-test ready: false, restart count 0
Nov 24 09:33:10.520: INFO: pod-service-account-nomountsa-mountspec started at 2022-11-24 09:30:54 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.520: INFO: 	Container token-test ready: false, restart count 0
Nov 24 09:33:10.520: INFO: pod-terminate-status-2-1 started at <nil> (0+0 container statuses recorded)
Nov 24 09:33:10.520: INFO: busybox-readonly-true-0c7fd3e6-417c-4909-a077-6624310b4dfb started at 2022-11-24 09:04:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.520: INFO: 	Container busybox-readonly-true-0c7fd3e6-417c-4909-a077-6624310b4dfb ready: false, restart count 0
Nov 24 09:33:10.520: INFO: up-down-1-2f5z5 started at 2022-11-24 09:30:54 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.520: INFO: 	Container up-down-1 ready: true, restart count 0
Nov 24 09:33:10.520: INFO: pod-always-succeed1ac1248a-f95d-4ec8-add5-00fdfc91f740 started at 2022-11-24 09:04:11 +0000 UTC (1+1 container statuses recorded)
Nov 24 09:33:10.520: INFO: 	Init container foo ready: true, restart count 0
Nov 24 09:33:10.520: INFO: 	Container bar ready: false, restart count 0
Nov 24 09:33:10.520: INFO: pod-service-account-mountsa started at 2022-11-24 09:30:54 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.520: INFO: 	Container token-test ready: false, restart count 0
Nov 24 09:33:10.520: INFO: netserver-0 started at 2022-11-24 09:04:49 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.520: INFO: 	Container webserver ready: false, restart count 9
Nov 24 09:33:10.520: INFO: pod-disruption-failure-ignore-0-r2g6r started at 2022-11-24 09:17:13 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.520: INFO: 	Container c ready: false, restart count 0
Nov 24 09:33:10.520: INFO: hostexec-bootstrap-e2e-minion-group-0xkq-pqnxr started at 2022-11-24 09:06:47 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.520: INFO: 	Container agnhost-container ready: true, restart count 3
Nov 24 09:33:10.520: INFO: pod-subpath-test-preprovisionedpv-tmmr started at 2022-11-24 09:07:37 +0000 UTC (2+1 container statuses recorded)
Nov 24 09:33:10.520: INFO: 	Init container init-volume-preprovisionedpv-tmmr ready: true, restart count 0
Nov 24 09:33:10.520: INFO: 	Init container test-init-volume-preprovisionedpv-tmmr ready: true, restart count 0
Nov 24 09:33:10.520: INFO: 	Container test-container-subpath-preprovisionedpv-tmmr ready: false, restart count 0
Nov 24 09:33:10.520: INFO: pod-configmaps-e234b165-43bc-41ce-91d4-7789b97cbf1a started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.520: INFO: 	Container env-test ready: false, restart count 0
Nov 24 09:33:10.520: INFO: netserver-0 started at 2022-11-24 09:18:27 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.520: INFO: 	Container webserver ready: false, restart count 4
Nov 24 09:33:10.520: INFO: coredns-6d97d5ddb-q22hn started at 2022-11-24 09:00:58 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.520: INFO: 	Container coredns ready: false, restart count 10
Nov 24 09:33:10.520: INFO: test-pod-3 started at 2022-11-24 09:02:41 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.520: INFO: 	Container token-test ready: false, restart count 0
Nov 24 09:33:10.520: INFO: pod-service-account-nomountsa-nomountspec started at 2022-11-24 09:30:55 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.520: INFO: 	Container token-test ready: false, restart count 0
Nov 24 09:33:10.520: INFO: konnectivity-agent-nxcws started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.520: INFO: 	Container konnectivity-agent ready: true, restart count 9
Nov 24 09:33:10.520: INFO: pod-disruption-failure-ignore-3-d94v4 started at 2022-11-24 09:17:17 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.520: INFO: 	Container c ready: false, restart count 0
Nov 24 09:33:10.520: INFO: agnhost started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.520: INFO: 	Container agnhost ready: false, restart count 0
Nov 24 09:33:10.520: INFO: apparmor-loader-nf47q started at 2022-11-24 09:18:27 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.520: INFO: 	Container apparmor-loader ready: true, restart count 4
Nov 24 09:33:10.520: INFO: csi-mockplugin-attacher-0 started at 2022-11-24 09:30:42 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.520: INFO: 	Container csi-attacher ready: true, restart count 1
Nov 24 09:33:10.520: INFO: pod-disruption-failure-ignore-1-b8vdq started at 2022-11-24 09:17:13 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.520: INFO: 	Container c ready: false, restart count 0
Nov 24 09:33:10.520: INFO: hostexec-bootstrap-e2e-minion-group-0xkq-vtzpg started at 2022-11-24 09:18:35 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.520: INFO: 	Container agnhost-container ready: true, restart count 5
Nov 24 09:33:10.520: INFO: simpletest.rc-7x898 started at 2022-11-24 09:30:56 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.520: INFO: 	Container nginx ready: true, restart count 0
Nov 24 09:33:10.520: INFO: pod-handle-http-request started at 2022-11-24 09:30:56 +0000 UTC (0+2 container statuses recorded)
Nov 24 09:33:10.520: INFO: 	Container container-handle-http-request ready: true, restart count 0
Nov 24 09:33:10.520: INFO: 	Container container-handle-https-request ready: true, restart count 0
Nov 24 09:33:10.520: INFO: pod-subpath-test-preprovisionedpv-bchr started at 2022-11-24 09:07:37 +0000 UTC (1+1 container statuses recorded)
Nov 24 09:33:10.520: INFO: 	Init container init-volume-preprovisionedpv-bchr ready: true, restart count 0
Nov 24 09:33:10.520: INFO: 	Container test-container-subpath-preprovisionedpv-bchr ready: false, restart count 0
Nov 24 09:33:10.520: INFO: webserver-7d887d45b-b2lng started at 2022-11-24 09:10:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.520: INFO: 	Container httpd ready: true, restart count 7
Nov 24 09:33:10.520: INFO: pod-disruption-failure-ignore-1-8q4cc started at 2022-11-24 09:13:53 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.520: INFO: 	Container c ready: false, restart count 0
Nov 24 09:33:10.520: INFO: hostexec-bootstrap-e2e-minion-group-0xkq-l5lfz started at 2022-11-24 09:30:40 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.520: INFO: 	Container agnhost-container ready: true, restart count 1
Nov 24 09:33:10.520: INFO: agnhost-host-aliases07dd0013-880a-43df-b65a-dd3cc866b1c6 started at 2022-11-24 09:04:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.520: INFO: 	Container agnhost-container ready: false, restart count 0
Nov 24 09:33:10.520: INFO: hostexec-bootstrap-e2e-minion-group-0xkq-gs72q started at 2022-11-24 09:06:42 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.520: INFO: 	Container agnhost-container ready: false, restart count 7
Nov 24 09:33:10.520: INFO: sample-webhook-deployment-865554f4d9-shnzq started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.520: INFO: 	Container sample-webhook ready: true, restart count 2
Nov 24 09:33:10.520: INFO: client-containers-73020471-75dc-486c-91d8-b2150c34f574 started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.520: INFO: 	Container agnhost-container ready: false, restart count 0
Nov 24 09:33:10.520: INFO: pod-disruption-failure-ignore-2-m4qbn started at 2022-11-24 09:17:17 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.520: INFO: 	Container c ready: false, restart count 0
Nov 24 09:33:10.520: INFO: metadata-proxy-v0.1-jg8bk started at 2022-11-24 09:00:33 +0000 UTC (0+2 container statuses recorded)
Nov 24 09:33:10.520: INFO: 	Container metadata-proxy ready: true, restart count 0
Nov 24 09:33:10.520: INFO: 	Container prometheus-to-sd-exporter ready: true, restart count 0
Nov 24 09:33:10.520: INFO: busybox-e4175cec-5a98-457b-8d7a-fc687790f79e started at 2022-11-24 09:04:11 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.520: INFO: 	Container busybox ready: false, restart count 10
Nov 24 09:33:10.520: INFO: pod-disruption-failure-ignore-0-ngtgb started at 2022-11-24 09:13:53 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.520: INFO: 	Container c ready: false, restart count 0
Nov 24 09:33:10.520: INFO: csi-mockplugin-0 started at 2022-11-24 09:02:44 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:33:10.520: INFO: 	Container csi-provisioner ready: true, restart count 9
Nov 24 09:33:10.520: INFO: 	Container driver-registrar ready: true, restart count 9
Nov 24 09:33:10.520: INFO: 	Container mock ready: true, restart count 9
Nov 24 09:33:10.520: INFO: netserver-0 started at 2022-11-24 09:04:04 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.520: INFO: 	Container webserver ready: false, restart count 10
Nov 24 09:33:10.520: INFO: kube-proxy-bootstrap-e2e-minion-group-0xkq started at 2022-11-24 09:00:32 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.520: INFO: 	Container kube-proxy ready: true, restart count 9
Nov 24 09:33:10.520: INFO: sample-webhook-deployment-865554f4d9-pngsn started at 2022-11-24 09:04:04 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.520: INFO: 	Container sample-webhook ready: true, restart count 10
Nov 24 09:33:10.520: INFO: csi-mockplugin-0 started at 2022-11-24 09:30:42 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:33:10.520: INFO: 	Container csi-provisioner ready: true, restart count 1
Nov 24 09:33:10.520: INFO: 	Container driver-registrar ready: true, restart count 1
Nov 24 09:33:10.520: INFO: 	Container mock ready: true, restart count 1
Nov 24 09:33:10.520: INFO: alpine-nnp-false-d237a6ae-3e11-402c-9f30-27adea86549e started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.520: INFO: 	Container alpine-nnp-false-d237a6ae-3e11-402c-9f30-27adea86549e ready: false, restart count 0
Nov 24 09:33:10.520: INFO: csi-hostpathplugin-0 started at 2022-11-24 09:18:27 +0000 UTC (0+7 container statuses recorded)
Nov 24 09:33:10.520: INFO: 	Container csi-attacher ready: true, restart count 4
Nov 24 09:33:10.520: INFO: 	Container csi-provisioner ready: true, restart count 4
Nov 24 09:33:10.520: INFO: 	Container csi-resizer ready: true, restart count 4
Nov 24 09:33:10.520: INFO: 	Container csi-snapshotter ready: true, restart count 4
Nov 24 09:33:10.520: INFO: 	Container hostpath ready: true, restart count 4
Nov 24 09:33:10.520: INFO: 	Container liveness-probe ready: true, restart count 4
Nov 24 09:33:10.520: INFO: 	Container node-driver-registrar ready: true, restart count 4
Nov 24 09:33:10.520: INFO: httpd started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:10.520: INFO: 	Container httpd ready: true, restart count 6
Nov 24 09:33:11.421: INFO: 
Latency metrics for node bootstrap-e2e-minion-group-0xkq
Nov 24 09:33:11.421: INFO: 
Logging node info for node bootstrap-e2e-minion-group-6m4q
Nov 24 09:33:11.464: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-6m4q    be4476db-4c35-4ea4-96f6-e1f0e7c12742 13541 0 2022-11-24 09:00:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-6m4q kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-6m4q topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-8753":"bootstrap-e2e-minion-group-6m4q","csi-hostpath-volume-expand-4427":"bootstrap-e2e-minion-group-6m4q","csi-mock-csi-mock-volumes-6588":"bootstrap-e2e-minion-group-6m4q"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-24 09:00:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-24 09:00:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-11-24 09:30:39 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {node-problem-detector Update v1 2022-11-24 09:30:43 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-24 09:33:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-serial-1-6/us-west1-b/bootstrap-e2e-minion-group-6m4q,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-24 09:30:43 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-24 09:30:43 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-24 09:30:43 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-24 09:30:43 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-24 09:30:43 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-24 09:30:43 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-24 09:30:43 +0000 UTC,LastTransitionTime:2022-11-24 09:00:38 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-24 09:00:50 +0000 UTC,LastTransitionTime:2022-11-24 09:00:50 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-24 09:33:06 +0000 UTC,LastTransitionTime:2022-11-24 09:00:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-24 09:33:06 +0000 UTC,LastTransitionTime:2022-11-24 09:00:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-24 09:33:06 +0000 UTC,LastTransitionTime:2022-11-24 09:00:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-24 09:33:06 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:35.247.58.118,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-6m4q.c.k8s-jkns-gce-serial-1-6.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-6m4q.c.k8s-jkns-gce-serial-1-6.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:7b2cc9e909d10f7df61b26e8aece9707,SystemUUID:7b2cc9e9-09d1-0f7d-f61b-26e8aece9707,BootID:64607970-cc6d-408c-9269-dff979065832,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.44+45279654db87f4,KubeProxyVersion:v1.27.0-alpha.0.44+45279654db87f4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:67201224,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 registry.k8s.io/sig-storage/snapshot-controller:v6.1.0],SizeBytes:22620891,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-7570^55118aeb-6bd7-11ed-8dba-2207550599a3 kubernetes.io/csi/csi-hostpath-ephemeral-8753^758a12fe-6bd7-11ed-b4fd-0e9a0f0cf363],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-8753^758a12fe-6bd7-11ed-b4fd-0e9a0f0cf363,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-7570^55118aeb-6bd7-11ed-8dba-2207550599a3,DevicePath:,},},Config:nil,},}
Nov 24 09:33:11.465: INFO: 
Logging kubelet events for node bootstrap-e2e-minion-group-6m4q
Nov 24 09:33:11.562: INFO: 
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-6m4q
Nov 24 09:33:12.018: INFO: pod-0 started at 2022-11-24 09:04:46 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:12.018: INFO: 	Container donothing ready: true, restart count 5
Nov 24 09:33:12.018: INFO: netserver-1 started at 2022-11-24 09:18:27 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:12.018: INFO: 	Container webserver ready: false, restart count 7
Nov 24 09:33:12.018: INFO: pod-client started at 2022-11-24 09:33:02 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:12.018: INFO: 	Container pod-client ready: false, restart count 0
Nov 24 09:33:12.018: INFO: webserver-7d887d45b-lr79x started at 2022-11-24 09:07:41 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:12.018: INFO: 	Container httpd ready: false, restart count 7
Nov 24 09:33:12.018: INFO: kube-proxy-bootstrap-e2e-minion-group-6m4q started at 2022-11-24 09:00:35 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:12.018: INFO: 	Container kube-proxy ready: false, restart count 8
Nov 24 09:33:12.018: INFO: netserver-1 started at 2022-11-24 09:04:04 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:12.018: INFO: 	Container webserver ready: false, restart count 9
Nov 24 09:33:12.018: INFO: inline-volume-tester-2k2tt started at 2022-11-24 09:18:27 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:12.018: INFO: 	Container csi-volume-tester ready: false, restart count 0
Nov 24 09:33:12.018: INFO: csi-hostpathplugin-0 started at 2022-11-24 09:06:47 +0000 UTC (0+7 container statuses recorded)
Nov 24 09:33:12.018: INFO: 	Container csi-attacher ready: false, restart count 9
Nov 24 09:33:12.018: INFO: 	Container csi-provisioner ready: false, restart count 9
Nov 24 09:33:12.018: INFO: 	Container csi-resizer ready: false, restart count 9
Nov 24 09:33:12.018: INFO: 	Container csi-snapshotter ready: false, restart count 9
Nov 24 09:33:12.018: INFO: 	Container hostpath ready: false, restart count 9
Nov 24 09:33:12.018: INFO: 	Container liveness-probe ready: false, restart count 9
Nov 24 09:33:12.018: INFO: 	Container node-driver-registrar ready: false, restart count 8
Nov 24 09:33:12.018: INFO: csi-mockplugin-0 started at 2022-11-24 09:30:45 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:33:12.018: INFO: 	Container csi-provisioner ready: true, restart count 0
Nov 24 09:33:12.018: INFO: 	Container driver-registrar ready: true, restart count 0
Nov 24 09:33:12.018: INFO: 	Container mock ready: true, restart count 0
Nov 24 09:33:12.019: INFO: csi-hostpathplugin-0 started at 2022-11-24 09:07:37 +0000 UTC (0+7 container statuses recorded)
Nov 24 09:33:12.019: INFO: 	Container csi-attacher ready: true, restart count 8
Nov 24 09:33:12.019: INFO: 	Container csi-provisioner ready: true, restart count 8
Nov 24 09:33:12.019: INFO: 	Container csi-resizer ready: true, restart count 8
Nov 24 09:33:12.019: INFO: 	Container csi-snapshotter ready: true, restart count 8
Nov 24 09:33:12.019: INFO: 	Container hostpath ready: true, restart count 8
Nov 24 09:33:12.019: INFO: 	Container liveness-probe ready: true, restart count 8
Nov 24 09:33:12.019: INFO: 	Container node-driver-registrar ready: true, restart count 7
Nov 24 09:33:12.019: INFO: pvc-volume-tester-8w74v started at 2022-11-24 09:07:38 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:12.019: INFO: 	Container volume-tester ready: false, restart count 0
Nov 24 09:33:12.019: INFO: pod-service-account-nomountsa started at 2022-11-24 09:30:54 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:12.019: INFO: 	Container token-test ready: false, restart count 0
Nov 24 09:33:12.019: INFO: pod-service-account-defaultsa-mountspec started at 2022-11-24 09:30:54 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:12.019: INFO: 	Container token-test ready: false, restart count 0
Nov 24 09:33:12.019: INFO: pod-service-account-mountsa-nomountspec started at 2022-11-24 09:30:55 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:12.019: INFO: 	Container token-test ready: false, restart count 0
Nov 24 09:33:12.019: INFO: webserver-pod started at 2022-11-24 09:04:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:12.019: INFO: 	Container agnhost ready: true, restart count 5
Nov 24 09:33:12.019: INFO: l7-default-backend-8549d69d99-762zc started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:12.019: INFO: 	Container default-http-backend ready: true, restart count 0
Nov 24 09:33:12.019: INFO: konnectivity-agent-k4jdw started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:12.019: INFO: 	Container konnectivity-agent ready: false, restart count 8
Nov 24 09:33:12.019: INFO: httpd-deployment-6859889f88-22w25 started at 2022-11-24 09:04:51 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:12.019: INFO: 	Container httpd ready: false, restart count 6
Nov 24 09:33:12.019: INFO: my-hostname-private-ae51c3f4-8897-433b-b3ed-7b3c0ce69bc4-9dsrv started at 2022-11-24 09:18:27 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:12.019: INFO: 	Container my-hostname-private-ae51c3f4-8897-433b-b3ed-7b3c0ce69bc4 ready: true, restart count 5
Nov 24 09:33:12.019: INFO: metadata-proxy-v0.1-lwtk4 started at 2022-11-24 09:00:35 +0000 UTC (0+2 container statuses recorded)
Nov 24 09:33:12.019: INFO: 	Container metadata-proxy ready: true, restart count 0
Nov 24 09:33:12.019: INFO: 	Container prometheus-to-sd-exporter ready: true, restart count 0
Nov 24 09:33:12.019: INFO: kube-dns-autoscaler-5f6455f985-hxtg5 started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:12.019: INFO: 	Container autoscaler ready: false, restart count 9
Nov 24 09:33:12.019: INFO: pod-configmaps-6929437e-13e1-4a93-b7fa-e8ec8d7c7138 started at 2022-11-24 09:04:04 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:33:12.019: INFO: 	Container createcm-volume-test ready: false, restart count 0
Nov 24 09:33:12.019: INFO: 	Container delcm-volume-test ready: false, restart count 0
Nov 24 09:33:12.019: INFO: 	Container updcm-volume-test ready: false, restart count 0
Nov 24 09:33:12.019: INFO: pod-client started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:12.019: INFO: 	Container pod-client ready: false, restart count 5
Nov 24 09:33:12.019: INFO: external-provisioner-7zgkv started at 2022-11-24 09:30:57 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:12.019: INFO: 	Container nfs-provisioner ready: true, restart count 0
Nov 24 09:33:12.019: INFO: csi-hostpathplugin-0 started at 2022-11-24 09:30:59 +0000 UTC (0+7 container statuses recorded)
Nov 24 09:33:12.019: INFO: 	Container csi-attacher ready: true, restart count 1
Nov 24 09:33:12.019: INFO: 	Container csi-provisioner ready: true, restart count 1
Nov 24 09:33:12.019: INFO: 	Container csi-resizer ready: true, restart count 1
Nov 24 09:33:12.019: INFO: 	Container csi-snapshotter ready: true, restart count 1
Nov 24 09:33:12.019: INFO: 	Container hostpath ready: true, restart count 1
Nov 24 09:33:12.019: INFO: 	Container liveness-probe ready: true, restart count 1
Nov 24 09:33:12.019: INFO: 	Container node-driver-registrar ready: true, restart count 1
Nov 24 09:33:12.019: INFO: netserver-1 started at 2022-11-24 09:04:49 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:12.019: INFO: 	Container webserver ready: false, restart count 8
Nov 24 09:33:12.019: INFO: inline-volume-tester-vc928 started at 2022-11-24 09:07:38 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:12.019: INFO: 	Container csi-volume-tester ready: false, restart count 0
Nov 24 09:33:12.019: INFO: pod-subpath-test-secret-56vz started at 2022-11-24 09:04:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:12.019: INFO: 	Container test-container-subpath-secret-56vz ready: false, restart count 0
Nov 24 09:33:12.019: INFO: inline-volume-tester-rr76m started at 2022-11-24 09:07:45 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:12.019: INFO: 	Container csi-volume-tester ready: false, restart count 0
Nov 24 09:33:12.019: INFO: csi-mockplugin-attacher-0 started at 2022-11-24 09:30:45 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:12.019: INFO: 	Container csi-attacher ready: true, restart count 0
Nov 24 09:33:12.019: INFO: simpletest.rc-gpbmh started at 2022-11-24 09:30:56 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:12.019: INFO: 	Container nginx ready: true, restart count 0
Nov 24 09:33:12.019: INFO: pod-release-42mdk started at 2022-11-24 09:31:00 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:12.019: INFO: 	Container pod-release ready: false, restart count 0
Nov 24 09:33:12.019: INFO: csi-mockplugin-0 started at 2022-11-24 09:06:45 +0000 UTC (0+4 container statuses recorded)
Nov 24 09:33:12.019: INFO: 	Container busybox ready: false, restart count 6
Nov 24 09:33:12.019: INFO: 	Container csi-provisioner ready: false, restart count 7
Nov 24 09:33:12.019: INFO: 	Container driver-registrar ready: false, restart count 7
Nov 24 09:33:12.019: INFO: 	Container mock ready: false, restart count 7
Nov 24 09:33:12.019: INFO: hostexec-bootstrap-e2e-minion-group-6m4q-qcs7x started at 2022-11-24 09:30:53 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:12.019: INFO: 	Container agnhost-container ready: true, restart count 0
Nov 24 09:33:12.019: INFO: up-down-1-zxx6f started at 2022-11-24 09:30:54 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:12.019: INFO: 	Container up-down-1 ready: true, restart count 0
Nov 24 09:33:12.019: INFO: hostexec-bootstrap-e2e-minion-group-6m4q-h8v54 started at 2022-11-24 09:04:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:12.019: INFO: 	Container agnhost-container ready: true, restart count 7
Nov 24 09:33:12.019: INFO: pod-service-account-defaultsa-nomountspec started at 2022-11-24 09:30:55 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:12.019: INFO: 	Container token-test ready: true, restart count 0
Nov 24 09:33:12.019: INFO: coredns-6d97d5ddb-9z7tn started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:12.019: INFO: 	Container coredns ready: false, restart count 10
Nov 24 09:33:12.019: INFO: volume-snapshot-controller-0 started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:12.019: INFO: 	Container volume-snapshot-controller ready: true, restart count 7
Nov 24 09:33:12.019: INFO: ss2-2 started at 2022-11-24 09:18:27 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:12.019: INFO: 	Container webserver ready: false, restart count 5
Nov 24 09:33:12.019: INFO: liveness-285ed85f-af70-4221-a9ae-9d3784882e9c started at 2022-11-24 09:06:27 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:12.019: INFO: 	Container agnhost-container ready: true, restart count 4
Nov 24 09:33:13.244: INFO: 
Latency metrics for node bootstrap-e2e-minion-group-6m4q
Nov 24 09:33:13.244: INFO: 
Logging node info for node bootstrap-e2e-minion-group-fj34
Nov 24 09:33:13.288: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-fj34    26b0a38a-1259-4217-8b0f-bfa92e43b570 13594 0 2022-11-24 09:00:32 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-fj34 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-fj34 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-4261":"bootstrap-e2e-minion-group-fj34","csi-hostpath-ephemeral-4353":"bootstrap-e2e-minion-group-fj34","csi-hostpath-ephemeral-9395":"bootstrap-e2e-minion-group-fj34","csi-mock-csi-mock-volumes-9394":"bootstrap-e2e-minion-group-fj34"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-11-24 09:00:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kubelet Update v1 2022-11-24 09:00:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-24 09:10:50 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {node-problem-detector Update v1 2022-11-24 09:30:41 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-24 09:33:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-serial-1-6/us-west1-b/bootstrap-e2e-minion-group-fj34,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-24 09:30:41 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-24 09:30:41 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-24 09:30:41 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-24 09:30:41 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-24 09:30:41 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-24 09:30:41 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-24 09:30:41 +0000 UTC,LastTransitionTime:2022-11-24 09:00:36 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-24 09:00:50 +0000 UTC,LastTransitionTime:2022-11-24 09:00:50 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-24 09:33:05 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-24 09:33:05 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-24 09:33:05 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-24 09:33:05 +0000 UTC,LastTransitionTime:2022-11-24 09:00:32 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.82.73.153,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-fj34.c.k8s-jkns-gce-serial-1-6.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-fj34.c.k8s-jkns-gce-serial-1-6.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:557b5201a29dc5c84dc79b98af6f523a,SystemUUID:557b5201-a29d-c5c8-4dc7-9b98af6f523a,BootID:0f4289cb-5f88-4ee3-b552-b99fcc030f54,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.44+45279654db87f4,KubeProxyVersion:v1.27.0-alpha.0.44+45279654db87f4,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.44_45279654db87f4],SizeBytes:67201224,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:c0ddb4794bc8a3631e3373015f913c00b230ee54f87bde9ade195b3a3415c60f registry.k8s.io/build-image/distroless-iptables:v0.1.2],SizeBytes:7685585,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-1806^5a1ffb25-6bd7-11ed-9365-7e36e6fec9d2 kubernetes.io/csi/csi-mock-csi-mock-volumes-9231^cbf4a4b9-6bd6-11ed-88e7-326e345b4078],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-9231^cbf4a4b9-6bd6-11ed-88e7-326e345b4078,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-1806^5a1ffb25-6bd7-11ed-9365-7e36e6fec9d2,DevicePath:,},},Config:nil,},}
Nov 24 09:33:13.289: INFO: 
Logging kubelet events for node bootstrap-e2e-minion-group-fj34
Nov 24 09:33:13.341: INFO: 
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-fj34
Nov 24 09:33:13.795: INFO: test-pod-2 started at 2022-11-24 09:02:40 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.795: INFO: 	Container token-test ready: false, restart count 0
Nov 24 09:33:13.795: INFO: csi-hostpathplugin-0 started at 2022-11-24 09:03:06 +0000 UTC (0+7 container statuses recorded)
Nov 24 09:33:13.795: INFO: 	Container csi-attacher ready: true, restart count 6
Nov 24 09:33:13.795: INFO: 	Container csi-provisioner ready: true, restart count 6
Nov 24 09:33:13.795: INFO: 	Container csi-resizer ready: true, restart count 6
Nov 24 09:33:13.795: INFO: 	Container csi-snapshotter ready: true, restart count 6
Nov 24 09:33:13.795: INFO: 	Container hostpath ready: true, restart count 6
Nov 24 09:33:13.795: INFO: 	Container liveness-probe ready: true, restart count 6
Nov 24 09:33:13.795: INFO: 	Container node-driver-registrar ready: true, restart count 6
Nov 24 09:33:13.795: INFO: hostexec-bootstrap-e2e-minion-group-fj34-z4nnm started at 2022-11-24 09:06:46 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.795: INFO: 	Container agnhost-container ready: true, restart count 9
Nov 24 09:33:13.795: INFO: pod-subpath-test-inlinevolume-mcdr started at 2022-11-24 09:04:49 +0000 UTC (2+1 container statuses recorded)
Nov 24 09:33:13.795: INFO: 	Init container init-volume-inlinevolume-mcdr ready: true, restart count 0
Nov 24 09:33:13.795: INFO: 	Init container test-init-volume-inlinevolume-mcdr ready: true, restart count 0
Nov 24 09:33:13.795: INFO: 	Container test-container-subpath-inlinevolume-mcdr ready: false, restart count 0
Nov 24 09:33:13.795: INFO: test-container-pod started at 2022-11-24 09:24:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.795: INFO: 	Container webserver ready: true, restart count 2
Nov 24 09:33:13.795: INFO: hostexec-bootstrap-e2e-minion-group-fj34-2qzg9 started at 2022-11-24 09:30:53 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.795: INFO: 	Container agnhost-container ready: true, restart count 2
Nov 24 09:33:13.795: INFO: test-pod-1 started at 2022-11-24 09:02:40 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.795: INFO: 	Container token-test ready: false, restart count 0
Nov 24 09:33:13.795: INFO: hostexec-bootstrap-e2e-minion-group-fj34-9j92x started at 2022-11-24 09:04:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.795: INFO: 	Container agnhost-container ready: true, restart count 5
Nov 24 09:33:13.795: INFO: httpd-deployment-6859889f88-whrb9 started at 2022-11-24 09:05:53 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.795: INFO: 	Container httpd ready: false, restart count 7
Nov 24 09:33:13.795: INFO: csi-mockplugin-0 started at 2022-11-24 09:06:32 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:33:13.795: INFO: 	Container csi-provisioner ready: false, restart count 7
Nov 24 09:33:13.795: INFO: 	Container driver-registrar ready: false, restart count 7
Nov 24 09:33:13.795: INFO: 	Container mock ready: false, restart count 7
Nov 24 09:33:13.795: INFO: webserver-7d887d45b-g8gjr started at 2022-11-24 09:07:41 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.795: INFO: 	Container httpd ready: false, restart count 7
Nov 24 09:33:13.795: INFO: test-host-network-pod started at 2022-11-24 09:30:47 +0000 UTC (0+2 container statuses recorded)
Nov 24 09:33:13.795: INFO: 	Container busybox-1 ready: false, restart count 2
Nov 24 09:33:13.795: INFO: 	Container busybox-2 ready: false, restart count 2
Nov 24 09:33:13.795: INFO: metrics-server-v0.5.2-867b8754b9-lprlm started at 2022-11-24 09:01:14 +0000 UTC (0+2 container statuses recorded)
Nov 24 09:33:13.795: INFO: 	Container metrics-server ready: false, restart count 9
Nov 24 09:33:13.795: INFO: 	Container metrics-server-nanny ready: false, restart count 9
Nov 24 09:33:13.795: INFO: netserver-2 started at 2022-11-24 09:04:04 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.795: INFO: 	Container webserver ready: true, restart count 7
Nov 24 09:33:13.795: INFO: csi-mockplugin-0 started at 2022-11-24 09:02:44 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:33:13.795: INFO: 	Container csi-provisioner ready: true, restart count 6
Nov 24 09:33:13.795: INFO: 	Container driver-registrar ready: true, restart count 6
Nov 24 09:33:13.795: INFO: 	Container mock ready: true, restart count 6
Nov 24 09:33:13.795: INFO: execpodpxn7d started at 2022-11-24 09:18:55 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.795: INFO: 	Container agnhost-container ready: true, restart count 1
Nov 24 09:33:13.795: INFO: netserver-2 started at 2022-11-24 09:04:49 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.795: INFO: 	Container webserver ready: true, restart count 9
Nov 24 09:33:13.795: INFO: csi-mockplugin-attacher-0 started at 2022-11-24 09:02:44 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.795: INFO: 	Container csi-attacher ready: true, restart count 7
Nov 24 09:33:13.795: INFO: external-provisioner-br7l6 started at 2022-11-24 09:13:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.795: INFO: 	Container nfs-provisioner ready: false, restart count 6
Nov 24 09:33:13.795: INFO: csi-hostpathplugin-0 started at 2022-11-24 09:18:54 +0000 UTC (0+7 container statuses recorded)
Nov 24 09:33:13.795: INFO: 	Container csi-attacher ready: true, restart count 1
Nov 24 09:33:13.795: INFO: 	Container csi-provisioner ready: true, restart count 1
Nov 24 09:33:13.795: INFO: 	Container csi-resizer ready: true, restart count 1
Nov 24 09:33:13.795: INFO: 	Container csi-snapshotter ready: true, restart count 1
Nov 24 09:33:13.795: INFO: 	Container hostpath ready: true, restart count 1
Nov 24 09:33:13.795: INFO: 	Container liveness-probe ready: true, restart count 1
Nov 24 09:33:13.795: INFO: 	Container node-driver-registrar ready: true, restart count 1
Nov 24 09:33:13.795: INFO: labelsupdate8c301c33-dc6a-450c-b014-b58592fac366 started at 2022-11-24 09:30:43 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.795: INFO: 	Container client-container ready: false, restart count 0
Nov 24 09:33:13.795: INFO: up-down-1-l6klw started at 2022-11-24 09:30:54 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.795: INFO: 	Container up-down-1 ready: true, restart count 2
Nov 24 09:33:13.795: INFO: konnectivity-agent-jjqhp started at 2022-11-24 09:00:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.795: INFO: 	Container konnectivity-agent ready: false, restart count 8
Nov 24 09:33:13.795: INFO: pod-subpath-test-preprovisionedpv-bvlk started at 2022-11-24 09:07:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.795: INFO: 	Container test-container-subpath-preprovisionedpv-bvlk ready: false, restart count 0
Nov 24 09:33:13.795: INFO: host-test-container-pod started at 2022-11-24 09:24:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.795: INFO: 	Container agnhost-container ready: true, restart count 1
Nov 24 09:33:13.795: INFO: kube-proxy-bootstrap-e2e-minion-group-fj34 started at 2022-11-24 09:00:32 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.795: INFO: 	Container kube-proxy ready: false, restart count 9
Nov 24 09:33:13.795: INFO: metadata-proxy-v0.1-rtz4q started at 2022-11-24 09:00:33 +0000 UTC (0+2 container statuses recorded)
Nov 24 09:33:13.795: INFO: 	Container metadata-proxy ready: true, restart count 0
Nov 24 09:33:13.795: INFO: 	Container prometheus-to-sd-exporter ready: true, restart count 0
Nov 24 09:33:13.795: INFO: pvc-volume-tester-5zg8r started at 2022-11-24 09:03:02 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.795: INFO: 	Container volume-tester ready: false, restart count 0
Nov 24 09:33:13.795: INFO: pvc-volume-tester-txtfw started at 2022-11-24 09:07:37 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.795: INFO: 	Container volume-tester ready: false, restart count 0
Nov 24 09:33:13.795: INFO: csi-mockplugin-attacher-0 started at 2022-11-24 09:06:32 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.795: INFO: 	Container csi-attacher ready: false, restart count 10
Nov 24 09:33:13.795: INFO: backofflimit-nvwhc started at 2022-11-24 09:30:44 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.795: INFO: 	Container c ready: false, restart count 0
Nov 24 09:33:13.795: INFO: netserver-2 started at 2022-11-24 09:18:27 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.795: INFO: 	Container webserver ready: false, restart count 5
Nov 24 09:33:13.795: INFO: ss2-1 started at 2022-11-24 09:18:38 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.795: INFO: 	Container webserver ready: true, restart count 7
Nov 24 09:33:13.795: INFO: pod-1 started at 2022-11-24 09:30:48 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.795: INFO: 	Container agnhost-container ready: false, restart count 0
Nov 24 09:33:13.795: INFO: csi-mockplugin-0 started at 2022-11-24 09:02:44 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:33:13.795: INFO: 	Container csi-provisioner ready: false, restart count 8
Nov 24 09:33:13.795: INFO: 	Container driver-registrar ready: false, restart count 8
Nov 24 09:33:13.795: INFO: 	Container mock ready: false, restart count 8
Nov 24 09:33:13.795: INFO: csi-mockplugin-resizer-0 started at 2022-11-24 09:02:44 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.795: INFO: 	Container csi-resizer ready: true, restart count 7
Nov 24 09:33:13.795: INFO: csi-hostpathplugin-0 started at 2022-11-24 09:30:57 +0000 UTC (0+7 container statuses recorded)
Nov 24 09:33:13.795: INFO: 	Container csi-attacher ready: true, restart count 4
Nov 24 09:33:13.795: INFO: 	Container csi-provisioner ready: true, restart count 4
Nov 24 09:33:13.795: INFO: 	Container csi-resizer ready: true, restart count 4
Nov 24 09:33:13.795: INFO: 	Container csi-snapshotter ready: true, restart count 4
Nov 24 09:33:13.795: INFO: 	Container hostpath ready: true, restart count 4
Nov 24 09:33:13.795: INFO: 	Container liveness-probe ready: true, restart count 4
Nov 24 09:33:13.795: INFO: 	Container node-driver-registrar ready: true, restart count 4
Nov 24 09:33:13.795: INFO: csi-mockplugin-attacher-0 started at 2022-11-24 09:02:44 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.795: INFO: 	Container csi-attacher ready: false, restart count 7
Nov 24 09:33:13.795: INFO: test-pod started at 2022-11-24 09:30:45 +0000 UTC (0+3 container statuses recorded)
Nov 24 09:33:13.795: INFO: 	Container busybox-1 ready: true, restart count 0
Nov 24 09:33:13.795: INFO: 	Container busybox-2 ready: true, restart count 0
Nov 24 09:33:13.795: INFO: 	Container busybox-3 ready: true, restart count 0
Nov 24 09:33:13.795: INFO: update-demo-nautilus-56j4t started at 2022-11-24 09:18:35 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.795: INFO: 	Container update-demo ready: true, restart count 4
Nov 24 09:33:13.795: INFO: apparmor-loader-lq5ht started at 2022-11-24 09:30:50 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.795: INFO: 	Container apparmor-loader ready: true, restart count 0
Nov 24 09:33:13.795: INFO: csi-hostpathplugin-0 started at 2022-11-24 09:30:51 +0000 UTC (0+7 container statuses recorded)
Nov 24 09:33:13.795: INFO: 	Container csi-attacher ready: true, restart count 2
Nov 24 09:33:13.795: INFO: 	Container csi-provisioner ready: true, restart count 2
Nov 24 09:33:13.795: INFO: 	Container csi-resizer ready: true, restart count 2
Nov 24 09:33:13.795: INFO: 	Container csi-snapshotter ready: true, restart count 2
Nov 24 09:33:13.795: INFO: 	Container hostpath ready: true, restart count 2
Nov 24 09:33:13.795: INFO: 	Container liveness-probe ready: true, restart count 2
Nov 24 09:33:13.795: INFO: 	Container node-driver-registrar ready: true, restart count 2
Nov 24 09:33:13.795: INFO: hostexec-bootstrap-e2e-minion-group-fj34-z7grr started at 2022-11-24 09:30:53 +0000 UTC (0+1 container statuses recorded)
Nov 24 09:33:13.795: INFO: 	Container agnhost-container ready: true, restart count 3
Nov 24 09:33:16.287: INFO: 
Latency metrics for node bootstrap-e2e-minion-group-fj34
[DeferCleanup (Each)] [sig-api-machinery] Garbage collector
  tear down framework | framework.go:193
STEP: Destroying namespace "gc-1117" for this suite. 11/24/22 09:33:16.287

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-api-machinery] Garbage collector should support orphan deletion of custom resources 30s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sGarbage\scollector\sshould\ssupport\sorphan\sdeletion\sof\scustom\sresources$'

test/e2e/framework/framework.go:241
k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc001174ff0)
	test/e2e/framework/framework.go:241 +0x96f
				[BeforeEach] [sig-api-machinery] Garbage collector
  set up framework | framework.go:178
STEP: Creating a kubernetes client 11/24/22 09:08:13.551
Nov 24 09:08:13.551: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Building a namespace api object, basename gc 11/24/22 09:08:13.552
Nov 24 09:08:13.591: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:08:15.631: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:08:17.632: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:08:19.631: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:08:21.631: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:08:23.631: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:08:25.631: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:08:27.631: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:08:29.631: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:08:31.631: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:08:33.631: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:08:35.631: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:08:37.631: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:08:39.631: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:08:41.631: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:08:43.633: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:08:43.672: INFO: Unexpected error while creating namespace: Post "https://35.233.217.30/api/v1/namespaces": dial tcp 35.233.217.30:443: connect: connection refused
Nov 24 09:08:43.672: INFO: Unexpected error: 
    <*errors.errorString | 0xc000217c50>: {
        s: "timed out waiting for the condition",
    }
Nov 24 09:08:43.672: FAIL: timed out waiting for the condition

Full Stack Trace
k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc001174ff0)
	test/e2e/framework/framework.go:241 +0x96f
[AfterEach] [sig-api-machinery] Garbage collector
  test/e2e/framework/node/init/init.go:32
Nov 24 09:08:43.672: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-api-machinery] Garbage collector
  dump namespaces | framework.go:196
STEP: dump namespace information after failure 11/24/22 09:08:43.712
[DeferCleanup (Each)] [sig-api-machinery] Garbage collector
  tear down framework | framework.go:193

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-api-machinery] Generated clientset should create pods, set the deletionTimestamp and deletionGracePeriodSeconds of the pod 2m1s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sGenerated\sclientset\sshould\screate\spods\,\sset\sthe\sdeletionTimestamp\sand\sdeletionGracePeriodSeconds\sof\sthe\spod$'

test/e2e/framework/framework.go:241
k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc000ef30e0)
	test/e2e/framework/framework.go:241 +0x96f
				[BeforeEach] [sig-api-machinery] Generated clientset
  set up framework | framework.go:178
STEP: Creating a kubernetes client 11/24/22 09:27:43.47
Nov 24 09:27:43.470: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Building a namespace api object, basename clientset 11/24/22 09:27:43.472
Nov 24 09:29:43.527: INFO: Unexpected error: 
    <*fmt.wrapError | 0xc001408020>: {
        msg: "wait for service account \"default\" in namespace \"clientset-6880\": timed out waiting for the condition",
        err: <*errors.errorString | 0xc0000d1db0>{
            s: "timed out waiting for the condition",
        },
    }
Nov 24 09:29:43.527: FAIL: wait for service account "default" in namespace "clientset-6880": timed out waiting for the condition

Full Stack Trace
k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc000ef30e0)
	test/e2e/framework/framework.go:241 +0x96f
[AfterEach] [sig-api-machinery] Generated clientset
  test/e2e/framework/node/init/init.go:32
Nov 24 09:29:43.528: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-api-machinery] Generated clientset
  dump namespaces | framework.go:196
STEP: dump namespace information after failure 11/24/22 09:29:43.577
STEP: Collecting events from namespace "clientset-6880". 11/24/22 09:29:43.577
STEP: Found 0 events. 11/24/22 09:29:43.618
Nov 24 09:29:43.659: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Nov 24 09:29:43.659: INFO: 
Nov 24 09:29:43.716: INFO: 
Logging node info for node bootstrap-e2e-master
Nov 24 09:29:43.758: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master    57b53f45-775d-4de5-a4ff-420df60cf61e 12044 0 2022-11-24 09:00:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-24 09:00:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-11-24 09:00:50 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-11-24 09:00:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}},"f:

Result	FAILURE
Tests	337 failed / 261 succeeded
Started	2022-11-24 08:55
Elapsed	1h3m
Revision
Builder	abcc6b06-6bd5-11ed-a6da-22215f11743a
control_plane_node_os_image	cos-97-16919-103-16
infra-commit	0915cbf7b
job-version	v1.27.0-alpha.0.44+45279654db87f4
kubetest-version	v20221116-7c85504268
repo	github.com/containerd/containerd
repo-commit	d06318622178a2209338d7f57eb8800b9f2e72fb
repos	{u'github.com/containerd/containerd': u'main'}
revision	v1.27.0-alpha.0.44+45279654db87f4
worker_node_os_image	cos-97-16919-103-16