ci-cri-containerd-e2e-cos-gce-proto #1595520297128169472
Recent runs || View in Spyglass
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\slisting\smutating\swebhooks\sshould\swork\s\[Conformance\]$'
test/e2e/framework/framework.go:241
k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc00115fe00)
test/e2e/framework/framework.go:241 +0x96f
There were additional failures detected after the initial failure:
[PANICKED]
Test Panicked
In [AfterEach] at: /usr/local/go/src/runtime/panic.go:260
runtime error: invalid memory address or nil pointer dereference
Full Stack Trace
k8s.io/kubernetes/test/e2e/apimachinery.cleanWebhookTest({0x0, 0x0}, {0x0, 0x0})
test/e2e/apimachinery/webhook.go:1680 +0x46
k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.2()
test/e2e/apimachinery/webhook.go:106 +0x2f
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
set up framework | framework.go:178
STEP: Creating a kubernetes client 11/23/22 21:35:03.128
Nov 23 21:35:03.128: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Building a namespace api object, basename webhook 11/23/22 21:35:03.13
Nov 23 21:35:03.174: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:35:05.215: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:35:07.215: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:35:09.215: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:35:11.216: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:35:13.215: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:35:15.214: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:35:17.215: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:35:19.215: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:35:21.215: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:35:23.215: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:35:25.215: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:35:27.215: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:35:29.215: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:35:31.215: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:35:33.215: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:35:33.255: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:35:33.255: INFO: Unexpected error:
<*errors.errorString | 0xc00011dd70>: {
s: "timed out waiting for the condition",
}
Nov 23 21:35:33.255: FAIL: timed out waiting for the condition
Full Stack Trace
k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc00115fe00)
test/e2e/framework/framework.go:241 +0x96f
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/framework/node/init/init.go:32
Nov 23 21:35:33.256: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/apimachinery/webhook.go:105
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
dump namespaces | framework.go:196
STEP: dump namespace information after failure 11/23/22 21:35:33.296
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
tear down framework | framework.go:193
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\spatching\/updating\sa\smutating\swebhook\sshould\swork\s\[Conformance\]$'
test/e2e/apimachinery/webhook.go:530 k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.17() test/e2e/apimachinery/webhook.go:530 +0x390from junit_01.xml
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] set up framework | framework.go:178 STEP: Creating a kubernetes client 11/23/22 20:59:50.369 Nov 23 20:59:50.369: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Building a namespace api object, basename webhook 11/23/22 20:59:50.373 Nov 23 20:59:50.431: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 20:59:52.474: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 20:59:54.472: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 20:59:56.474: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 20:59:58.472: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:00:00.472: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:00:02.472: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:00:04.473: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:00:06.473: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:00:08.473: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:00:10.473: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:00:12.472: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:00:14.473: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:00:16.472: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:00:18.474: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused STEP: Waiting for a default service account to be provisioned in namespace 11/23/22 21:01:20.862 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 11/23/22 21:01:20.951 [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/apimachinery/webhook.go:90 STEP: Setting up server cert 11/23/22 21:01:21.229 STEP: Create role binding to let webhook read extension-apiserver-authentication 11/23/22 21:01:22.402 STEP: Deploying the webhook pod 11/23/22 21:01:22.446 STEP: Wait for the deployment to be ready 11/23/22 21:01:22.542 Nov 23 21:01:22.694: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 23 21:01:24.746: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 23 21:01:26.759: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 23 21:01:28.842: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 23 21:01:30.858: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 23 21:01:32.798: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 23 21:01:34.765: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 23 21:01:36.926: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 23 21:01:38.779: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 23 21:01:40.766: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 23 21:01:42.805: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 23 21:01:44.760: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 23 21:01:46.782: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 23 21:01:48.758: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 23 21:01:50.822: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 23 21:01:52.770: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 23 21:01:54.746: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 23 21:01:56.774: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 23 21:01:58.769: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 23 21:02:00.753: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 23 21:02:02.757: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 23 21:02:04.749: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 23 21:02:06.748: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 1, 22, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} STEP: Deploying the webhook service 11/23/22 21:02:08.749 STEP: Verifying the service has paired with the endpoint 11/23/22 21:02:08.856 Nov 23 21:02:09.857: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1 [It] patching/updating a mutating webhook should work [Conformance] test/e2e/apimachinery/webhook.go:508 STEP: Creating a mutating webhook configuration 11/23/22 21:02:09.927 Nov 23 21:02:20.177: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:30.369: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:35.732: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:35.863: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:35.964: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:36.063: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:36.171: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:36.263: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:36.369: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:36.462: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:36.562: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:36.663: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:36.767: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:36.862: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:36.963: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:37.063: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:37.177: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:37.383: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:37.571: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:37.662: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:37.771: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:37.862: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:37.964: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:38.065: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:38.164: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:38.265: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:38.364: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:38.470: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:38.565: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:38.662: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:38.767: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:38.862: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:38.963: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:39.063: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:39.195: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:39.383: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:39.571: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:39.672: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:39.766: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:39.864: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:39.964: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:40.065: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:40.168: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:40.266: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:40.460: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:40.569: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:40.663: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:40.765: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:40.865: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:40.968: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:41.062: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:41.166: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:41.263: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:41.369: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:41.464: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:41.562: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:41.665: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:41.764: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:41.863: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:41.963: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:42.122: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:42.454: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:42.588: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:42.770: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:42.865: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:42.965: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:43.069: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:43.174: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:43.280: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:43.531: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:43.665: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:43.772: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:43.872: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:44.044: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:44.167: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:44.266: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:44.379: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:44.574: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:44.665: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:44.824: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:44.988: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:45.170: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:45.290: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:45.466: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:45.566: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:45.664: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:45.766: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:45.864: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:45.964: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:46.066: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:46.165: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:46.263: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:46.362: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:46.465: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:46.568: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:46.663: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:46.763: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:46.902: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:47.067: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:47.176: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:47.275: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:47.371: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:47.477: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:47.683: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:47.863: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:47.963: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:48.064: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:48.163: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:48.263: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:48.366: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:48.464: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:48.568: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:48.671: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:48.764: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:48.863: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:48.991: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:49.231: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:49.374: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:49.469: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:49.574: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:49.666: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:49.763: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:49.864: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:49.963: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:50.065: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:50.163: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:50.263: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:50.349: INFO: Waiting for webhook configuration to be ready... Nov 23 21:02:50.349: INFO: Unexpected error: waiting for webhook configuration to be ready: <*errors.errorString | 0xc000207d80>: { s: "timed out waiting for the condition", } Nov 23 21:02:50.349: FAIL: waiting for webhook configuration to be ready: timed out waiting for the condition Full Stack Trace k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.17() test/e2e/apimachinery/webhook.go:530 +0x390 [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/framework/node/init/init.go:32 Nov 23 21:02:50.392: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/apimachinery/webhook.go:105 [DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] dump namespaces | framework.go:196 STEP: dump namespace information after failure 11/23/22 21:02:50.707 STEP: Collecting events from namespace "webhook-9856". 11/23/22 21:02:50.707 STEP: Found 12 events. 11/23/22 21:02:50.749 Nov 23 21:02:50.749: INFO: At 2022-11-23 21:01:22 +0000 UTC - event for sample-webhook-deployment: {deployment-controller } ScalingReplicaSet: Scaled up replica set sample-webhook-deployment-865554f4d9 to 1 Nov 23 21:02:50.749: INFO: At 2022-11-23 21:01:22 +0000 UTC - event for sample-webhook-deployment-865554f4d9: {replicaset-controller } SuccessfulCreate: Created pod: sample-webhook-deployment-865554f4d9-75ktw Nov 23 21:02:50.749: INFO: At 2022-11-23 21:01:22 +0000 UTC - event for sample-webhook-deployment-865554f4d9-75ktw: {default-scheduler } Scheduled: Successfully assigned webhook-9856/sample-webhook-deployment-865554f4d9-75ktw to bootstrap-e2e-minion-group-3h36 Nov 23 21:02:50.749: INFO: At 2022-11-23 21:01:25 +0000 UTC - event for sample-webhook-deployment-865554f4d9-75ktw: {kubelet bootstrap-e2e-minion-group-3h36} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Nov 23 21:02:50.749: INFO: At 2022-11-23 21:01:25 +0000 UTC - event for sample-webhook-deployment-865554f4d9-75ktw: {kubelet bootstrap-e2e-minion-group-3h36} Created: Created container sample-webhook Nov 23 21:02:50.749: INFO: At 2022-11-23 21:01:25 +0000 UTC - event for sample-webhook-deployment-865554f4d9-75ktw: {kubelet bootstrap-e2e-minion-group-3h36} Started: Started container sample-webhook Nov 23 21:02:50.749: INFO: At 2022-11-23 21:01:26 +0000 UTC - event for sample-webhook-deployment-865554f4d9-75ktw: {kubelet bootstrap-e2e-minion-group-3h36} Killing: Stopping container sample-webhook Nov 23 21:02:50.749: INFO: At 2022-11-23 21:01:27 +0000 UTC - event for sample-webhook-deployment-865554f4d9-75ktw: {kubelet bootstrap-e2e-minion-group-3h36} Unhealthy: Readiness probe failed: Get "https://10.64.3.139:8444/readyz": dial tcp 10.64.3.139:8444: connect: connection refused Nov 23 21:02:50.749: INFO: At 2022-11-23 21:01:28 +0000 UTC - event for sample-webhook-deployment-865554f4d9-75ktw: {kubelet bootstrap-e2e-minion-group-3h36} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Nov 23 21:02:50.749: INFO: At 2022-11-23 21:01:29 +0000 UTC - event for sample-webhook-deployment-865554f4d9-75ktw: {kubelet bootstrap-e2e-minion-group-3h36} Unhealthy: Readiness probe failed: Get "https://10.64.3.139:8444/readyz": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) Nov 23 21:02:50.749: INFO: At 2022-11-23 21:01:35 +0000 UTC - event for sample-webhook-deployment-865554f4d9-75ktw: {kubelet bootstrap-e2e-minion-group-3h36} Unhealthy: Readiness probe failed: Get "https://10.64.3.146:8444/readyz": dial tcp 10.64.3.146:8444: connect: connection refused Nov 23 21:02:50.749: INFO: At 2022-11-23 21:01:38 +0000 UTC - event for sample-webhook-deployment-865554f4d9-75ktw: {kubelet bootstrap-e2e-minion-group-3h36} BackOff: Back-off restarting failed container sample-webhook in pod sample-webhook-deployment-865554f4d9-75ktw_webhook-9856(c0cec433-b890-4373-b8e6-241163ce5f7d) Nov 23 21:02:50.790: INFO: POD NODE PHASE GRACE CONDITIONS Nov 23 21:02:50.790: INFO: sample-webhook-deployment-865554f4d9-75ktw bootstrap-e2e-minion-group-3h36 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-11-23 21:01:22 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-11-23 21:01:51 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-11-23 21:01:51 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-11-23 21:01:22 +0000 UTC }] Nov 23 21:02:50.790: INFO: Nov 23 21:02:50.833: INFO: Unable to fetch webhook-9856/sample-webhook-deployment-865554f4d9-75ktw/sample-webhook logs: an error on the server ("unknown") has prevented the request from succeeding (get pods sample-webhook-deployment-865554f4d9-75ktw) Nov 23 21:02:50.884: INFO: Logging node info for node bootstrap-e2e-master Nov 23 21:02:50.926: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master e178771e-6078-4cf7-a352-1d84c66cb7be 5347 0 2022-11-23 20:56:22 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-23 20:56:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-11-23 20:56:39 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-11-23 20:56:40 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-11-23 21:01:49 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-alpha/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3858366464 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3596222464 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-23 20:56:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:39 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-23 21:01:49 +0000 UTC,LastTransitionTime:2022-11-23 20:56:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-23 21:01:49 +0000 UTC,LastTransitionTime:2022-11-23 20:56:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-23 21:01:49 +0000 UTC,LastTransitionTime:2022-11-23 20:56:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-23 21:01:49 +0000 UTC,LastTransitionTime:2022-11-23 20:56:24 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:35.247.28.208,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-jkns-gci-gce-alpha.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-jkns-gci-gce-alpha.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:15f6e783a1401075c491684ecd23ec3a,SystemUUID:15f6e783-a140-1075-c491-684ecd23ec3a,BootID:04aebf08-8ea7-4b94-843b-308a92bf91fb,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.40+9884746f0fd338,KubeProxyVersion:v1.27.0-alpha.0.40+9884746f0fd338,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-alpha.0.40_9884746f0fd338],SizeBytes:135160275,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-alpha.0.40_9884746f0fd338],SizeBytes:124989753,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:b83c1d70989e1fe87583607bf5aee1ee34e52773d4755b95f5cf5a451962f3a4 registry.k8s.io/etcd:3.5.5-0],SizeBytes:102417044,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-alpha.0.40_9884746f0fd338],SizeBytes:57659704,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:2c111f004bec24888d8cfa2a812a38fb8341350abac67dcd0ac64e709dfe389c registry.k8s.io/kas-network-proxy/proxy-server:v0.0.33],SizeBytes:22020129,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 23 21:02:50.926: INFO: Logging kubelet events for node bootstrap-e2e-master Nov 23 21:02:50.969: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-master Nov 23 21:02:51.011: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-master: error trying to reach service: No agent available Nov 23 21:02:51.011: INFO: Logging node info for node bootstrap-e2e-minion-group-3dd6 Nov 23 21:02:51.054: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-3dd6 aba1b812-4944-438f-b4bc-79f731a0b1cc 6056 0 2022-11-23 20:56:27 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-3dd6 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-3dd6 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-174":"bootstrap-e2e-minion-group-3dd6","csi-hostpath-ephemeral-7454":"bootstrap-e2e-minion-group-3dd6","csi-mock-csi-mock-volumes-4923":"bootstrap-e2e-minion-group-3dd6"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-11-23 20:56:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {kubelet Update v1 2022-11-23 20:56:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {node-problem-detector Update v1 2022-11-23 21:01:31 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-11-23 21:02:00 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2022-11-23 21:02:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-alpha/us-west1-b/bootstrap-e2e-minion-group-3dd6,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-23 21:01:31 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-23 21:01:31 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-23 21:01:31 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-23 21:01:31 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-23 21:01:31 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-23 21:01:31 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-23 21:01:31 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-23 20:56:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:39 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-23 21:02:25 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-23 21:02:25 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-23 21:02:25 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-23 21:02:25 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.83.109.94,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-3dd6.c.k8s-jkns-gci-gce-alpha.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-3dd6.c.k8s-jkns-gci-gce-alpha.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e748f2e47d098c7d59fb0c64c73041ef,SystemUUID:e748f2e4-7d09-8c7d-59fb-0c64c73041ef,BootID:7dd715f8-7985-4853-a244-581e49eff17e,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.40+9884746f0fd338,KubeProxyVersion:v1.27.0-alpha.0.40+9884746f0fd338,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.40_9884746f0fd338],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-174^0850954f-6b72-11ed-8a23-76b571dae824],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-7454^01c1ad09-6b72-11ed-afe6-0ad9dffce272,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-174^0850954f-6b72-11ed-8a23-76b571dae824,DevicePath:,},},Config:nil,},} Nov 23 21:02:51.055: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-3dd6 Nov 23 21:02:51.099: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-3dd6 Nov 23 21:02:51.143: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-3dd6: error trying to reach service: No agent available Nov 23 21:02:51.143: INFO: Logging node info for node bootstrap-e2e-minion-group-3h36 Nov 23 21:02:51.185: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-3h36 ab6bfea1-ac11-4084-be81-dd72391e5606 6166 0 2022-11-23 20:56:27 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-3h36 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-3h36 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-volumemode-1165":"bootstrap-e2e-minion-group-3h36","csi-mock-csi-mock-volumes-4031":"bootstrap-e2e-minion-group-3h36","csi-mock-csi-mock-volumes-6008":"bootstrap-e2e-minion-group-3h36"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-23 20:56:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-23 20:56:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {node-problem-detector Update v1 2022-11-23 21:01:32 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-11-23 21:02:14 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2022-11-23 21:02:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-alpha/us-west1-b/bootstrap-e2e-minion-group-3h36,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815430144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553286144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-23 21:01:32 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-23 21:01:32 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-23 21:01:32 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-23 21:01:32 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-23 21:01:32 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-23 21:01:32 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-23 21:01:32 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-23 20:56:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:39 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-23 21:02:36 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-23 21:02:36 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-23 21:02:36 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-23 21:02:36 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:35.199.155.0,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-3h36.c.k8s-jkns-gci-gce-alpha.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-3h36.c.k8s-jkns-gci-gce-alpha.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:4aed16763bdc994e9fc6e3e0c95cb8ae,SystemUUID:4aed1676-3bdc-994e-9fc6-e3e0c95cb8ae,BootID:461d3e21-d519-43c8-ab39-0c2de0db6ed8,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.40+9884746f0fd338,KubeProxyVersion:v1.27.0-alpha.0.40+9884746f0fd338,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.40_9884746f0fd338],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 registry.k8s.io/sig-storage/snapshot-controller:v6.1.0],SizeBytes:22620891,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-volumemode-1165^1563a9dd-6b72-11ed-b993-66f87e0e4481,DevicePath:,},},Config:nil,},} Nov 23 21:02:51.185: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-3h36 Nov 23 21:02:51.228: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-3h36 Nov 23 21:02:51.275: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-3h36: error trying to reach service: No agent available Nov 23 21:02:51.275: INFO: Logging node info for node bootstrap-e2e-minion-group-qss2 Nov 23 21:02:51.317: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-qss2 0f567691-be6f-4056-8e45-f5c587fd8fff 6534 0 2022-11-23 20:56:26 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-qss2 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-qss2 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-7702":"bootstrap-e2e-minion-group-qss2","csi-hostpath-ephemeral-7934":"bootstrap-e2e-minion-group-qss2","csi-hostpath-provisioning-1098":"bootstrap-e2e-minion-group-qss2"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-23 20:56:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-23 20:56:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-11-23 21:01:29 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {node-problem-detector Update v1 2022-11-23 21:01:30 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-23 21:02:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-alpha/us-west1-b/bootstrap-e2e-minion-group-qss2,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815430144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553286144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-23 21:01:29 +0000 UTC,LastTransitionTime:2022-11-23 20:56:28 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-23 21:01:29 +0000 UTC,LastTransitionTime:2022-11-23 20:56:28 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-23 21:01:29 +0000 UTC,LastTransitionTime:2022-11-23 20:56:28 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-23 21:01:29 +0000 UTC,LastTransitionTime:2022-11-23 20:56:28 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-23 21:01:29 +0000 UTC,LastTransitionTime:2022-11-23 20:56:28 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-23 21:01:29 +0000 UTC,LastTransitionTime:2022-11-23 20:56:28 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-23 21:01:29 +0000 UTC,LastTransitionTime:2022-11-23 20:56:28 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-23 20:56:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:39 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-23 21:02:15 +0000 UTC,LastTransitionTime:2022-11-23 20:56:25 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-23 21:02:15 +0000 UTC,LastTransitionTime:2022-11-23 20:56:25 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-23 21:02:15 +0000 UTC,LastTransitionTime:2022-11-23 20:56:25 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-23 21:02:15 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:34.127.127.16,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-qss2.c.k8s-jkns-gci-gce-alpha.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-qss2.c.k8s-jkns-gci-gce-alpha.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:76baa30d5979427855b04f88deaf8671,SystemUUID:76baa30d-5979-4278-55b0-4f88deaf8671,BootID:f794e29b-0541-47d9-932b-8ed3667da969,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.40+9884746f0fd338,KubeProxyVersion:v1.27.0-alpha.0.40+9884746f0fd338,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.40_9884746f0fd338],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-7702^ffd504bb-6b71-11ed-859d-b62c6013251e,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-7702^ffd536d3-6b71-11ed-859d-b62c6013251e,DevicePath:,},},Config:nil,},} Nov 23 21:02:51.317: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-qss2 Nov 23 21:02:51.360: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-qss2 Nov 23 21:02:51.406: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-qss2: error trying to reach service: No agent available STEP: Collecting events from namespace "webhook-9856-markers". 11/23/22 21:02:51.406 STEP: Found 0 events. 11/23/22 21:02:51.446 Nov 23 21:02:51.487: INFO: POD NODE PHASE GRACE CONDITIONS Nov 23 21:02:51.487: INFO: Nov 23 21:02:51.536: INFO: Logging node info for node bootstrap-e2e-master Nov 23 21:02:51.578: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master e178771e-6078-4cf7-a352-1d84c66cb7be 5347 0 2022-11-23 20:56:22 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-23 20:56:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-11-23 20:56:39 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-11-23 20:56:40 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-11-23 21:01:49 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-alpha/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3858366464 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3596222464 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-23 20:56:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:39 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-23 21:01:49 +0000 UTC,LastTransitionTime:2022-11-23 20:56:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-23 21:01:49 +0000 UTC,LastTransitionTime:2022-11-23 20:56:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-23 21:01:49 +0000 UTC,LastTransitionTime:2022-11-23 20:56:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-23 21:01:49 +0000 UTC,LastTransitionTime:2022-11-23 20:56:24 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:35.247.28.208,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-jkns-gci-gce-alpha.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-jkns-gci-gce-alpha.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:15f6e783a1401075c491684ecd23ec3a,SystemUUID:15f6e783-a140-1075-c491-684ecd23ec3a,BootID:04aebf08-8ea7-4b94-843b-308a92bf91fb,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.40+9884746f0fd338,KubeProxyVersion:v1.27.0-alpha.0.40+9884746f0fd338,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-alpha.0.40_9884746f0fd338],SizeBytes:135160275,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-alpha.0.40_9884746f0fd338],SizeBytes:124989753,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:b83c1d70989e1fe87583607bf5aee1ee34e52773d4755b95f5cf5a451962f3a4 registry.k8s.io/etcd:3.5.5-0],SizeBytes:102417044,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-alpha.0.40_9884746f0fd338],SizeBytes:57659704,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:2c111f004bec24888d8cfa2a812a38fb8341350abac67dcd0ac64e709dfe389c registry.k8s.io/kas-network-proxy/proxy-server:v0.0.33],SizeBytes:22020129,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 23 21:02:51.578: INFO: Logging kubelet events for node bootstrap-e2e-master Nov 23 21:02:51.621: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-master Nov 23 21:02:51.664: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-master: error trying to reach service: No agent available Nov 23 21:02:51.664: INFO: Logging node info for node bootstrap-e2e-minion-group-3dd6 Nov 23 21:02:51.706: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-3dd6 aba1b812-4944-438f-b4bc-79f731a0b1cc 6056 0 2022-11-23 20:56:27 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-3dd6 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-3dd6 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-174":"bootstrap-e2e-minion-group-3dd6","csi-hostpath-ephemeral-7454":"bootstrap-e2e-minion-group-3dd6","csi-mock-csi-mock-volumes-4923":"bootstrap-e2e-minion-group-3dd6"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-11-23 20:56:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {kubelet Update v1 2022-11-23 20:56:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {node-problem-detector Update v1 2022-11-23 21:01:31 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-11-23 21:02:00 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2022-11-23 21:02:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-alpha/us-west1-b/bootstrap-e2e-minion-group-3dd6,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-23 21:01:31 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-23 21:01:31 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-23 21:01:31 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-23 21:01:31 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-23 21:01:31 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-23 21:01:31 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-23 21:01:31 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-23 20:56:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:39 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-23 21:02:25 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-23 21:02:25 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-23 21:02:25 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-23 21:02:25 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.83.109.94,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-3dd6.c.k8s-jkns-gci-gce-alpha.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-3dd6.c.k8s-jkns-gci-gce-alpha.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e748f2e47d098c7d59fb0c64c73041ef,SystemUUID:e748f2e4-7d09-8c7d-59fb-0c64c73041ef,BootID:7dd715f8-7985-4853-a244-581e49eff17e,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.40+9884746f0fd338,KubeProxyVersion:v1.27.0-alpha.0.40+9884746f0fd338,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.40_9884746f0fd338],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-174^0850954f-6b72-11ed-8a23-76b571dae824],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-7454^01c1ad09-6b72-11ed-afe6-0ad9dffce272,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-174^0850954f-6b72-11ed-8a23-76b571dae824,DevicePath:,},},Config:nil,},} Nov 23 21:02:51.706: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-3dd6 Nov 23 21:02:51.749: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-3dd6 Nov 23 21:02:51.792: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-3dd6: error trying to reach service: No agent available Nov 23 21:02:51.792: INFO: Logging node info for node bootstrap-e2e-minion-group-3h36 Nov 23 21:02:51.834: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-3h36 ab6bfea1-ac11-4084-be81-dd72391e5606 6166 0 2022-11-23 20:56:27 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-3h36 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-3h36 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-volumemode-1165":"bootstrap-e2e-minion-group-3h36","csi-mock-csi-mock-volumes-4031":"bootstrap-e2e-minion-group-3h36","csi-mock-csi-mock-volumes-6008":"bootstrap-e2e-minion-group-3h36"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-23 20:56:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-23 20:56:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {node-problem-detector Update v1 2022-11-23 21:01:32 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-11-23 21:02:14 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2022-11-23 21:02:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-alpha/us-west1-b/bootstrap-e2e-minion-group-3h36,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815430144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553286144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-23 21:01:32 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-23 21:01:32 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-23 21:01:32 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-23 21:01:32 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-23 21:01:32 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-23 21:01:32 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-23 21:01:32 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-23 20:56:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:39 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-23 21:02:36 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-23 21:02:36 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-23 21:02:36 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-23 21:02:36 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:35.199.155.0,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-3h36.c.k8s-jkns-gci-gce-alpha.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-3h36.c.k8s-jkns-gci-gce-alpha.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:4aed16763bdc994e9fc6e3e0c95cb8ae,SystemUUID:4aed1676-3bdc-994e-9fc6-e3e0c95cb8ae,BootID:461d3e21-d519-43c8-ab39-0c2de0db6ed8,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.40+9884746f0fd338,KubeProxyVersion:v1.27.0-alpha.0.40+9884746f0fd338,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.40_9884746f0fd338],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 registry.k8s.io/sig-storage/snapshot-controller:v6.1.0],SizeBytes:22620891,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-volumemode-1165^1563a9dd-6b72-11ed-b993-66f87e0e4481,DevicePath:,},},Config:nil,},} Nov 23 21:02:51.834: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-3h36 Nov 23 21:02:51.880: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-3h36 Nov 23 21:02:51.936: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-3h36: error trying to reach service: No agent available Nov 23 21:02:51.936: INFO: Logging node info for node bootstrap-e2e-minion-group-qss2 Nov 23 21:02:51.982: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-qss2 0f567691-be6f-4056-8e45-f5c587fd8fff 6534 0 2022-11-23 20:56:26 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-qss2 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-qss2 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-7702":"bootstrap-e2e-minion-group-qss2","csi-hostpath-ephemeral-7934":"bootstrap-e2e-minion-group-qss2","csi-hostpath-provisioning-1098":"bootstrap-e2e-minion-group-qss2"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-23 20:56:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-23 20:56:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-11-23 21:01:29 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {node-problem-detector Update v1 2022-11-23 21:01:30 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-23 21:02:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-alpha/us-west1-b/bootstrap-e2e-minion-group-qss2,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815430144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553286144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-23 21:01:29 +0000 UTC,LastTransitionTime:2022-11-23 20:56:28 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-23 21:01:29 +0000 UTC,LastTransitionTime:2022-11-23 20:56:28 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-23 21:01:29 +0000 UTC,LastTransitionTime:2022-11-23 20:56:28 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-23 21:01:29 +0000 UTC,LastTransitionTime:2022-11-23 20:56:28 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-23 21:01:29 +0000 UTC,LastTransitionTime:2022-11-23 20:56:28 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-23 21:01:29 +0000 UTC,LastTransitionTime:2022-11-23 20:56:28 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-23 21:01:29 +0000 UTC,LastTransitionTime:2022-11-23 20:56:28 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-23 20:56:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:39 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-23 21:02:15 +0000 UTC,LastTransitionTime:2022-11-23 20:56:25 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-23 21:02:15 +0000 UTC,LastTransitionTime:2022-11-23 20:56:25 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-23 21:02:15 +0000 UTC,LastTransitionTime:2022-11-23 20:56:25 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-23 21:02:15 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:34.127.127.16,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-qss2.c.k8s-jkns-gci-gce-alpha.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-qss2.c.k8s-jkns-gci-gce-alpha.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:76baa30d5979427855b04f88deaf8671,SystemUUID:76baa30d-5979-4278-55b0-4f88deaf8671,BootID:f794e29b-0541-47d9-932b-8ed3667da969,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.40+9884746f0fd338,KubeProxyVersion:v1.27.0-alpha.0.40+9884746f0fd338,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.40_9884746f0fd338],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-7702^ffd504bb-6b71-11ed-859d-b62c6013251e,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-7702^ffd536d3-6b71-11ed-859d-b62c6013251e,DevicePath:,},},Config:nil,},} Nov 23 21:02:51.982: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-qss2 Nov 23 21:02:52.025: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-qss2 Nov 23 21:02:52.068: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-qss2: error trying to reach service: No agent available [DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] tear down framework | framework.go:193 STEP: Destroying namespace "webhook-9856" for this suite. 11/23/22 21:02:52.068 STEP: Destroying namespace "webhook-9856-markers" for this suite. 11/23/22 21:02:52.112
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\spatching\/updating\sa\svalidating\swebhook\sshould\swork\s\[Conformance\]$'
test/e2e/apimachinery/webhook.go:435
k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.16()
test/e2e/apimachinery/webhook.go:435 +0x454
There were additional failures detected after the initial failure:
[FAILED]
Nov 23 21:35:02.461: failed to list events in namespace "webhook-6603": Get "https://35.247.28.208/api/v1/namespaces/webhook-6603/events": dial tcp 35.247.28.208:443: connect: connection refused
In [DeferCleanup (Each)] at: test/e2e/framework/debug/dump.go:44
----------
[FAILED]
Nov 23 21:35:02.541: Couldn't delete ns: "webhook-6603": Delete "https://35.247.28.208/api/v1/namespaces/webhook-6603": dial tcp 35.247.28.208:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://35.247.28.208/api/v1/namespaces/webhook-6603", Err:(*net.OpError)(0xc00496fa90)}),Couldn't delete ns: "webhook-6603-markers": Delete "https://35.247.28.208/api/v1/namespaces/webhook-6603-markers": dial tcp 35.247.28.208:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://35.247.28.208/api/v1/namespaces/webhook-6603-markers", Err:(*net.OpError)(0xc0028b4af0)})
In [DeferCleanup (Each)] at: test/e2e/framework/framework.go:370
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
set up framework | framework.go:178
STEP: Creating a kubernetes client 11/23/22 21:34:28.257
Nov 23 21:34:28.257: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Building a namespace api object, basename webhook 11/23/22 21:34:28.26
STEP: Waiting for a default service account to be provisioned in namespace 11/23/22 21:34:28.598
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 11/23/22 21:34:28.694
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/framework/metrics/init/init.go:31
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/apimachinery/webhook.go:90
STEP: Setting up server cert 11/23/22 21:34:29.012
STEP: Create role binding to let webhook read extension-apiserver-authentication 11/23/22 21:34:29.915
Nov 23 21:34:30.033: INFO: role binding webhook-auth-reader already exists
STEP: Deploying the webhook pod 11/23/22 21:34:30.033
STEP: Wait for the deployment to be ready 11/23/22 21:34:30.202
Nov 23 21:34:30.532: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:0, UpdatedReplicas:0, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 34, 30, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 34, 30, 0, time.Local), Reason:"NewReplicaSetCreated", Message:"Created new replica set \"sample-webhook-deployment-865554f4d9\""}, v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 34, 30, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 34, 30, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:34:32.791: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 34, 30, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 34, 30, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 34, 30, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 34, 30, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:34:34.776: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 34, 30, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 34, 30, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 34, 30, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 34, 30, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:34:36.829: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 34, 30, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 34, 30, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 34, 30, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 34, 30, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
STEP: Deploying the webhook service 11/23/22 21:34:38.721
STEP: Verifying the service has paired with the endpoint 11/23/22 21:34:39.121
Nov 23 21:34:40.122: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
[It] patching/updating a validating webhook should work [Conformance]
test/e2e/apimachinery/webhook.go:413
STEP: Creating a validating webhook configuration 11/23/22 21:34:40.331
Nov 23 21:34:41.038: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:41.533: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:42.172: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:43.576: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:44.379: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:45.659: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:46.589: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:47.181: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:47.830: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:48.504: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:48.846: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:49.106: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:49.387: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:49.622: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:49.909: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:50.610: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:51.368: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:51.734: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:51.910: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:52.190: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:52.420: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:52.722: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:53.056: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:53.361: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:53.777: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:54.034: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:54.875: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:55.677: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:56.154: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:56.566: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:56.793: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:57.010: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:57.326: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:57.510: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:58.081: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:58.591: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:59.349: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:35:00.018: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:35:00.640: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:35:01.168: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:35:01.467: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:35:01.762: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:35:02.056: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:35:02.178: INFO: Unexpected error: waiting for webhook configuration to be ready:
<*url.Error | 0xc0031284b0>: {
Op: "Post",
URL: "https://35.247.28.208/api/v1/namespaces/webhook-6603-markers/configmaps",
Err: <*net.OpError | 0xc00496f590>{
Op: "dial",
Net: "tcp",
Source: nil,
Addr: <*net.TCPAddr | 0xc0030893b0>{
IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 35, 247, 28, 208],
Port: 443,
Zone: "",
},
Err: <*os.SyscallError | 0xc0014de400>{
Syscall: "connect",
Err: <syscall.Errno>0x6f,
},
},
}
Nov 23 21:35:02.178: FAIL: waiting for webhook configuration to be ready: Post "https://35.247.28.208/api/v1/namespaces/webhook-6603-markers/configmaps": dial tcp 35.247.28.208:443: connect: connection refused
Full Stack Trace
k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.16()
test/e2e/apimachinery/webhook.go:435 +0x454
Nov 23 21:35:02.219: INFO: Unexpected error: Deleting validating webhook configuration:
<*url.Error | 0xc004df9dd0>: {
Op: "Delete",
URL: "https://35.247.28.208/apis/admissionregistration.k8s.io/v1/validatingwebhookconfigurations/webhook-6603",
Err: <*net.OpError | 0xc004f9ad20>{
Op: "dial",
Net: "tcp",
Source: nil,
Addr: <*net.TCPAddr | 0xc0031288d0>{
IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 35, 247, 28, 208],
Port: 443,
Zone: "",
},
Err: <*os.SyscallError | 0xc0006bef00>{
Syscall: "connect",
Err: <syscall.Errno>0x6f,
},
},
}
Nov 23 21:35:02.219: FAIL: Deleting validating webhook configuration: Delete "https://35.247.28.208/apis/admissionregistration.k8s.io/v1/validatingwebhookconfigurations/webhook-6603": dial tcp 35.247.28.208:443: connect: connection refused
Full Stack Trace
k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.16.1()
test/e2e/apimachinery/webhook.go:430 +0xfd
panic({0x70eb7e0, 0xc00011ea10})
/usr/local/go/src/runtime/panic.go:884 +0x212
k8s.io/kubernetes/test/e2e/framework.Fail({0xc001e14180, 0xb6}, {0xc00323dc00?, 0xc0048687e0?, 0xc00323dc28?})
test/e2e/framework/log.go:61 +0x145
k8s.io/kubernetes/test/e2e/framework.ExpectNoErrorWithOffset(0x1, {0x7fadf60, 0xc0031284b0}, {0xc00155f660?, 0xc004052000?, 0x46b?})
test/e2e/framework/expect.go:76 +0x267
k8s.io/kubernetes/test/e2e/framework.ExpectNoError(...)
test/e2e/framework/expect.go:43
k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.16()
test/e2e/apimachinery/webhook.go:435 +0x454
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/framework/node/init/init.go:32
Nov 23 21:35:02.220: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/apimachinery/webhook.go:105
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
dump namespaces | framework.go:196
STEP: dump namespace information after failure 11/23/22 21:35:02.42
STEP: Collecting events from namespace "webhook-6603". 11/23/22 21:35:02.421
Nov 23 21:35:02.461: INFO: Unexpected error: failed to list events in namespace "webhook-6603":
<*url.Error | 0xc0029e6c60>: {
Op: "Get",
URL: "https://35.247.28.208/api/v1/namespaces/webhook-6603/events",
Err: <*net.OpError | 0xc0028b47d0>{
Op: "dial",
Net: "tcp",
Source: nil,
Addr: <*net.TCPAddr | 0xc003129170>{
IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 35, 247, 28, 208],
Port: 443,
Zone: "",
},
Err: <*os.SyscallError | 0xc004d609e0>{
Syscall: "connect",
Err: <syscall.Errno>0x6f,
},
},
}
Nov 23 21:35:02.461: FAIL: failed to list events in namespace "webhook-6603": Get "https://35.247.28.208/api/v1/namespaces/webhook-6603/events": dial tcp 35.247.28.208:443: connect: connection refused
Full Stack Trace
k8s.io/kubernetes/test/e2e/framework/debug.dumpEventsInNamespace(0xc0006f45c0, {0xc0011ac000, 0xc})
test/e2e/framework/debug/dump.go:44 +0x191
k8s.io/kubernetes/test/e2e/framework/debug.DumpAllNamespaceInfo({0x801de88, 0xc0033d4b60}, {0xc0011ac000, 0xc})
test/e2e/framework/debug/dump.go:62 +0x8d
k8s.io/kubernetes/test/e2e/framework/debug/init.init.0.func1.1(0xc0006f4650?, {0xc0011ac000?, 0x7fa7740?})
test/e2e/framework/debug/init/init.go:34 +0x32
k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo.func1()
test/e2e/framework/framework.go:274 +0x6d
k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo(0xc001207e00)
test/e2e/framework/framework.go:271 +0x179
reflect.Value.call({0x6627cc0?, 0xc001452700?, 0xc004166fb0?}, {0x75b6e72, 0x4}, {0xae73300, 0x0, 0xc0033d5748?})
/usr/local/go/src/reflect/value.go:584 +0x8c5
reflect.Value.Call({0x6627cc0?, 0xc001452700?, 0x29449fc?}, {0xae73300?, 0xc004166f80?, 0x2fdb5c0?})
/usr/local/go/src/reflect/value.go:368 +0xbc
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
tear down framework | framework.go:193
STEP: Destroying namespace "webhook-6603" for this suite. 11/23/22 21:35:02.461
STEP: Destroying namespace "webhook-6603-markers" for this suite. 11/23/22 21:35:02.501
Nov 23 21:35:02.541: FAIL: Couldn't delete ns: "webhook-6603": Delete "https://35.247.28.208/api/v1/namespaces/webhook-6603": dial tcp 35.247.28.208:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://35.247.28.208/api/v1/namespaces/webhook-6603", Err:(*net.OpError)(0xc00496fa90)}),Couldn't delete ns: "webhook-6603-markers": Delete "https://35.247.28.208/api/v1/namespaces/webhook-6603-markers": dial tcp 35.247.28.208:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://35.247.28.208/api/v1/namespaces/webhook-6603-markers", Err:(*net.OpError)(0xc0028b4af0)})
Full Stack Trace
k8s.io/kubernetes/test/e2e/framework.(*Framework).AfterEach.func1()
test/e2e/framework/framework.go:370 +0x4fe
k8s.io/kubernetes/test/e2e/framework.(*Framework).AfterEach(0xc001207e00)
test/e2e/framework/framework.go:383 +0x1ca
reflect.Value.call({0x6627cc0?, 0xc001452660?, 0xc003bb4fb0?}, {0x75b6e72, 0x4}, {0xae73300, 0x0, 0x0?})
/usr/local/go/src/reflect/value.go:584 +0x8c5
reflect.Value.Call({0x6627cc0?, 0xc001452660?, 0x0?}, {0xae73300?, 0x5?, 0xc002ab7530?})
/usr/local/go/src/reflect/value.go:368 +0xbc
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\sshould\sbe\sable\sto\sdeny\scustom\sresource\screation\,\supdate\sand\sdeletion\s\[Conformance\]$'
test/e2e/apimachinery/webhook.go:1731
k8s.io/kubernetes/test/e2e/apimachinery.registerWebhookForCustomResource(0xc00082fe00, {0xc003fd7970, 0xc}, 0xc00178a500, 0xc000d361c0, 0x416ce40?)
test/e2e/apimachinery/webhook.go:1731 +0x871
k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.6()
test/e2e/apimachinery/webhook.go:227 +0xad
There were additional failures detected after the initial failure:
[FAILED]
Nov 23 21:35:02.492: failed to list events in namespace "webhook-4392": Get "https://35.247.28.208/api/v1/namespaces/webhook-4392/events": dial tcp 35.247.28.208:443: connect: connection refused
In [DeferCleanup (Each)] at: test/e2e/framework/debug/dump.go:44
----------
[FAILED]
Nov 23 21:35:02.573: Couldn't delete ns: "webhook-4392": Delete "https://35.247.28.208/api/v1/namespaces/webhook-4392": dial tcp 35.247.28.208:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://35.247.28.208/api/v1/namespaces/webhook-4392", Err:(*net.OpError)(0xc004e079f0)}),Couldn't delete ns: "webhook-4392-markers": Delete "https://35.247.28.208/api/v1/namespaces/webhook-4392-markers": dial tcp 35.247.28.208:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://35.247.28.208/api/v1/namespaces/webhook-4392-markers", Err:(*net.OpError)(0xc003563d60)})
In [DeferCleanup (Each)] at: test/e2e/framework/framework.go:370
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
set up framework | framework.go:178
STEP: Creating a kubernetes client 11/23/22 21:32:19.256
Nov 23 21:32:19.257: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Building a namespace api object, basename webhook 11/23/22 21:32:19.259
Nov 23 21:32:19.299: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:32:21.339: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:32:23.340: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:32:25.339: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:32:27.340: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
STEP: Waiting for a default service account to be provisioned in namespace 11/23/22 21:33:21.233
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 11/23/22 21:33:21.315
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/framework/metrics/init/init.go:31
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/apimachinery/webhook.go:90
STEP: Setting up server cert 11/23/22 21:33:24.156
STEP: Create role binding to let webhook read extension-apiserver-authentication 11/23/22 21:33:25.507
STEP: Deploying the webhook pod 11/23/22 21:33:25.558
STEP: Wait for the deployment to be ready 11/23/22 21:33:25.675
Nov 23 21:33:25.861: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:33:27.922: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:33:29.925: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:33:31.985: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:33:33.919: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:33:35.946: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:33:37.927: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:33:39.926: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:33:41.912: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:33:43.929: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:33:45.921: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:33:47.958: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:33:49.928: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:33:51.917: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:33:53.957: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:33:55.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:33:57.920: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:33:59.948: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:34:01.914: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:34:03.937: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:34:05.933: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:34:07.925: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:34:09.928: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:34:11.919: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:34:13.907: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:34:15.925: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:34:17.918: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:34:19.959: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:34:21.920: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:34:23.919: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:34:25.949: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:34:27.975: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:34:29.976: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:34:31.987: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 25, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
STEP: Deploying the webhook service 11/23/22 21:34:34.052
STEP: Verifying the service has paired with the endpoint 11/23/22 21:34:34.568
Nov 23 21:34:35.569: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
[It] should be able to deny custom resource creation, update and deletion [Conformance]
test/e2e/apimachinery/webhook.go:221
Nov 23 21:34:35.796: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Registering the custom resource webhook via the AdmissionRegistration API 11/23/22 21:34:36.705
Nov 23 21:34:37.774: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:38.416: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:39.019: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:39.887: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:40.441: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:41.036: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:41.389: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:41.840: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:43.312: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:44.212: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:45.065: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:46.125: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:46.753: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:47.320: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:48.229: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:48.675: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:48.906: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:49.194: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:49.471: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:49.684: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:50.066: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:50.716: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:51.375: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:51.819: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:52.074: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:52.386: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:52.720: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:53.046: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:53.308: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:53.672: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:53.884: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:54.900: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:55.781: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:56.315: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:56.618: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:56.849: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:57.026: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:57.324: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:57.587: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:58.229: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:58.672: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:59.267: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:59.801: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:35:00.450: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:35:01.050: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:35:01.355: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:35:01.585: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:35:01.924: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:35:02.151: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:35:02.214: INFO: Unexpected error: waiting for webhook configuration to be ready:
<*url.Error | 0xc002d8c0c0>: {
Op: "Post",
URL: "https://35.247.28.208/api/v1/namespaces/webhook-4392-markers/configmaps",
Err: <*net.OpError | 0xc004e07310>{
Op: "dial",
Net: "tcp",
Source: nil,
Addr: <*net.TCPAddr | 0xc00538c0f0>{
IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 35, 247, 28, 208],
Port: 443,
Zone: "",
},
Err: <*os.SyscallError | 0xc004efe600>{
Syscall: "connect",
Err: <syscall.Errno>0x6f,
},
},
}
Nov 23 21:35:02.214: FAIL: waiting for webhook configuration to be ready: Post "https://35.247.28.208/api/v1/namespaces/webhook-4392-markers/configmaps": dial tcp 35.247.28.208:443: connect: connection refused
Full Stack Trace
k8s.io/kubernetes/test/e2e/apimachinery.registerWebhookForCustomResource(0xc00082fe00, {0xc003fd7970, 0xc}, 0xc00178a500, 0xc000d361c0, 0x416ce40?)
test/e2e/apimachinery/webhook.go:1731 +0x871
k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.6()
test/e2e/apimachinery/webhook.go:227 +0xad
Nov 23 21:35:02.254: FAIL: failed to delete CustomResourceDefinition(e2e-test-webhook-253-crd): Delete "https://35.247.28.208/apis/apiextensions.k8s.io/v1/customresourcedefinitions/e2e-test-webhook-253-crds.webhook.example.com": dial tcp 35.247.28.208:443: connect: connection refused
Full Stack Trace
k8s.io/kubernetes/test/utils/crd.CreateMultiVersionTestCRD.func1()
test/utils/crd/crd_util.go:117 +0xbf
panic({0x70eb7e0, 0xc000146230})
/usr/local/go/src/runtime/panic.go:884 +0x212
k8s.io/kubernetes/test/e2e/framework.Fail({0xc000417800, 0xb6}, {0xc003bdfc48?, 0xc003b8a750?, 0xc003bdfc70?})
test/e2e/framework/log.go:61 +0x145
k8s.io/kubernetes/test/e2e/framework.ExpectNoErrorWithOffset(0x1, {0x7fadf60, 0xc002d8c0c0}, {0xc000f62200?, 0xc0017ae800?, 0x46b?})
test/e2e/framework/expect.go:76 +0x267
k8s.io/kubernetes/test/e2e/framework.ExpectNoError(...)
test/e2e/framework/expect.go:43
k8s.io/kubernetes/test/e2e/apimachinery.registerWebhookForCustomResource(0xc00082fe00, {0xc003fd7970, 0xc}, 0xc00178a500, 0xc000d361c0, 0x416ce40?)
test/e2e/apimachinery/webhook.go:1731 +0x871
k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.6()
test/e2e/apimachinery/webhook.go:227 +0xad
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/framework/node/init/init.go:32
Nov 23 21:35:02.254: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/apimachinery/webhook.go:105
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
dump namespaces | framework.go:196
STEP: dump namespace information after failure 11/23/22 21:35:02.452
STEP: Collecting events from namespace "webhook-4392". 11/23/22 21:35:02.452
Nov 23 21:35:02.492: INFO: Unexpected error: failed to list events in namespace "webhook-4392":
<*url.Error | 0xc00538c7e0>: {
Op: "Get",
URL: "https://35.247.28.208/api/v1/namespaces/webhook-4392/events",
Err: <*net.OpError | 0xc003563900>{
Op: "dial",
Net: "tcp",
Source: nil,
Addr: <*net.TCPAddr | 0xc000982810>{
IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 35, 247, 28, 208],
Port: 443,
Zone: "",
},
Err: <*os.SyscallError | 0xc003b71080>{
Syscall: "connect",
Err: <syscall.Errno>0x6f,
},
},
}
Nov 23 21:35:02.492: FAIL: failed to list events in namespace "webhook-4392": Get "https://35.247.28.208/api/v1/namespaces/webhook-4392/events": dial tcp 35.247.28.208:443: connect: connection refused
Full Stack Trace
k8s.io/kubernetes/test/e2e/framework/debug.dumpEventsInNamespace(0xc003bde5c0, {0xc003fd7970, 0xc})
test/e2e/framework/debug/dump.go:44 +0x191
k8s.io/kubernetes/test/e2e/framework/debug.DumpAllNamespaceInfo({0x801de88, 0xc00011d1e0}, {0xc003fd7970, 0xc})
test/e2e/framework/debug/dump.go:62 +0x8d
k8s.io/kubernetes/test/e2e/framework/debug/init.init.0.func1.1(0xc003bde650?, {0xc003fd7970?, 0x7fa7740?})
test/e2e/framework/debug/init/init.go:34 +0x32
k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo.func1()
test/e2e/framework/framework.go:274 +0x6d
k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo(0xc00082fe00)
test/e2e/framework/framework.go:271 +0x179
reflect.Value.call({0x6627cc0?, 0xc001564930?, 0xc003587fb0?}, {0x75b6e72, 0x4}, {0xae73300, 0x0, 0xc00370b268?})
/usr/local/go/src/reflect/value.go:584 +0x8c5
reflect.Value.Call({0x6627cc0?, 0xc001564930?, 0x29449fc?}, {0xae73300?, 0xc003587f80?, 0xc002706450?})
/usr/local/go/src/reflect/value.go:368 +0xbc
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
tear down framework | framework.go:193
STEP: Destroying namespace "webhook-4392" for this suite. 11/23/22 21:35:02.493
STEP: Destroying namespace "webhook-4392-markers" for this suite. 11/23/22 21:35:02.533
Nov 23 21:35:02.573: FAIL: Couldn't delete ns: "webhook-4392": Delete "https://35.247.28.208/api/v1/namespaces/webhook-4392": dial tcp 35.247.28.208:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://35.247.28.208/api/v1/namespaces/webhook-4392", Err:(*net.OpError)(0xc004e079f0)}),Couldn't delete ns: "webhook-4392-markers": Delete "https://35.247.28.208/api/v1/namespaces/webhook-4392-markers": dial tcp 35.247.28.208:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://35.247.28.208/api/v1/namespaces/webhook-4392-markers", Err:(*net.OpError)(0xc003563d60)})
Full Stack Trace
k8s.io/kubernetes/test/e2e/framework.(*Framework).AfterEach.func1()
test/e2e/framework/framework.go:370 +0x4fe
k8s.io/kubernetes/test/e2e/framework.(*Framework).AfterEach(0xc00082fe00)
test/e2e/framework/framework.go:383 +0x1ca
reflect.Value.call({0x6627cc0?, 0xc001564850?, 0xc002588fb0?}, {0x75b6e72, 0x4}, {0xae73300, 0x0, 0x0?})
/usr/local/go/src/reflect/value.go:584 +0x8c5
reflect.Value.Call({0x6627cc0?, 0xc001564850?, 0x0?}, {0xae73300?, 0x5?, 0xc00416b500?})
/usr/local/go/src/reflect/value.go:368 +0xbc
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\sshould\sdeny\scrd\screation\s\[Conformance\]$'
test/e2e/apimachinery/webhook.go:2041
k8s.io/kubernetes/test/e2e/apimachinery.registerValidatingWebhookForCRD(0xc001157ef0, {0xc004fb8ed0, 0xc}, 0xc004772b90, 0x0?)
test/e2e/apimachinery/webhook.go:2041 +0x792
k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.12()
test/e2e/apimachinery/webhook.go:309 +0x45
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
set up framework | framework.go:178
STEP: Creating a kubernetes client 11/23/22 21:06:37.515
Nov 23 21:06:37.515: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Building a namespace api object, basename webhook 11/23/22 21:06:37.516
STEP: Waiting for a default service account to be provisioned in namespace 11/23/22 21:06:37.717
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 11/23/22 21:06:37.837
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/framework/metrics/init/init.go:31
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/apimachinery/webhook.go:90
STEP: Setting up server cert 11/23/22 21:06:38.133
STEP: Create role binding to let webhook read extension-apiserver-authentication 11/23/22 21:06:38.639
STEP: Deploying the webhook pod 11/23/22 21:06:38.707
STEP: Wait for the deployment to be ready 11/23/22 21:06:38.909
Nov 23 21:06:39.150: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 6, 38, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 6, 38, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 6, 39, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 6, 38, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:06:41.204: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 6, 38, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 6, 38, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 6, 39, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 6, 38, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:06:43.213: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 6, 38, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 6, 38, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 6, 39, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 6, 38, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:06:45.208: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 6, 38, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 6, 38, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 6, 39, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 6, 38, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:06:47.280: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 6, 38, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 6, 38, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 6, 39, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 6, 38, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:06:49.213: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 6, 38, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 6, 38, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 6, 39, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 6, 38, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:06:51.240: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 6, 38, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 6, 38, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 6, 39, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 6, 38, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:06:53.207: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 6, 38, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 6, 38, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 6, 39, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 6, 38, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:06:55.207: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 6, 38, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 6, 38, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 6, 39, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 6, 38, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:06:57.234: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 6, 38, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 6, 38, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 6, 39, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 6, 38, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
STEP: Deploying the webhook service 11/23/22 21:06:59.243
STEP: Verifying the service has paired with the endpoint 11/23/22 21:06:59.34
Nov 23 21:07:00.341: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
[It] should deny crd creation [Conformance]
test/e2e/apimachinery/webhook.go:308
STEP: Registering the crd webhook via the AdmissionRegistration API 11/23/22 21:07:00.454
Nov 23 21:07:00.774: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:01.167: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:01.326: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:01.524: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:01.722: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:01.989: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:02.340: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:02.850: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:03.081: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:03.391: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:03.610: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:03.833: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:04.036: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:04.379: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:04.742: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:05.009: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:05.233: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:05.499: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:05.852: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:06.458: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:06.923: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:07.233: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:07.467: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:07.682: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:08.254: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:08.654: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:08.835: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:09.081: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:09.393: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:09.706: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:09.963: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:10.230: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:10.490: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:10.751: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:10.940: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:11.208: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:11.514: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:11.774: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:11.998: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:12.269: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:12.532: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:12.713: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:12.930: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:13.151: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:13.371: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:13.574: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:13.795: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:14.092: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:14.443: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:14.766: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:14.941: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:15.206: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:15.541: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:15.774: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:15.997: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:16.234: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:16.619: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:16.848: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:17.078: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:17.410: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:17.641: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:17.840: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:18.015: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:18.243: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:18.499: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:18.830: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:19.095: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:19.494: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:19.765: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:19.915: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:20.176: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:20.473: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:20.681: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:20.997: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:21.279: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:21.553: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:21.720: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:21.949: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:22.226: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:22.678: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:23.133: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:23.418: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:23.658: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:23.817: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:24.068: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:24.288: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:24.569: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:24.713: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:24.996: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:25.271: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:25.451: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:25.640: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:25.886: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:26.255: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:26.505: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:26.715: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:26.942: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:27.178: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:27.412: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:27.675: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:27.865: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:28.081: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:28.347: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:28.536: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:28.755: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:28.942: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:29.133: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:29.335: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:29.542: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:29.942: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:30.203: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:30.561: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:30.733: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:30.934: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:31.129: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:07:31.129: INFO: Unexpected error: waiting for webhook configuration to be ready:
<*errors.errorString | 0xc0001ffa10>: {
s: "timed out waiting for the condition",
}
Nov 23 21:07:31.129: FAIL: waiting for webhook configuration to be ready: timed out waiting for the condition
Full Stack Trace
k8s.io/kubernetes/test/e2e/apimachinery.registerValidatingWebhookForCRD(0xc001157ef0, {0xc004fb8ed0, 0xc}, 0xc004772b90, 0x0?)
test/e2e/apimachinery/webhook.go:2041 +0x792
k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.12()
test/e2e/apimachinery/webhook.go:309 +0x45
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/framework/node/init/init.go:32
Nov 23 21:07:31.129: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/apimachinery/webhook.go:105
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
dump namespaces | framework.go:196
STEP: dump namespace information after failure 11/23/22 21:07:31.511
STEP: Collecting events from namespace "webhook-9920". 11/23/22 21:07:31.511
STEP: Found 9 events. 11/23/22 21:07:31.57
Nov 23 21:07:31.570: INFO: At 2022-11-23 21:06:38 +0000 UTC - event for sample-webhook-deployment: {deployment-controller } ScalingReplicaSet: Scaled up replica set sample-webhook-deployment-865554f4d9 to 1
Nov 23 21:07:31.570: INFO: At 2022-11-23 21:06:38 +0000 UTC - event for sample-webhook-deployment-865554f4d9: {replicaset-controller } SuccessfulCreate: Created pod: sample-webhook-deployment-865554f4d9-tqb2k
Nov 23 21:07:31.570: INFO: At 2022-11-23 21:06:39 +0000 UTC - event for sample-webhook-deployment-865554f4d9-tqb2k: {default-scheduler } Scheduled: Successfully assigned webhook-9920/sample-webhook-deployment-865554f4d9-tqb2k to bootstrap-e2e-minion-group-qss2
Nov 23 21:07:31.570: INFO: At 2022-11-23 21:06:40 +0000 UTC - event for sample-webhook-deployment-865554f4d9-tqb2k: {kubelet bootstrap-e2e-minion-group-qss2} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine
Nov 23 21:07:31.570: INFO: At 2022-11-23 21:06:40 +0000 UTC - event for sample-webhook-deployment-865554f4d9-tqb2k: {kubelet bootstrap-e2e-minion-group-qss2} Created: Created container sample-webhook
Nov 23 21:07:31.570: INFO: At 2022-11-23 21:06:40 +0000 UTC - event for sample-webhook-deployment-865554f4d9-tqb2k: {kubelet bootstrap-e2e-minion-group-qss2} Started: Started container sample-webhook
Nov 23 21:07:31.570: INFO: At 2022-11-23 21:06:42 +0000 UTC - event for sample-webhook-deployment-865554f4d9-tqb2k: {kubelet bootstrap-e2e-minion-group-qss2} Killing: Stopping container sample-webhook
Nov 23 21:07:31.570: INFO: At 2022-11-23 21:06:43 +0000 UTC - event for sample-webhook-deployment-865554f4d9-tqb2k: {kubelet bootstrap-e2e-minion-group-qss2} SandboxChanged: Pod sandbox changed, it will be killed and re-created.
Nov 23 21:07:31.570: INFO: At 2022-11-23 21:06:44 +0000 UTC - event for sample-webhook-deployment-865554f4d9-tqb2k: {kubelet bootstrap-e2e-minion-group-qss2} Unhealthy: Readiness probe failed: Get "https://10.64.1.249:8444/readyz": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
Nov 23 21:07:31.625: INFO: POD NODE PHASE GRACE CONDITIONS
Nov 23 21:07:31.625: INFO:
Nov 23 21:07:31.679: INFO:
Logging node info for node bootstrap-e2e-master
Nov 23 21:07:31.750: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master e178771e-6078-4cf7-a352-1d84c66cb7be 9193 0 2022-11-23 20:56:22 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-23 20:56:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-11-23 20:56:39 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-11-23 20:56:40 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-11-23 21:06:55 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-alpha/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3858366464 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3596222464 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-23 20:56:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:39 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-23 21:06:55 +0000 UTC,LastTransitionTime:2022-11-23 20:56:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-23 21:06:55 +0000 UTC,LastTransitionTime:2022-11-23 20:56:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-23 21:06:55 +0000 UTC,LastTransitionTime:2022-11-23 20:56:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-23 21:06:55 +0000 UTC,LastTransitionTime:2022-11-23 20:56:24 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:35.247.28.208,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-jkns-gci-gce-alpha.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-jkns-gci-gce-alpha.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:15f6e783a1401075c491684ecd23ec3a,SystemUUID:15f6e783-a140-1075-c491-684ecd23ec3a,BootID:04aebf08-8ea7-4b94-843b-308a92bf91fb,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.40+9884746f0fd338,KubeProxyVersion:v1.27.0-alpha.0.40+9884746f0fd338,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-alpha.0.40_9884746f0fd338],SizeBytes:135160275,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-alpha.0.40_9884746f0fd338],SizeBytes:124989753,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:b83c1d70989e1fe87583607bf5aee1ee34e52773d4755b95f5cf5a451962f3a4 registry.k8s.io/etcd:3.5.5-0],SizeBytes:102417044,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-alpha.0.40_9884746f0fd338],SizeBytes:57659704,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:2c111f004bec24888d8cfa2a812a38fb8341350abac67dcd0ac64e709dfe389c registry.k8s.io/kas-network-proxy/proxy-server:v0.0.33],SizeBytes:22020129,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 23 21:07:31.750: INFO:
Logging kubelet events for node bootstrap-e2e-master
Nov 23 21:07:31.837: INFO:
Logging pods the kubelet thinks is on node bootstrap-e2e-master
Nov 23 21:07:31.926: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-master: error trying to reach service: No agent available
Nov 23 21:07:31.926: INFO:
Logging node info for node bootstrap-e2e-minion-group-3dd6
Nov 23 21:07:31.999: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-3dd6 aba1b812-4944-438f-b4bc-79f731a0b1cc 10000 0 2022-11-23 20:56:27 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-3dd6 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-3dd6 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-174":"bootstrap-e2e-minion-group-3dd6","csi-mock-csi-mock-volumes-1039":"bootstrap-e2e-minion-group-3dd6","csi-mock-csi-mock-volumes-4923":"bootstrap-e2e-minion-group-3dd6"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-11-23 20:56:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {kubelet Update v1 2022-11-23 20:56:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-23 21:03:38 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {node-problem-detector Update v1 2022-11-23 21:07:00 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-23 21:07:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-alpha/us-west1-b/bootstrap-e2e-minion-group-3dd6,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-23 21:07:00 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2022-11-23 21:07:00 +0000 UTC,LastTransitionTime:2022-11-23 21:06:58 +0000 UTC,Reason:DockerHung,Message:kernel: INFO: task docker:12345 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-23 21:07:00 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-23 21:07:00 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-23 21:07:00 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-23 21:07:00 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-23 21:07:00 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-23 20:56:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:39 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-23 21:06:30 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-23 21:06:30 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-23 21:06:30 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-23 21:06:30 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.83.109.94,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-3dd6.c.k8s-jkns-gci-gce-alpha.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-3dd6.c.k8s-jkns-gci-gce-alpha.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e748f2e47d098c7d59fb0c64c73041ef,SystemUUID:e748f2e4-7d09-8c7d-59fb-0c64c73041ef,BootID:7dd715f8-7985-4853-a244-581e49eff17e,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.40+9884746f0fd338,KubeProxyVersion:v1.27.0-alpha.0.40+9884746f0fd338,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.40_9884746f0fd338],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-174^0850954f-6b72-11ed-8a23-76b571dae824],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-174^0850954f-6b72-11ed-8a23-76b571dae824,DevicePath:,},},Config:nil,},}
Nov 23 21:07:31.999: INFO:
Logging kubelet events for node bootstrap-e2e-minion-group-3dd6
Nov 23 21:07:32.108: INFO:
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-3dd6
Nov 23 21:07:32.450: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-3dd6: error trying to reach service: No agent available
Nov 23 21:07:32.450: INFO:
Logging node info for node bootstrap-e2e-minion-group-3h36
Nov 23 21:07:32.511: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-3h36 ab6bfea1-ac11-4084-be81-dd72391e5606 9856 0 2022-11-23 20:56:27 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-3h36 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-3h36 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-volumemode-1165":"bootstrap-e2e-minion-group-3h36","csi-mock-csi-mock-volumes-4031":"bootstrap-e2e-minion-group-3h36","csi-mock-csi-mock-volumes-6008":"bootstrap-e2e-minion-group-3h36"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-23 20:56:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-23 20:56:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-11-23 21:05:52 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2022-11-23 21:07:02 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-23 21:07:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-alpha/us-west1-b/bootstrap-e2e-minion-group-3h36,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815430144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553286144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-23 21:07:02 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-23 21:07:02 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-23 21:07:02 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-23 21:07:02 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-23 21:07:02 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2022-11-23 21:07:02 +0000 UTC,LastTransitionTime:2022-11-23 21:07:01 +0000 UTC,Reason:DockerHung,Message:kernel: INFO: task docker:12345 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-23 21:07:02 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-23 20:56:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:39 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-23 21:06:41 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-23 21:06:41 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-23 21:06:41 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-23 21:06:41 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:35.199.155.0,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-3h36.c.k8s-jkns-gci-gce-alpha.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-3h36.c.k8s-jkns-gci-gce-alpha.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:4aed16763bdc994e9fc6e3e0c95cb8ae,SystemUUID:4aed1676-3bdc-994e-9fc6-e3e0c95cb8ae,BootID:461d3e21-d519-43c8-ab39-0c2de0db6ed8,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.40+9884746f0fd338,KubeProxyVersion:v1.27.0-alpha.0.40+9884746f0fd338,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.40_9884746f0fd338],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 registry.k8s.io/sig-storage/snapshot-controller:v6.1.0],SizeBytes:22620891,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 23 21:07:32.511: INFO:
Logging kubelet events for node bootstrap-e2e-minion-group-3h36
Nov 23 21:07:32.596: INFO:
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-3h36
Nov 23 21:07:32.677: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-3h36: error trying to reach service: No agent available
Nov 23 21:07:32.677: INFO:
Logging node info for node bootstrap-e2e-minion-group-qss2
Nov 23 21:07:32.757: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-qss2 0f567691-be6f-4056-8e45-f5c587fd8fff 10024 0 2022-11-23 20:56:26 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-qss2 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-qss2 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-7934":"bootstrap-e2e-minion-group-qss2","csi-hostpath-provisioning-1098":"bootstrap-e2e-minion-group-qss2","csi-hostpath-volumelimits-3844":"bootstrap-e2e-minion-group-qss2","csi-mock-csi-mock-volumes-5603":"bootstrap-e2e-minion-group-qss2","csi-mock-csi-mock-volumes-9113":"bootstrap-e2e-minion-group-qss2"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-23 20:56:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-23 20:56:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-11-23 21:06:59 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2022-11-23 21:07:06 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-23 21:07:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-alpha/us-west1-b/bootstrap-e2e-minion-group-qss2,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815430144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553286144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-23 21:07:05 +0000 UTC,LastTransitionTime:2022-11-23 20:56:28 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-23 21:07:05 +0000 UTC,LastTransitionTime:2022-11-23 20:56:28 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-23 21:07:05 +0000 UTC,LastTransitionTime:2022-11-23 20:56:28 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-23 21:07:05 +0000 UTC,LastTransitionTime:2022-11-23 20:56:28 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-23 21:07:05 +0000 UTC,LastTransitionTime:2022-11-23 20:56:28 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-23 21:07:05 +0000 UTC,LastTransitionTime:2022-11-23 20:56:28 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2022-11-23 21:07:05 +0000 UTC,LastTransitionTime:2022-11-23 21:07:05 +0000 UTC,Reason:DockerHung,Message:kernel: INFO: task docker:12345 blocked for more than 120 seconds.,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-23 20:56:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:39 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-23 21:07:02 +0000 UTC,LastTransitionTime:2022-11-23 20:56:25 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-23 21:07:02 +0000 UTC,LastTransitionTime:2022-11-23 20:56:25 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-23 21:07:02 +0000 UTC,LastTransitionTime:2022-11-23 20:56:25 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-23 21:07:02 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:34.127.127.16,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-qss2.c.k8s-jkns-gci-gce-alpha.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-qss2.c.k8s-jkns-gci-gce-alpha.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:76baa30d5979427855b04f88deaf8671,SystemUUID:76baa30d-5979-4278-55b0-4f88deaf8671,BootID:f794e29b-0541-47d9-932b-8ed3667da969,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.40+9884746f0fd338,KubeProxyVersion:v1.27.0-alpha.0.40+9884746f0fd338,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcd@sha256:4c4bb2ffc261dd79041c1fa8a7a979520b4c08d8e535583e8fbbf22690d13bb1 registry.k8s.io/etcd:3.5.5-1],SizeBytes:102440299,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.40_9884746f0fd338],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 23 21:07:32.757: INFO:
Logging kubelet events for node bootstrap-e2e-minion-group-qss2
Nov 23 21:07:32.883: INFO:
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-qss2
Nov 23 21:07:33.032: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-qss2: error trying to reach service: No agent available
STEP: Collecting events from namespace "webhook-9920-markers". 11/23/22 21:07:33.032
STEP: Found 0 events. 11/23/22 21:07:33.146
Nov 23 21:07:33.269: INFO: POD NODE PHASE GRACE CONDITIONS
Nov 23 21:07:33.269: INFO:
Nov 23 21:07:33.368: INFO:
Logging node info for node bootstrap-e2e-master
Nov 23 21:07:33.484: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master e178771e-6078-4cf7-a352-1d84c66cb7be 9193 0 2022-11-23 20:56:22 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-23 20:56:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-11-23 20:56:39 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-11-23 20:56:40 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-11-23 21:06:55 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-alpha/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3858366464 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3596222464 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-23 20:56:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:39 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-23 21:06:55 +0000 UTC,LastTransitionTime:2022-11-23 20:56:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-23 21:06:55 +0000 UTC,LastTransitionTime:2022-11-23 20:56:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-23 21:06:55 +0000 UTC,LastTransitionTime:2022-11-23 20:56:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-23 21:06:55 +0000 UTC,LastTransitionTime:2022-11-23 20:56:24 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:35.247.28.208,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-jkns-gci-gce-alpha.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-jkns-gci-gce-alpha.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:15f6e783a1401075c491684ecd23ec3a,SystemUUID:15f6e783-a140-1075-c491-684ecd23ec3a,BootID:04aebf08-8ea7-4b94-843b-308a92bf91fb,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.40+9884746f0fd338,KubeProxyVersion:v1.27.0-alpha.0.40+9884746f0fd338,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-alpha.0.40_9884746f0fd338],SizeBytes:135160275,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-alpha.0.40_9884746f0fd338],SizeBytes:124989753,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:b83c1d70989e1fe87583607bf5aee1ee34e52773d4755b95f5cf5a451962f3a4 registry.k8s.io/etcd:3.5.5-0],SizeBytes:102417044,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-alpha.0.40_9884746f0fd338],SizeBytes:57659704,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:2c111f004bec24888d8cfa2a812a38fb8341350abac67dcd0ac64e709dfe389c registry.k8s.io/kas-network-proxy/proxy-server:v0.0.33],SizeBytes:22020129,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 23 21:07:33.485: INFO:
Logging kubelet events for node bootstrap-e2e-master
Nov 23 21:07:33.572: INFO:
Logging pods the kubelet thinks is on node bootstrap-e2e-master
Nov 23 21:07:33.677: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-master: error trying to reach service: No agent available
Nov 23 21:07:33.677: INFO:
Logging node info for node bootstrap-e2e-minion-group-3dd6
Nov 23 21:07:33.751: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-3dd6 aba1b812-4944-438f-b4bc-79f731a0b1cc 10000 0 2022-11-23 20:56:27 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-3dd6 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-3dd6 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-174":"bootstrap-e2e-minion-group-3dd6","csi-mock-csi-mock-volumes-1039":"bootstrap-e2e-minion-group-3dd6","csi-mock-csi-mock-volumes-4923":"bootstrap-e2e-minion-group-3dd6"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-11-23 20:56:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {kubelet Update v1 2022-11-23 20:56:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-23 21:03:38 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {node-problem-detector Update v1 2022-11-23 21:07:00 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-23 21:07:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-alpha/us-west1-b/bootstrap-e2e-minion-group-3dd6,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-23 21:07:00 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2022-11-23 21:07:00 +0000 UTC,LastTransitionTime:2022-11-23 21:06:58 +0000 UTC,Reason:DockerHung,Message:kernel: INFO: task docker:12345 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-23 21:07:00 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-23 21:07:00 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-23 21:07:00 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-23 21:07:00 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-23 21:07:00 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-23 20:56:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:39 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-23 21:06:30 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-23 21:06:30 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-23 21:06:30 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-23 21:06:30 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.83.109.94,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-3dd6.c.k8s-jkns-gci-gce-alpha.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-3dd6.c.k8s-jkns-gci-gce-alpha.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e748f2e47d098c7d59fb0c64c73041ef,SystemUUID:e748f2e4-7d09-8c7d-59fb-0c64c73041ef,BootID:7dd715f8-7985-4853-a244-581e49eff17e,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.40+9884746f0fd338,KubeProxyVersion:v1.27.0-alpha.0.40+9884746f0fd338,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.40_9884746f0fd338],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-174^0850954f-6b72-11ed-8a23-76b571dae824],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-174^0850954f-6b72-11ed-8a23-76b571dae824,DevicePath:,},},Config:nil,},}
Nov 23 21:07:33.751: INFO:
Logging kubelet events for node bootstrap-e2e-minion-group-3dd6
Nov 23 21:07:33.831: INFO:
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-3dd6
Nov 23 21:07:33.952: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-3dd6: error trying to reach service: No agent available
Nov 23 21:07:33.952: INFO:
Logging node info for node bootstrap-e2e-minion-group-3h36
Nov 23 21:07:34.018: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-3h36 ab6bfea1-ac11-4084-be81-dd72391e5606 9856 0 2022-11-23 20:56:27 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-3h36 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-3h36 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-volumemode-1165":"bootstrap-e2e-minion-group-3h36","csi-mock-csi-mock-volumes-4031":"bootstrap-e2e-minion-group-3h36","csi-mock-csi-mock-volumes-6008":"bootstrap-e2e-minion-group-3h36"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-23 20:56:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-23 20:56:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-11-23 21:05:52 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2022-11-23 21:07:02 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-23 21:07:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-alpha/us-west1-b/bootstrap-e2e-minion-group-3h36,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815430144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553286144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-23 21:07:02 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-23 21:07:02 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-23 21:07:02 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-23 21:07:02 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-23 21:07:02 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2022-11-23 21:07:02 +0000 UTC,LastTransitionTime:2022-11-23 21:07:01 +0000 UTC,Reason:DockerHung,Message:kernel: INFO: task docker:12345 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-23 21:07:02 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-23 20:56:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:39 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-23 21:06:41 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-23 21:06:41 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-23 21:06:41 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-23 21:06:41 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:35.199.155.0,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-3h36.c.k8s-jkns-gci-gce-alpha.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-3h36.c.k8s-jkns-gci-gce-alpha.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:4aed16763bdc994e9fc6e3e0c95cb8ae,SystemUUID:4aed1676-3bdc-994e-9fc6-e3e0c95cb8ae,BootID:461d3e21-d519-43c8-ab39-0c2de0db6ed8,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.40+9884746f0fd338,KubeProxyVersion:v1.27.0-alpha.0.40+9884746f0fd338,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.40_9884746f0fd338],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 registry.k8s.io/sig-storage/snapshot-controller:v6.1.0],SizeBytes:22620891,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 23 21:07:34.019: INFO:
Logging kubelet events for node bootstrap-e2e-minion-group-3h36
Nov 23 21:07:34.108: INFO:
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-3h36
Nov 23 21:07:34.299: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-3h36: error trying to reach service: No agent available
Nov 23 21:07:34.299: INFO:
Logging node info for node bootstrap-e2e-minion-group-qss2
Nov 23 21:07:34.382: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-qss2 0f567691-be6f-4056-8e45-f5c587fd8fff 10194 0 2022-11-23 20:56:26 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-qss2 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-qss2 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-7934":"bootstrap-e2e-minion-group-qss2","csi-hostpath-provisioning-1098":"bootstrap-e2e-minion-group-qss2","csi-hostpath-volumelimits-3844":"bootstrap-e2e-minion-group-qss2","csi-mock-csi-mock-volumes-5603":"bootstrap-e2e-minion-group-qss2"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-23 20:56:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-23 20:56:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-11-23 21:06:59 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2022-11-23 21:07:06 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-23 21:07:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-alpha/us-west1-b/bootstrap-e2e-minion-group-qss2,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815430144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553286144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-23 21:07:05 +0000 UTC,LastTransitionTime:2022-11-23 20:56:28 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-23 21:07:05 +0000 UTC,LastTransitionTime:2022-11-23 20:56:28 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-23 21:07:05 +0000 UTC,LastTransitionTime:2022-11-23 20:56:28 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-23 21:07:05 +0000 UTC,LastTransitionTime:2022-11-23 20:56:28 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-23 21:07:05 +0000 UTC,LastTransitionTime:2022-11-23 20:56:28 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-23 21:07:05 +0000 UTC,LastTransitionTime:2022-11-23 20:56:28 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2022-11-23 21:07:05 +0000 UTC,LastTransitionTime:2022-11-23 21:07:05 +0000 UTC,Reason:DockerHung,Message:kernel: INFO: task docker:12345 blocked for more than 120 seconds.,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-23 20:56:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:39 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-23 21:07:02 +0000 UTC,LastTransitionTime:2022-11-23 20:56:25 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-23 21:07:02 +0000 UTC,LastTransitionTime:2022-11-23 20:56:25 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-23 21:07:02 +0000 UTC,LastTransitionTime:2022-11-23 20:56:25 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-23 21:07:02 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:34.127.127.16,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-qss2.c.k8s-jkns-gci-gce-alpha.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-qss2.c.k8s-jkns-gci-gce-alpha.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:76baa30d5979427855b04f88deaf8671,SystemUUID:76baa30d-5979-4278-55b0-4f88deaf8671,BootID:f794e29b-0541-47d9-932b-8ed3667da969,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.40+9884746f0fd338,KubeProxyVersion:v1.27.0-alpha.0.40+9884746f0fd338,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcd@sha256:4c4bb2ffc261dd79041c1fa8a7a979520b4c08d8e535583e8fbbf22690d13bb1 registry.k8s.io/etcd:3.5.5-1],SizeBytes:102440299,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.40_9884746f0fd338],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 23 21:07:34.383: INFO:
Logging kubelet events for node bootstrap-e2e-minion-group-qss2
Nov 23 21:07:34.458: INFO:
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-qss2
Nov 23 21:07:34.558: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-qss2: error trying to reach service: No agent available
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
tear down framework | framework.go:193
STEP: Destroying namespace "webhook-9920" for this suite. 11/23/22 21:07:34.558
STEP: Destroying namespace "webhook-9920-markers" for this suite. 11/23/22 21:07:34.622
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\sshould\shonor\stimeout\s\[Conformance\]$'
test/e2e/framework/framework.go:241 k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc00082fe00) test/e2e/framework/framework.go:241 +0x96ffrom junit_01.xml
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] set up framework | framework.go:178 STEP: Creating a kubernetes client 11/23/22 21:35:03.235 Nov 23 21:35:03.236: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Building a namespace api object, basename webhook 11/23/22 21:35:03.239 Nov 23 21:35:03.279: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:35:05.319: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:35:07.319: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:35:09.319: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:35:11.319: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:35:13.318: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:35:15.319: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:35:17.319: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:35:19.319: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:35:21.320: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:35:23.319: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:35:25.319: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:35:27.319: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:35:29.319: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:35:31.319: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:35:33.319: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:35:33.363: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:35:33.363: INFO: Unexpected error: <*errors.errorString | 0xc000195d70>: { s: "timed out waiting for the condition", } Nov 23 21:35:33.364: FAIL: timed out waiting for the condition Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc00082fe00) test/e2e/framework/framework.go:241 +0x96f [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/framework/node/init/init.go:32 Nov 23 21:35:33.364: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/apimachinery/webhook.go:105 [DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] dump namespaces | framework.go:196 STEP: dump namespace information after failure 11/23/22 21:35:33.565 [DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] tear down framework | framework.go:193
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\sshould\smutate\scustom\sresource\swith\sdifferent\sstored\sversion\s\[Conformance\]$'
test/e2e/apimachinery/webhook.go:1808
k8s.io/kubernetes/test/e2e/apimachinery.registerMutatingWebhookForCustomResource(0xc00121be00, {0xc004e24fd0, 0xc}, 0xc00507c0a0, 0xc004c08a40, 0x3aafb88?)
test/e2e/apimachinery/webhook.go:1808 +0xd51
k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.13()
test/e2e/apimachinery/webhook.go:329 +0xad
There were additional failures detected after the initial failure:
[FAILED]
Nov 23 21:35:02.526: failed to list events in namespace "webhook-5430": Get "https://35.247.28.208/api/v1/namespaces/webhook-5430/events": dial tcp 35.247.28.208:443: connect: connection refused
In [DeferCleanup (Each)] at: test/e2e/framework/debug/dump.go:44
----------
[FAILED]
Nov 23 21:35:02.607: Couldn't delete ns: "webhook-5430": Delete "https://35.247.28.208/api/v1/namespaces/webhook-5430": dial tcp 35.247.28.208:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://35.247.28.208/api/v1/namespaces/webhook-5430", Err:(*net.OpError)(0xc0050bb3b0)}),Couldn't delete ns: "webhook-5430-markers": Delete "https://35.247.28.208/api/v1/namespaces/webhook-5430-markers": dial tcp 35.247.28.208:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://35.247.28.208/api/v1/namespaces/webhook-5430-markers", Err:(*net.OpError)(0xc0050bb5e0)})
In [DeferCleanup (Each)] at: test/e2e/framework/framework.go:370
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
set up framework | framework.go:178
STEP: Creating a kubernetes client 11/23/22 21:32:19.885
Nov 23 21:32:19.885: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Building a namespace api object, basename webhook 11/23/22 21:32:19.887
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:32:19.937: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:32:21.977: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:32:23.977: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:32:25.978: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
STEP: Waiting for a default service account to be provisioned in namespace 11/23/22 21:33:21.326
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 11/23/22 21:33:21.407
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/framework/metrics/init/init.go:31
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/apimachinery/webhook.go:90
STEP: Setting up server cert 11/23/22 21:33:39.087
STEP: Create role binding to let webhook read extension-apiserver-authentication 11/23/22 21:33:39.843
Nov 23 21:33:39.918: INFO: role binding webhook-auth-reader already exists
STEP: Deploying the webhook pod 11/23/22 21:33:39.918
STEP: Wait for the deployment to be ready 11/23/22 21:33:40.061
Nov 23 21:33:40.275: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:33:42.340: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:33:44.347: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:33:46.359: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:33:48.360: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:33:50.335: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:33:52.335: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:33:54.346: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:33:56.347: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:33:58.325: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:34:00.333: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:34:02.357: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:34:04.371: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:34:06.448: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:34:08.367: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:34:10.362: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:34:12.370: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:34:14.434: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:34:16.340: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:34:18.351: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:34:20.355: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:34:22.358: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:34:24.383: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:34:26.352: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:34:28.418: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 21:34:30.364: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 21, 33, 40, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
STEP: Deploying the webhook service 11/23/22 21:34:32.515
STEP: Verifying the service has paired with the endpoint 11/23/22 21:34:33.097
Nov 23 21:34:34.097: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
[It] should mutate custom resource with different stored version [Conformance]
test/e2e/apimachinery/webhook.go:323
Nov 23 21:34:34.375: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Registering the mutating webhook for custom resource e2e-test-webhook-68-crds.webhook.example.com via the AdmissionRegistration API 11/23/22 21:34:35.242
Nov 23 21:34:36.100: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:36.917: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:37.660: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:38.251: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:38.818: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:39.759: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:40.339: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:41.011: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:41.503: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:42.466: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:43.585: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:44.379: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:45.598: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:46.350: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:46.825: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:47.496: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:48.264: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:48.695: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:48.944: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:49.244: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:49.483: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:49.764: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:50.095: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:50.710: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:51.409: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:51.817: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:52.112: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:52.397: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:52.680: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:52.954: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:53.220: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:53.492: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:53.794: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:53.976: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:54.900: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:55.671: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:56.095: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:56.498: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:56.670: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:56.892: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:57.057: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:57.340: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:57.626: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:58.264: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:58.726: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:59.326: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:34:59.944: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:35:00.684: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:35:01.168: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:35:01.415: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:35:01.713: INFO: Waiting for webhook configuration to be ready...
Nov 23 21:35:02.000: INFO: Waiting for webhook configuration to be ready...
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:35:02.153: INFO: Waiting for webhook configuration to be ready...
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:35:02.241: INFO: Unexpected error: waiting for webhook configuration to be ready:
<*url.Error | 0xc00434bd10>: {
Op: "Post",
URL: "https://35.247.28.208/api/v1/namespaces/webhook-5430-markers/configmaps",
Err: <*net.OpError | 0xc0051fdc20>{
Op: "dial",
Net: "tcp",
Source: nil,
Addr: <*net.TCPAddr | 0xc00434bce0>{
IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 35, 247, 28, 208],
Port: 443,
Zone: "",
},
Err: <*os.SyscallError | 0xc004348bc0>{
Syscall: "connect",
Err: <syscall.Errno>0x6f,
},
},
}
Nov 23 21:35:02.241: FAIL: waiting for webhook configuration to be ready: Post "https://35.247.28.208/api/v1/namespaces/webhook-5430-markers/configmaps": dial tcp 35.247.28.208:443: connect: connection refused
Full Stack Trace
k8s.io/kubernetes/test/e2e/apimachinery.registerMutatingWebhookForCustomResource(0xc00121be00, {0xc004e24fd0, 0xc}, 0xc00507c0a0, 0xc004c08a40, 0x3aafb88?)
test/e2e/apimachinery/webhook.go:1808 +0xd51
k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.13()
test/e2e/apimachinery/webhook.go:329 +0xad
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:35:02.282: FAIL: failed to delete CustomResourceDefinition(e2e-test-webhook-68-crd): Delete "https://35.247.28.208/apis/apiextensions.k8s.io/v1/customresourcedefinitions/e2e-test-webhook-68-crds.webhook.example.com": dial tcp 35.247.28.208:443: connect: connection refused
Full Stack Trace
k8s.io/kubernetes/test/utils/crd.CreateMultiVersionTestCRD.func1()
test/utils/crd/crd_util.go:117 +0xbf
panic({0x70eb7e0, 0xc0002fa150})
/usr/local/go/src/runtime/panic.go:884 +0x212
k8s.io/kubernetes/test/e2e/framework.Fail({0xc001704b40, 0xb6}, {0xc003ebbbb0?, 0xc000f167e0?, 0xc003ebbbd8?})
test/e2e/framework/log.go:61 +0x145
k8s.io/kubernetes/test/e2e/framework.ExpectNoErrorWithOffset(0x1, {0x7fadf60, 0xc00434bd10}, {0xc000e55330?, 0xc00044e800?, 0x46b?})
test/e2e/framework/expect.go:76 +0x267
k8s.io/kubernetes/test/e2e/framework.ExpectNoError(...)
test/e2e/framework/expect.go:43
k8s.io/kubernetes/test/e2e/apimachinery.registerMutatingWebhookForCustomResource(0xc00121be00, {0xc004e24fd0, 0xc}, 0xc00507c0a0, 0xc004c08a40, 0x3aafb88?)
test/e2e/apimachinery/webhook.go:1808 +0xd51
k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.13()
test/e2e/apimachinery/webhook.go:329 +0xad
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/framework/node/init/init.go:32
Nov 23 21:35:02.284: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/apimachinery/webhook.go:105
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
dump namespaces | framework.go:196
STEP: dump namespace information after failure 11/23/22 21:35:02.485
STEP: Collecting events from namespace "webhook-5430". 11/23/22 21:35:02.485
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:35:02.525: INFO: Unexpected error: failed to list events in namespace "webhook-5430":
<*url.Error | 0xc00439aea0>: {
Op: "Get",
URL: "https://35.247.28.208/api/v1/namespaces/webhook-5430/events",
Err: <*net.OpError | 0xc0050baf50>{
Op: "dial",
Net: "tcp",
Source: nil,
Addr: <*net.TCPAddr | 0xc00439ae70>{
IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 35, 247, 28, 208],
Port: 443,
Zone: "",
},
Err: <*os.SyscallError | 0xc004398a40>{
Syscall: "connect",
Err: <syscall.Errno>0x6f,
},
},
}
Nov 23 21:35:02.526: FAIL: failed to list events in namespace "webhook-5430": Get "https://35.247.28.208/api/v1/namespaces/webhook-5430/events": dial tcp 35.247.28.208:443: connect: connection refused
Full Stack Trace
k8s.io/kubernetes/test/e2e/framework/debug.dumpEventsInNamespace(0xc002b825c0, {0xc004e24fd0, 0xc})
test/e2e/framework/debug/dump.go:44 +0x191
k8s.io/kubernetes/test/e2e/framework/debug.DumpAllNamespaceInfo({0x801de88, 0xc004fd2340}, {0xc004e24fd0, 0xc})
test/e2e/framework/debug/dump.go:62 +0x8d
k8s.io/kubernetes/test/e2e/framework/debug/init.init.0.func1.1(0xc002b82650?, {0xc004e24fd0?, 0x7fa7740?})
test/e2e/framework/debug/init/init.go:34 +0x32
k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo.func1()
test/e2e/framework/framework.go:274 +0x6d
k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo(0xc00121be00)
test/e2e/framework/framework.go:271 +0x179
reflect.Value.call({0x6627cc0?, 0xc0010d2250?, 0xc003494fb0?}, {0x75b6e72, 0x4}, {0xae73300, 0x0, 0xc0030f8d88?})
/usr/local/go/src/reflect/value.go:584 +0x8c5
reflect.Value.Call({0x6627cc0?, 0xc0010d2250?, 0x29449fc?}, {0xae73300?, 0xc003494f80?, 0x0?})
/usr/local/go/src/reflect/value.go:368 +0xbc
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
tear down framework | framework.go:193
STEP: Destroying namespace "webhook-5430" for this suite. 11/23/22 21:35:02.526
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
STEP: Destroying namespace "webhook-5430-markers" for this suite. 11/23/22 21:35:02.566
ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:35:02.607: FAIL: Couldn't delete ns: "webhook-5430": Delete "https://35.247.28.208/api/v1/namespaces/webhook-5430": dial tcp 35.247.28.208:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://35.247.28.208/api/v1/namespaces/webhook-5430", Err:(*net.OpError)(0xc0050bb3b0)}),Couldn't delete ns: "webhook-5430-markers": Delete "https://35.247.28.208/api/v1/namespaces/webhook-5430-markers": dial tcp 35.247.28.208:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://35.247.28.208/api/v1/namespaces/webhook-5430-markers", Err:(*net.OpError)(0xc0050bb5e0)})
Full Stack Trace
k8s.io/kubernetes/test/e2e/framework.(*Framework).AfterEach.func1()
test/e2e/framework/framework.go:370 +0x4fe
k8s.io/kubernetes/test/e2e/framework.(*Framework).AfterEach(0xc00121be00)
test/e2e/framework/framework.go:383 +0x1ca
reflect.Value.call({0x6627cc0?, 0xc0010d2040?, 0xc003494fb0?}, {0x75b6e72, 0x4}, {0xae73300, 0x0, 0xc0030f8d88?})
/usr/local/go/src/reflect/value.go:584 +0x8c5
reflect.Value.Call({0x6627cc0?, 0xc0010d2040?, 0x29449fc?}, {0xae73300?, 0xc003494f80?, 0x0?})
/usr/local/go/src/reflect/value.go:368 +0xbc
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\sshould\smutate\scustom\sresource\swith\spruning\s\[Conformance\]$'
test/e2e/framework/framework.go:241
k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc00115fe00)
test/e2e/framework/framework.go:241 +0x96f
There were additional failures detected after the initial failure:
[PANICKED]
Test Panicked
In [AfterEach] at: /usr/local/go/src/runtime/panic.go:260
runtime error: invalid memory address or nil pointer dereference
Full Stack Trace
k8s.io/kubernetes/test/e2e/apimachinery.cleanWebhookTest({0x0, 0x0}, {0x0, 0x0})
test/e2e/apimachinery/webhook.go:1680 +0x46
k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.2()
test/e2e/apimachinery/webhook.go:106 +0x2f
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
set up framework | framework.go:178
STEP: Creating a kubernetes client 11/23/22 21:16:48.972
Nov 23 21:16:48.972: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Building a namespace api object, basename webhook 11/23/22 21:16:48.974
Nov 23 21:16:49.014: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:16:51.054: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:16:53.054: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:16:55.054: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:16:57.053: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:16:59.054: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:17:01.053: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:17:03.054: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:17:05.054: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:17:07.053: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:17:09.058: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:17:11.054: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:17:13.054: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:17:15.054: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:17:17.053: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:17:19.054: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:17:19.093: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:17:19.094: INFO: Unexpected error:
<*errors.errorString | 0xc00011dd70>: {
s: "timed out waiting for the condition",
}
Nov 23 21:17:19.094: FAIL: timed out waiting for the condition
Full Stack Trace
k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc00115fe00)
test/e2e/framework/framework.go:241 +0x96f
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/framework/node/init/init.go:32
Nov 23 21:17:19.094: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/apimachinery/webhook.go:105
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
dump namespaces | framework.go:196
STEP: dump namespace information after failure 11/23/22 21:17:19.134
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
tear down framework | framework.go:193
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\sshould\smutate\spod\sand\sapply\sdefaults\safter\smutation\s\[Conformance\]$'
test/e2e/framework/framework.go:241
k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc0009dde00)
test/e2e/framework/framework.go:241 +0x96f
There were additional failures detected after the initial failure:
[PANICKED]
Test Panicked
In [AfterEach] at: /usr/local/go/src/runtime/panic.go:260
runtime error: invalid memory address or nil pointer dereference
Full Stack Trace
k8s.io/kubernetes/test/e2e/apimachinery.cleanWebhookTest({0x0, 0x0}, {0x0, 0x0})
test/e2e/apimachinery/webhook.go:1680 +0x46
k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.2()
test/e2e/apimachinery/webhook.go:106 +0x2f
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
set up framework | framework.go:178
STEP: Creating a kubernetes client 11/23/22 21:17:18.875
Nov 23 21:17:18.875: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Building a namespace api object, basename webhook 11/23/22 21:17:18.877
Nov 23 21:17:18.916: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:17:20.956: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:17:22.956: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:17:24.956: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:17:26.956: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:17:28.956: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:17:30.956: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:17:32.957: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:19:38.312: INFO: Unexpected error:
<*fmt.wrapError | 0xc003402020>: {
msg: "wait for service account \"default\" in namespace \"webhook-7003\": timed out waiting for the condition",
err: <*errors.errorString | 0xc00011dd80>{
s: "timed out waiting for the condition",
},
}
Nov 23 21:19:38.312: FAIL: wait for service account "default" in namespace "webhook-7003": timed out waiting for the condition
Full Stack Trace
k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc0009dde00)
test/e2e/framework/framework.go:241 +0x96f
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/framework/node/init/init.go:32
Nov 23 21:19:38.312: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/apimachinery/webhook.go:105
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
dump namespaces | framework.go:196
STEP: dump namespace information after failure 11/23/22 21:19:38.398
STEP: Collecting events from namespace "webhook-7003". 11/23/22 21:19:38.399
STEP: Found 0 events. 11/23/22 21:19:38.44
Nov 23 21:19:38.482: INFO: POD NODE PHASE GRACE CONDITIONS
Nov 23 21:19:38.482: INFO:
Nov 23 21:19:38.528: INFO:
Logging node info for node bootstrap-e2e-master
Nov 23 21:19:38.568: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master e178771e-6078-4cf7-a352-1d84c66cb7be 15145 0 2022-11-23 20:56:22 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-23 20:56:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-11-23 20:56:39 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-11-23 20:56:40 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-11-23 21:17:38 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-alpha/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3858366464 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3596222464 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-23 20:56:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:39 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-23 21:17:38 +0000 UTC,LastTransitionTime:2022-11-23 20:56:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-23 21:17:38 +0000 UTC,LastTransitionTime:2022-11-23 20:56:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-23 21:17:38 +0000 UTC,LastTransitionTime:2022-11-23 20:56:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-23 21:17:38 +0000 UTC,LastTransitionTime:2022-11-23 20:56:24 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:35.247.28.208,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-jkns-gci-gce-alpha.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-jkns-gci-gce-alpha.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:15f6e783a1401075c491684ecd23ec3a,SystemUUID:15f6e783-a140-1075-c491-684ecd23ec3a,BootID:04aebf08-8ea7-4b94-843b-308a92bf91fb,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.40+9884746f0fd338,KubeProxyVersion:v1.27.0-alpha.0.40+9884746f0fd338,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-alpha.0.40_9884746f0fd338],SizeBytes:135160275,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-alpha.0.40_9884746f0fd338],SizeBytes:124989753,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:b83c1d70989e1fe87583607bf5aee1ee34e52773d4755b95f5cf5a451962f3a4 registry.k8s.io/etcd:3.5.5-0],SizeBytes:102417044,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-alpha.0.40_9884746f0fd338],SizeBytes:57659704,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:2c111f004bec24888d8cfa2a812a38fb8341350abac67dcd0ac64e709dfe389c registry.k8s.io/kas-network-proxy/proxy-server:v0.0.33],SizeBytes:22020129,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 23 21:19:38.569: INFO:
Logging kubelet events for node bootstrap-e2e-master
Nov 23 21:19:38.615: INFO:
Logging pods the kubelet thinks is on node bootstrap-e2e-master
Nov 23 21:19:38.658: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-master: error trying to reach service: No agent available
Nov 23 21:19:38.658: INFO:
Logging node info for node bootstrap-e2e-minion-group-3dd6
Nov 23 21:19:38.762: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-3dd6 aba1b812-4944-438f-b4bc-79f731a0b1cc 15329 0 2022-11-23 20:56:27 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-3dd6 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-3dd6 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-volumemode-5531":"bootstrap-e2e-minion-group-3dd6","csi-mock-csi-mock-volumes-1039":"bootstrap-e2e-minion-group-3dd6","csi-mock-csi-mock-volumes-4923":"bootstrap-e2e-minion-group-3dd6"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-11-23 20:56:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {kubelet Update v1 2022-11-23 20:56:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-23 21:13:33 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {node-problem-detector Update v1 2022-11-23 21:17:42 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-23 21:19:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-alpha/us-west1-b/bootstrap-e2e-minion-group-3dd6,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2022-11-23 21:17:42 +0000 UTC,LastTransitionTime:2022-11-23 21:06:58 +0000 UTC,Reason:DockerHung,Message:kernel: INFO: task docker:12345 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-23 21:17:42 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-23 21:17:42 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-23 21:17:42 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-23 21:17:42 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-23 21:17:42 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-23 21:17:42 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-23 20:56:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:39 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-23 21:16:43 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-23 21:16:43 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-23 21:16:43 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-23 21:16:43 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.83.109.94,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-3dd6.c.k8s-jkns-gci-gce-alpha.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-3dd6.c.k8s-jkns-gci-gce-alpha.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e748f2e47d098c7d59fb0c64c73041ef,SystemUUID:e748f2e4-7d09-8c7d-59fb-0c64c73041ef,BootID:7dd715f8-7985-4853-a244-581e49eff17e,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.40+9884746f0fd338,KubeProxyVersion:v1.27.0-alpha.0.40+9884746f0fd338,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.40_9884746f0fd338],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-174^0850954f-6b72-11ed-8a23-76b571dae824],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-174^0850954f-6b72-11ed-8a23-76b571dae824,DevicePath:,},},Config:nil,},}
Nov 23 21:19:38.763: INFO:
Logging kubelet events for node bootstrap-e2e-minion-group-3dd6
Nov 23 21:19:38.931: INFO:
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-3dd6
Nov 23 21:19:38.997: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-3dd6: error trying to reach service: No agent available
Nov 23 21:19:38.997: INFO:
Logging node info for node bootstrap-e2e-minion-group-3h36
Nov 23 21:19:39.043: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-3h36 ab6bfea1-ac11-4084-be81-dd72391e5606 15372 0 2022-11-23 20:56:27 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-3h36 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-3h36 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-6659":"bootstrap-e2e-minion-group-3h36","csi-hostpath-volume-7023":"bootstrap-e2e-minion-group-3h36","csi-hostpath-volume-expand-1606":"bootstrap-e2e-minion-group-3h36","csi-mock-csi-mock-volumes-2421":"bootstrap-e2e-minion-group-3h36","csi-mock-csi-mock-volumes-2701":"bootstrap-e2e-minion-group-3h36","csi-mock-csi-mock-volumes-4031":"bootstrap-e2e-minion-group-3h36","csi-mock-csi-mock-volumes-6008":"bootstrap-e2e-minion-group-3h36"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-23 20:56:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-23 20:56:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-11-23 21:13:20 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {node-problem-detector Update v1 2022-11-23 21:17:45 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-23 21:19:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-alpha/us-west1-b/bootstrap-e2e-minion-group-3h36,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815430144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553286144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2022-11-23 21:17:45 +0000 UTC,LastTransitionTime:2022-11-23 21:07:01 +0000 UTC,Reason:DockerHung,Message:kernel: INFO: task docker:12345 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-23 21:17:45 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-23 21:17:45 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-23 21:17:45 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-23 21:17:45 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-23 21:17:45 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-23 21:17:45 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-23 20:56:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:39 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-23 21:18:29 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-23 21:18:29 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-23 21:18:29 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-23 21:18:29 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:35.199.155.0,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-3h36.c.k8s-jkns-gci-gce-alpha.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-3h36.c.k8s-jkns-gci-gce-alpha.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:4aed16763bdc994e9fc6e3e0c95cb8ae,SystemUUID:4aed1676-3bdc-994e-9fc6-e3e0c95cb8ae,BootID:461d3e21-d519-43c8-ab39-0c2de0db6ed8,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.40+9884746f0fd338,KubeProxyVersion:v1.27.0-alpha.0.40+9884746f0fd338,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.40_9884746f0fd338],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 registry.k8s.io/sig-storage/snapshot-controller:v6.1.0],SizeBytes:22620891,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-6659^86e580f3-6b73-11ed-b59e-5aeca3ae5a48],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-6659^86e580f3-6b73-11ed-b59e-5aeca3ae5a48,DevicePath:,},},Config:nil,},}
Nov 23 21:19:39.043: INFO:
Logging kubelet events for node bootstrap-e2e-minion-group-3h36
Nov 23 21:19:39.095: INFO:
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-3h36
Nov 23 21:19:39.163: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-3h36: error trying to reach service: No agent available
Nov 23 21:19:39.163: INFO:
Logging node info for node bootstrap-e2e-minion-group-qss2
Nov 23 21:19:39.216: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-qss2 0f567691-be6f-4056-8e45-f5c587fd8fff 15331 0 2022-11-23 20:56:26 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-qss2 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-qss2 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-4070":"bootstrap-e2e-minion-group-qss2","csi-hostpath-ephemeral-7934":"bootstrap-e2e-minion-group-qss2","csi-hostpath-provisioning-1098":"bootstrap-e2e-minion-group-qss2"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-23 20:56:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-23 20:56:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-11-23 21:13:57 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {node-problem-detector Update v1 2022-11-23 21:17:39 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-23 21:19:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-alpha/us-west1-b/bootstrap-e2e-minion-group-qss2,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815430144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553286144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-23 21:17:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:28 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-23 21:17:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:28 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-23 21:17:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:28 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2022-11-23 21:17:39 +0000 UTC,LastTransitionTime:2022-11-23 21:07:05 +0000 UTC,Reason:DockerHung,Message:kernel: INFO: task docker:12345 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-23 21:17:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:28 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-23 21:17:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:28 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-23 21:17:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:28 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-23 20:56:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:39 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-23 21:19:03 +0000 UTC,LastTransitionTime:2022-11-23 20:56:25 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-23 21:19:03 +0000 UTC,LastTransitionTime:2022-11-23 20:56:25 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-23 21:19:03 +0000 UTC,LastTransitionTime:2022-11-23 20:56:25 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-23 21:19:03 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:34.127.127.16,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-qss2.c.k8s-jkns-gci-gce-alpha.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-qss2.c.k8s-jkns-gci-gce-alpha.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:76baa30d5979427855b04f88deaf8671,SystemUUID:76baa30d-5979-4278-55b0-4f88deaf8671,BootID:f794e29b-0541-47d9-932b-8ed3667da969,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.40+9884746f0fd338,KubeProxyVersion:v1.27.0-alpha.0.40+9884746f0fd338,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4c4bb2ffc261dd79041c1fa8a7a979520b4c08d8e535583e8fbbf22690d13bb1 registry.k8s.io/etcd:3.5.5-1],SizeBytes:102440299,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.40_9884746f0fd338],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-volume-expand-652^27b2ea4d-6b73-11ed-a3f5-da4b8a158143],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-volume-expand-652^27b2ea4d-6b73-11ed-a3f5-da4b8a158143,DevicePath:,},},Config:nil,},}
Nov 23 21:19:39.216: INFO:
Logging kubelet events for node bootstrap-e2e-minion-group-qss2
Nov 23 21:19:39.337: INFO:
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-qss2
Nov 23 21:19:39.418: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-qss2: error trying to reach service: No agent available
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
tear down framework | framework.go:193
STEP: Destroying namespace "webhook-7003" for this suite. 11/23/22 21:19:39.418
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\sshould\snot\sbe\sable\sto\smutate\sor\sprevent\sdeletion\sof\swebhook\sconfiguration\sobjects\s\[Conformance\]$'
test/e2e/framework/framework.go:241
k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc00128ce10)
test/e2e/framework/framework.go:241 +0x96f
There were additional failures detected after the initial failure:
[PANICKED]
Test Panicked
In [AfterEach] at: /usr/local/go/src/runtime/panic.go:260
runtime error: invalid memory address or nil pointer dereference
Full Stack Trace
k8s.io/kubernetes/test/e2e/apimachinery.cleanWebhookTest({0x0, 0x0}, {0x0, 0x0})
test/e2e/apimachinery/webhook.go:1680 +0x46
k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.2()
test/e2e/apimachinery/webhook.go:106 +0x2f
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
set up framework | framework.go:178
STEP: Creating a kubernetes client 11/23/22 21:35:03.246
Nov 23 21:35:03.246: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Building a namespace api object, basename webhook 11/23/22 21:35:03.248
Nov 23 21:35:03.287: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:35:05.328: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:35:07.327: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:35:09.328: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:35:11.328: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:35:13.328: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:35:15.328: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:35:17.328: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:35:19.327: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:35:21.328: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:35:23.328: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:35:25.328: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:35:27.328: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:35:29.327: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:35:31.328: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:35:33.328: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:35:33.368: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:35:33.368: INFO: Unexpected error:
<*errors.errorString | 0xc0001cba00>: {
s: "timed out waiting for the condition",
}
Nov 23 21:35:33.368: FAIL: timed out waiting for the condition
Full Stack Trace
k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc00128ce10)
test/e2e/framework/framework.go:241 +0x96f
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/framework/node/init/init.go:32
Nov 23 21:35:33.368: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/apimachinery/webhook.go:105
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
dump namespaces | framework.go:196
STEP: dump namespace information after failure 11/23/22 21:35:33.409
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
tear down framework | framework.go:193
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sCustomResourceConversionWebhook\s\[Privileged\:ClusterAdmin\]\sshould\sbe\sable\sto\sconvert\sfrom\sCR\sv1\sto\sCR\sv2\s\[Conformance\]$'
test/e2e/apimachinery/crd_conversion_webhook.go:478
k8s.io/kubernetes/test/e2e/apimachinery.waitWebhookConversionReady(0xc000de2870?, 0xc000b93900?, 0xc0036b6a80?, {0x75b567e?, 0x2?})
test/e2e/apimachinery/crd_conversion_webhook.go:478 +0xf3
k8s.io/kubernetes/test/e2e/apimachinery.glob..func5.3()
test/e2e/apimachinery/crd_conversion_webhook.go:173 +0x113
There were additional failures detected after the initial failure:
[FAILED]
Nov 23 20:59:48.441: Couldn't delete ns: "crd-webhook-5956": Delete "https://35.247.28.208/api/v1/namespaces/crd-webhook-5956": dial tcp 35.247.28.208:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://35.247.28.208/api/v1/namespaces/crd-webhook-5956", Err:(*net.OpError)(0xc002430820)})
In [DeferCleanup (Each)] at: test/e2e/framework/framework.go:370
[BeforeEach] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin]
set up framework | framework.go:178
STEP: Creating a kubernetes client 11/23/22 20:58:16.451
Nov 23 20:58:16.451: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Building a namespace api object, basename crd-webhook 11/23/22 20:58:16.454
STEP: Waiting for a default service account to be provisioned in namespace 11/23/22 20:58:16.831
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 11/23/22 20:58:16.932
[BeforeEach] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin]
test/e2e/framework/metrics/init/init.go:31
[BeforeEach] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin]
test/e2e/apimachinery/crd_conversion_webhook.go:128
STEP: Setting up server cert 11/23/22 20:58:17.018
STEP: Create role binding to let cr conversion webhook read extension-apiserver-authentication 11/23/22 20:58:17.684
STEP: Deploying the custom resource conversion webhook pod 11/23/22 20:58:17.927
STEP: Wait for the deployment to be ready 11/23/22 20:58:18.312
Nov 23 20:58:18.669: INFO: deployment "sample-crd-conversion-webhook-deployment" doesn't have the required revision set
Nov 23 20:58:21.008: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 20:58:23.095: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 20:58:25.163: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 20:58:27.089: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 20:58:29.083: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 20:58:31.125: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 20:58:33.111: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 20:58:35.075: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 20:58:37.069: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 20:58:39.142: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 20:58:41.067: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 20:58:43.091: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 20:58:45.137: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 20:58:47.076: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 20:58:49.077: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 20:58:51.129: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 20:58:53.066: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 20:58:55.071: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 20:58:57.051: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 20:58:59.064: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 20:59:01.058: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 20:59:03.144: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 20:59:05.088: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 20:59:07.057: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 23 20:59:09.059: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 23, 20, 58, 18, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
STEP: Deploying the webhook service 11/23/22 20:59:11.068
STEP: Verifying the service has paired with the endpoint 11/23/22 20:59:11.153
Nov 23 20:59:12.154: INFO: Waiting for amount of service:e2e-test-crd-conversion-webhook endpoints to be 1
[It] should be able to convert from CR v1 to CR v2 [Conformance]
test/e2e/apimachinery/crd_conversion_webhook.go:149
Nov 23 20:59:12.210: INFO: >>> kubeConfig: /workspace/.kube/config
Nov 23 20:59:15.376: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:15.542: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:15.627: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:15.757: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:15.843: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:15.946: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:16.023: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:16.138: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:16.243: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:16.330: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:16.444: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:16.548: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:16.626: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:16.736: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:16.842: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:16.979: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:17.319: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:17.450: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:17.582: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:17.761: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:17.869: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:18.136: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:18.410: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:18.585: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:18.727: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:18.826: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:18.923: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:19.040: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:19.147: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:19.347: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:19.530: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:19.737: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:19.930: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:20.138: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:20.325: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:20.531: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:20.732: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:20.934: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:21.161: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:21.340: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:21.608: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:21.738: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:21.937: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:22.132: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:22.369: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:22.526: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:22.729: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:22.929: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:23.133: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:23.335: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:23.524: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:23.752: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:23.930: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:24.158: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:24.363: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:24.606: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:24.850: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:24.955: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:25.148: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:25.358: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:25.557: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:25.736: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:25.928: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:26.120: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:26.335: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:26.548: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:26.727: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:26.931: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:27.123: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:27.326: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:27.542: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:27.753: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:27.934: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:28.130: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:28.329: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:28.532: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:28.721: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:28.924: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:29.135: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:29.345: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:29.567: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:29.727: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:29.925: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:30.130: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:30.330: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:30.527: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:30.772: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:30.943: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:31.182: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:31.324: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:31.556: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:31.727: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:31.951: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:32.123: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:32.331: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:32.527: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:32.741: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:32.917: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:33.131: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:33.334: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:33.535: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:33.771: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:33.964: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:34.145: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:34.340: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:34.554: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:34.727: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:34.934: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:35.124: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:35.328: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:35.528: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:35.732: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:35.942: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:36.127: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:36.324: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:36.533: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:36.743: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:36.936: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:37.123: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:37.333: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:37.530: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:37.734: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:37.934: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:38.128: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:38.328: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:38.581: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:38.740: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:38.941: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:39.195: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:39.341: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:39.531: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:39.739: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:39.934: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:40.133: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:40.327: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:40.528: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:40.729: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:40.959: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:41.125: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:41.339: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:41.526: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:41.749: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:41.950: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:42.233: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:42.335: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:42.548: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:42.729: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:42.939: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:43.128: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:43.324: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:43.527: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:43.718: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:43.921: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:44.135: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:44.333: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:44.523: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:44.723: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:44.949: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:45.147: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:45.331: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:45.539: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:45.728: INFO: error waiting for conversion to succeed during setup: conversion webhook for stable.example.com/v2, Kind=e2e-test-crd-webhook-714-crd failed: Post "https://e2e-test-crd-conversion-webhook.crd-webhook-5956.svc:9443/crdconvert?timeout=30s": no endpoints available for service "e2e-test-crd-conversion-webhook"
Nov 23 20:59:45.728: INFO: Unexpected error:
<*errors.errorString | 0xc000117c60>: {
s: "timed out waiting for the condition",
}
Nov 23 20:59:45.729: FAIL: timed out waiting for the condition
Full Stack Trace
k8s.io/kubernetes/test/e2e/apimachinery.waitWebhookConversionReady(0xc000de2870?, 0xc000b93900?, 0xc0036b6a80?, {0x75b567e?, 0x2?})
test/e2e/apimachinery/crd_conversion_webhook.go:478 +0xf3
k8s.io/kubernetes/test/e2e/apimachinery.glob..func5.3()
test/e2e/apimachinery/crd_conversion_webhook.go:173 +0x113
[AfterEach] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin]
test/e2e/framework/node/init/init.go:32
Nov 23 20:59:46.444: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[AfterEach] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin]
test/e2e/apimachinery/crd_conversion_webhook.go:139
[DeferCleanup (Each)] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin]
test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin]
dump namespaces | framework.go:196
STEP: dump namespace information after failure 11/23/22 20:59:46.854
STEP: Collecting events from namespace "crd-webhook-5956". 11/23/22 20:59:46.855
STEP: Found 13 events. 11/23/22 20:59:46.907
Nov 23 20:59:46.907: INFO: At 2022-11-23 20:58:18 +0000 UTC - event for sample-crd-conversion-webhook-deployment: {deployment-controller } ScalingReplicaSet: Scaled up replica set sample-crd-conversion-webhook-deployment-74ff66dd47 to 1
Nov 23 20:59:46.907: INFO: At 2022-11-23 20:58:18 +0000 UTC - event for sample-crd-conversion-webhook-deployment-74ff66dd47: {replicaset-controller } SuccessfulCreate: Created pod: sample-crd-conversion-webhook-deployment-74ff66dd47-zs47n
Nov 23 20:59:46.907: INFO: At 2022-11-23 20:58:18 +0000 UTC - event for sample-crd-conversion-webhook-deployment-74ff66dd47-zs47n: {default-scheduler } Scheduled: Successfully assigned crd-webhook-5956/sample-crd-conversion-webhook-deployment-74ff66dd47-zs47n to bootstrap-e2e-minion-group-3h36
Nov 23 20:59:46.907: INFO: At 2022-11-23 20:58:20 +0000 UTC - event for sample-crd-conversion-webhook-deployment-74ff66dd47-zs47n: {kubelet bootstrap-e2e-minion-group-3h36} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine
Nov 23 20:59:46.907: INFO: At 2022-11-23 20:58:20 +0000 UTC - event for sample-crd-conversion-webhook-deployment-74ff66dd47-zs47n: {kubelet bootstrap-e2e-minion-group-3h36} Created: Created container sample-crd-conversion-webhook
Nov 23 20:59:46.907: INFO: At 2022-11-23 20:58:20 +0000 UTC - event for sample-crd-conversion-webhook-deployment-74ff66dd47-zs47n: {kubelet bootstrap-e2e-minion-group-3h36} Started: Started container sample-crd-conversion-webhook
Nov 23 20:59:46.907: INFO: At 2022-11-23 20:58:21 +0000 UTC - event for sample-crd-conversion-webhook-deployment-74ff66dd47-zs47n: {kubelet bootstrap-e2e-minion-group-3h36} Unhealthy: Readiness probe failed: Get "https://10.64.3.31:9444/readyz": dial tcp 10.64.3.31:9444: connect: connection refused
Nov 23 20:59:46.907: INFO: At 2022-11-23 20:58:21 +0000 UTC - event for sample-crd-conversion-webhook-deployment-74ff66dd47-zs47n: {kubelet bootstrap-e2e-minion-group-3h36} Unhealthy: Readiness probe failed: Get "https://10.64.3.31:9444/readyz": read tcp 10.64.3.1:42214->10.64.3.31:9444: read: connection reset by peer
Nov 23 20:59:46.907: INFO: At 2022-11-23 20:58:21 +0000 UTC - event for sample-crd-conversion-webhook-deployment-74ff66dd47-zs47n: {kubelet bootstrap-e2e-minion-group-3h36} Killing: Stopping container sample-crd-conversion-webhook
Nov 23 20:59:46.907: INFO: At 2022-11-23 20:58:22 +0000 UTC - event for sample-crd-conversion-webhook-deployment-74ff66dd47-zs47n: {kubelet bootstrap-e2e-minion-group-3h36} SandboxChanged: Pod sandbox changed, it will be killed and re-created.
Nov 23 20:59:46.907: INFO: At 2022-11-23 20:58:26 +0000 UTC - event for sample-crd-conversion-webhook-deployment-74ff66dd47-zs47n: {kubelet bootstrap-e2e-minion-group-3h36} Unhealthy: Readiness probe failed: Get "https://10.64.3.32:9444/readyz": read tcp 10.64.3.1:51812->10.64.3.32:9444: read: connection reset by peer
Nov 23 20:59:46.907: INFO: At 2022-11-23 20:58:42 +0000 UTC - event for sample-crd-conversion-webhook-deployment-74ff66dd47-zs47n: {kubelet bootstrap-e2e-minion-group-3h36} Unhealthy: Readiness probe failed: Get "https://10.64.3.57:9444/readyz": dial tcp 10.64.3.57:9444: connect: connection refused
Nov 23 20:59:46.907: INFO: At 2022-11-23 20:58:49 +0000 UTC - event for sample-crd-conversion-webhook-deployment-74ff66dd47-zs47n: {kubelet bootstrap-e2e-minion-group-3h36} BackOff: Back-off restarting failed container sample-crd-conversion-webhook in pod sample-crd-conversion-webhook-deployment-74ff66dd47-zs47n_crd-webhook-5956(dc51afd6-75c2-4d10-b851-ce90224224c8)
Nov 23 20:59:46.959: INFO: POD NODE PHASE GRACE CONDITIONS
Nov 23 20:59:46.960: INFO:
Nov 23 20:59:47.029: INFO:
Logging node info for node bootstrap-e2e-master
Nov 23 20:59:47.105: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master e178771e-6078-4cf7-a352-1d84c66cb7be 566 0 2022-11-23 20:56:22 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-23 20:56:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-11-23 20:56:39 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-11-23 20:56:40 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-11-23 20:56:43 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-alpha/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3858366464 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3596222464 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-23 20:56:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:39 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-23 20:56:43 +0000 UTC,LastTransitionTime:2022-11-23 20:56:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-23 20:56:43 +0000 UTC,LastTransitionTime:2022-11-23 20:56:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-23 20:56:43 +0000 UTC,LastTransitionTime:2022-11-23 20:56:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-23 20:56:43 +0000 UTC,LastTransitionTime:2022-11-23 20:56:24 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:35.247.28.208,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-jkns-gci-gce-alpha.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-jkns-gci-gce-alpha.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:15f6e783a1401075c491684ecd23ec3a,SystemUUID:15f6e783-a140-1075-c491-684ecd23ec3a,BootID:04aebf08-8ea7-4b94-843b-308a92bf91fb,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.40+9884746f0fd338,KubeProxyVersion:v1.27.0-alpha.0.40+9884746f0fd338,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-alpha.0.40_9884746f0fd338],SizeBytes:135160275,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-alpha.0.40_9884746f0fd338],SizeBytes:124989753,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:b83c1d70989e1fe87583607bf5aee1ee34e52773d4755b95f5cf5a451962f3a4 registry.k8s.io/etcd:3.5.5-0],SizeBytes:102417044,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-alpha.0.40_9884746f0fd338],SizeBytes:57659704,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:2c111f004bec24888d8cfa2a812a38fb8341350abac67dcd0ac64e709dfe389c registry.k8s.io/kas-network-proxy/proxy-server:v0.0.33],SizeBytes:22020129,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 23 20:59:47.106: INFO:
Logging kubelet events for node bootstrap-e2e-master
Nov 23 20:59:47.194: INFO:
Logging pods the kubelet thinks is on node bootstrap-e2e-master
Nov 23 20:59:47.330: INFO: etcd-server-bootstrap-e2e-master started at 2022-11-23 20:55:40 +0000 UTC (0+1 container statuses recorded)
Nov 23 20:59:47.330: INFO: Container etcd-container ready: true, restart count 0
Nov 23 20:59:47.330: INFO: konnectivity-server-bootstrap-e2e-master started at 2022-11-23 20:55:40 +0000 UTC (0+1 container statuses recorded)
Nov 23 20:59:47.330: INFO: Container konnectivity-server-container ready: true, restart count 0
Nov 23 20:59:47.330: INFO: kube-apiserver-bootstrap-e2e-master started at 2022-11-23 20:55:40 +0000 UTC (0+1 container statuses recorded)
Nov 23 20:59:47.330: INFO: Container kube-apiserver ready: true, restart count 0
Nov 23 20:59:47.330: INFO: kube-scheduler-bootstrap-e2e-master started at 2022-11-23 20:55:40 +0000 UTC (0+1 container statuses recorded)
Nov 23 20:59:47.330: INFO: Container kube-scheduler ready: true, restart count 0
Nov 23 20:59:47.330: INFO: etcd-server-events-bootstrap-e2e-master started at 2022-11-23 20:55:40 +0000 UTC (0+1 container statuses recorded)
Nov 23 20:59:47.330: INFO: Container etcd-container ready: true, restart count 0
Nov 23 20:59:47.330: INFO: kube-controller-manager-bootstrap-e2e-master started at 2022-11-23 20:55:40 +0000 UTC (0+1 container statuses recorded)
Nov 23 20:59:47.330: INFO: Container kube-controller-manager ready: true, restart count 1
Nov 23 20:59:47.330: INFO: kube-addon-manager-bootstrap-e2e-master started at 2022-11-23 20:55:56 +0000 UTC (0+1 container statuses recorded)
Nov 23 20:59:47.330: INFO: Container kube-addon-manager ready: true, restart count 0
Nov 23 20:59:47.330: INFO: l7-lb-controller-bootstrap-e2e-master started at 2022-11-23 20:55:56 +0000 UTC (0+1 container statuses recorded)
Nov 23 20:59:47.330: INFO: Container l7-lb-controller ready: true, restart count 4
Nov 23 20:59:47.330: INFO: metadata-proxy-v0.1-vrplk started at 2022-11-23 20:56:22 +0000 UTC (0+2 container statuses recorded)
Nov 23 20:59:47.330: INFO: Container metadata-proxy ready: true, restart count 0
Nov 23 20:59:47.330: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0
Nov 23 20:59:47.707: INFO:
Latency metrics for node bootstrap-e2e-master
Nov 23 20:59:47.707: INFO:
Logging node info for node bootstrap-e2e-minion-group-3dd6
Nov 23 20:59:47.791: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-3dd6 aba1b812-4944-438f-b4bc-79f731a0b1cc 4128 0 2022-11-23 20:56:27 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-3dd6 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-3dd6 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-11-23 20:56:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {kubelet Update v1 2022-11-23 20:56:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {node-problem-detector Update v1 2022-11-23 20:56:31 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-11-23 20:56:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-11-23 20:59:31 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-alpha/us-west1-b/bootstrap-e2e-minion-group-3dd6,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-23 20:56:31 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-23 20:56:31 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-23 20:56:31 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-23 20:56:31 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-23 20:56:31 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-23 20:56:31 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-23 20:56:31 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-23 20:56:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:39 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-23 20:59:31 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-23 20:59:31 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-23 20:59:31 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-23 20:59:31 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.83.109.94,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-3dd6.c.k8s-jkns-gci-gce-alpha.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-3dd6.c.k8s-jkns-gci-gce-alpha.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e748f2e47d098c7d59fb0c64c73041ef,SystemUUID:e748f2e4-7d09-8c7d-59fb-0c64c73041ef,BootID:7dd715f8-7985-4853-a244-581e49eff17e,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.40+9884746f0fd338,KubeProxyVersion:v1.27.0-alpha.0.40+9884746f0fd338,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.40_9884746f0fd338],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 23 20:59:47.792: INFO:
Logging kubelet events for node bootstrap-e2e-minion-group-3dd6
Nov 23 20:59:47.869: INFO:
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-3dd6
Nov 23 20:59:48.024: INFO: metadata-proxy-v0.1-vqzmn started at 2022-11-23 20:56:28 +0000 UTC (0+2 container statuses recorded)
Nov 23 20:59:48.024: INFO: Container metadata-proxy ready: true, restart count 0
Nov 23 20:59:48.024: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0
Nov 23 20:59:48.024: INFO: hostexec started at 2022-11-23 20:59:26 +0000 UTC (0+1 container statuses recorded)
Nov 23 20:59:48.024: INFO: Container agnhost-container ready: true, restart count 0
Nov 23 20:59:48.024: INFO: kube-dns-autoscaler-5f6455f985-gvgs7 started at 2022-11-23 20:56:40 +0000 UTC (0+1 container statuses recorded)
Nov 23 20:59:48.024: INFO: Container autoscaler ready: false, restart count 3
Nov 23 20:59:48.024: INFO: coredns-6d97d5ddb-mj9sj started at 2022-11-23 20:56:40 +0000 UTC (0+1 container statuses recorded)
Nov 23 20:59:48.024: INFO: Container coredns ready: false, restart count 3
Nov 23 20:59:48.024: INFO: pod2 started at 2022-11-23 20:59:04 +0000 UTC (0+1 container statuses recorded)
Nov 23 20:59:48.024: INFO: Container container1 ready: true, restart count 2
Nov 23 20:59:48.024: INFO: external-provisioner-z9vxz started at 2022-11-23 20:58:56 +0000 UTC (0+1 container statuses recorded)
Nov 23 20:59:48.024: INFO: Container nfs-provisioner ready: true, restart count 2
Nov 23 20:59:48.024: INFO: konnectivity-agent-qhrlc started at 2022-11-23 20:56:40 +0000 UTC (0+1 container statuses recorded)
Nov 23 20:59:48.024: INFO: Container konnectivity-agent ready: false, restart count 2
Nov 23 20:59:48.024: INFO: verify-service-up-exec-pod-f6cqj started at <nil> (0+0 container statuses recorded)
Nov 23 20:59:48.024: INFO: pod-subpath-test-projected-wd9g started at 2022-11-23 20:59:32 +0000 UTC (0+1 container statuses recorded)
Nov 23 20:59:48.024: INFO: Container test-container-subpath-projected-wd9g ready: true, restart count 0
Nov 23 20:59:48.024: INFO: hostexec-bootstrap-e2e-minion-group-3dd6-dzkmx started at 2022-11-23 20:59:35 +0000 UTC (0+1 container statuses recorded)
Nov 23 20:59:48.024: INFO: Container agnhost-container ready: true, restart count 1
Nov 23 20:59:48.024: INFO: kube-proxy-bootstrap-e2e-minion-group-3dd6 started at 2022-11-23 20:56:27 +0000 UTC (0+1 container statuses recorded)
Nov 23 20:59:48.024: INFO: Container kube-proxy ready: true, restart count 4
Nov 23 20:59:48.024: INFO: csi-mockplugin-0 started at 2022-11-23 20:58:11 +0000 UTC (0+3 container statuses recorded)
Nov 23 20:59:48.024: INFO: Container csi-provisioner ready: false, restart count 1
Nov 23 20:59:48.024: INFO: Container driver-registrar ready: false, restart count 1
Nov 23 20:59:48.024: INFO: Container mock ready: false, restart count 1
Nov 23 20:59:48.024: INFO: netserver-0 started at 2022-11-23 20:59:23 +0000 UTC (0+1 container statuses recorded)
Nov 23 20:59:48.024: INFO: Container webserver ready: false, restart count 1
Nov 23 20:59:48.024: INFO: pod-subpath-test-inlinevolume-zcfz started at 2022-11-23 20:59:39 +0000 UTC (1+1 container statuses recorded)
Nov 23 20:59:48.024: INFO: Init container init-volume-inlinevolume-zcfz ready: true, restart count 0
Nov 23 20:59:48.024: INFO: Container test-container-subpath-inlinevolume-zcfz ready: true, restart count 0
Nov 23 20:59:48.024: INFO: apparmor-loader-mqcbd started at 2022-11-23 20:59:11 +0000 UTC (0+1 container statuses recorded)
Nov 23 20:59:48.024: INFO: Container apparmor-loader ready: true, restart count 1
Nov 23 20:59:48.024: INFO: inline-volume-tester-2nzpr started at 2022-11-23 20:59:33 +0000 UTC (0+1 container statuses recorded)
Nov 23 20:59:48.024: INFO: Container csi-volume-tester ready: true, restart count 0
Nov 23 20:59:48.024: INFO: netserver-0 started at 2022-11-23 20:57:44 +0000 UTC (0+1 container statuses recorded)
Nov 23 20:59:48.024: INFO: Container webserver ready: false, restart count 4
Nov 23 20:59:48.024: INFO: csi-mockplugin-attacher-0 started at 2022-11-23 20:57:47 +0000 UTC (0+1 container statuses recorded)
Nov 23 20:59:48.024: INFO: Container csi-attacher ready: true, restart count 1
Nov 23 20:59:48.024: INFO: local-injector started at <nil> (0+0 container statuses recorded)
Nov 23 20:59:48.024: INFO: netserver-0 started at 2022-11-23 20:57:45 +0000 UTC (0+1 container statuses recorded)
Nov 23 20:59:48.024: INFO: Container webserver ready: false, restart count 4
Nov 23 20:59:48.024: INFO: csi-mockplugin-0 started at 2022-11-23 20:57:47 +0000 UTC (0+3 container statuses recorded)
Nov 23 20:59:48.024: INFO: Container csi-provisioner ready: false, restart count 4
Nov 23 20:59:48.024: INFO: Container driver-registrar ready: false, restart count 4
Nov 23 20:59:48.024: INFO: Container mock ready: false, restart count 4
Nov 23 20:59:48.024: INFO: netserver-0 started at 2022-11-23 20:57:44 +0000 UTC (0+1 container statuses recorded)
Nov 23 20:59:48.024: INFO: Container webserver ready: false, restart count 4
Nov 23 20:59:48.024: INFO: pod1 started at 2022-11-23 20:59:04 +0000 UTC (0+1 container statuses recorded)
Nov 23 20:59:48.024: INFO: Container container1 ready: true, restart count 2
Nov 23 20:59:48.155: INFO:
Logging node info for node bootstrap-e2e-minion-group-3h36
Nov 23 20:59:48.194: INFO: Error getting node info Get "https://35.247.28.208/api/v1/nodes/bootstrap-e2e-minion-group-3h36": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 20:59:48.194: INFO: Node Info: &Node{ObjectMeta:{ 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{},Allocatable:ResourceList{},Phase:,Conditions:[]NodeCondition{},Addresses:[]NodeAddress{},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:0,},},NodeInfo:NodeSystemInfo{MachineID:,SystemUUID:,BootID:,KernelVersion:,OSImage:,ContainerRuntimeVersion:,KubeletVersion:,KubeProxyVersion:,OperatingSystem:,Architecture:,},Images:[]ContainerImage{},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 23 20:59:48.194: INFO:
Logging kubelet events for node bootstrap-e2e-minion-group-3h36
Nov 23 20:59:48.235: INFO: Unexpected error retrieving node events Get "https://35.247.28.208/api/v1/namespaces/kube-system/events?fieldSelector=involvedObject.kind%3DNode%2CinvolvedObject.namespace%3D%2Csource%3Dkubelet%2CinvolvedObject.name%3Dbootstrap-e2e-minion-group-3h36": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 20:59:48.235: INFO:
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-3h36
Nov 23 20:59:48.275: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-3h36: Get "https://35.247.28.208/api/v1/nodes/bootstrap-e2e-minion-group-3h36:10250/proxy/pods": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 20:59:48.275: INFO:
Logging node info for node bootstrap-e2e-minion-group-qss2
Nov 23 20:59:48.317: INFO: Error getting node info Get "https://35.247.28.208/api/v1/nodes/bootstrap-e2e-minion-group-qss2": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 20:59:48.317: INFO: Node Info: &Node{ObjectMeta:{ 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{},Allocatable:ResourceList{},Phase:,Conditions:[]NodeCondition{},Addresses:[]NodeAddress{},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:0,},},NodeInfo:NodeSystemInfo{MachineID:,SystemUUID:,BootID:,KernelVersion:,OSImage:,ContainerRuntimeVersion:,KubeletVersion:,KubeProxyVersion:,OperatingSystem:,Architecture:,},Images:[]ContainerImage{},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 23 20:59:48.317: INFO:
Logging kubelet events for node bootstrap-e2e-minion-group-qss2
Nov 23 20:59:48.358: INFO: Unexpected error retrieving node events Get "https://35.247.28.208/api/v1/namespaces/kube-system/events?fieldSelector=involvedObject.namespace%3D%2Csource%3Dkubelet%2CinvolvedObject.name%3Dbootstrap-e2e-minion-group-qss2%2CinvolvedObject.kind%3DNode": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 20:59:48.358: INFO:
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-qss2
Nov 23 20:59:48.400: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-qss2: Get "https://35.247.28.208/api/v1/nodes/bootstrap-e2e-minion-group-qss2:10250/proxy/pods": dial tcp 35.247.28.208:443: connect: connection refused
[DeferCleanup (Each)] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin]
tear down framework | framework.go:193
STEP: Destroying namespace "crd-webhook-5956" for this suite. 11/23/22 20:59:48.4
Nov 23 20:59:48.441: FAIL: Couldn't delete ns: "crd-webhook-5956": Delete "https://35.247.28.208/api/v1/namespaces/crd-webhook-5956": dial tcp 35.247.28.208:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://35.247.28.208/api/v1/namespaces/crd-webhook-5956", Err:(*net.OpError)(0xc002430820)})
Full Stack Trace
k8s.io/kubernetes/test/e2e/framework.(*Framework).AfterEach.func1()
test/e2e/framework/framework.go:370 +0x4fe
k8s.io/kubernetes/test/e2e/framework.(*Framework).AfterEach(0xc000de2870)
test/e2e/framework/framework.go:383 +0x1ca
reflect.Value.call({0x6627cc0?, 0xc001031dd0?, 0xc000297fb0?}, {0x75b6e72, 0x4}, {0xae73300, 0x0, 0x0?})
/usr/local/go/src/reflect/value.go:584 +0x8c5
reflect.Value.Call({0x6627cc0?, 0xc001031dd0?, 0x0?}, {0xae73300?, 0x5?, 0xc0021ed4b8?})
/usr/local/go/src/reflect/value.go:368 +0xbc
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sCustomResourcePublishOpenAPI\s\[Privileged\:ClusterAdmin\]\sworks\sfor\smultiple\sCRDs\sof\sdifferent\sgroups\s\[Conformance\]$'
test/e2e/apimachinery/crd_publish_openapi.go:299
k8s.io/kubernetes/test/e2e/apimachinery.glob..func6.5()
test/e2e/apimachinery/crd_publish_openapi.go:299 +0x3ee
There were additional failures detected after the initial failure:
[FAILED]
Nov 23 21:35:02.191: failed to list events in namespace "crd-publish-openapi-319": Get "https://35.247.28.208/api/v1/namespaces/crd-publish-openapi-319/events": dial tcp 35.247.28.208:443: connect: connection refused
In [DeferCleanup (Each)] at: test/e2e/framework/debug/dump.go:44
----------
[FAILED]
Nov 23 21:35:02.232: Couldn't delete ns: "crd-publish-openapi-319": Delete "https://35.247.28.208/api/v1/namespaces/crd-publish-openapi-319": dial tcp 35.247.28.208:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://35.247.28.208/api/v1/namespaces/crd-publish-openapi-319", Err:(*net.OpError)(0xc002525450)})
In [DeferCleanup (Each)] at: test/e2e/framework/framework.go:370
[BeforeEach] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin]
set up framework | framework.go:178
STEP: Creating a kubernetes client 11/23/22 21:34:28.583
Nov 23 21:34:28.583: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Building a namespace api object, basename crd-publish-openapi 11/23/22 21:34:28.588
STEP: Waiting for a default service account to be provisioned in namespace 11/23/22 21:34:28.796
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 11/23/22 21:34:28.918
[BeforeEach] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin]
test/e2e/framework/metrics/init/init.go:31
[It] works for multiple CRDs of different groups [Conformance]
test/e2e/apimachinery/crd_publish_openapi.go:276
STEP: CRs in different groups (two CRDs) show up in OpenAPI documentation 11/23/22 21:34:29.024
Nov 23 21:34:29.027: INFO: >>> kubeConfig: /workspace/.kube/config
Nov 23 21:34:39.806: INFO: >>> kubeConfig: /workspace/.kube/config
Nov 23 21:35:02.110: FAIL: failed to wait for definition "com.example.crd-publish-openapi-test-waldo.v1beta1.e2e-test-crd-publish-openapi-6754-crd" not to be served anymore: failed to wait for OpenAPI spec validating condition: Get "https://35.247.28.208/openapi/v2": dial tcp 35.247.28.208:443: connect: connection refused; lastMsg:
Full Stack Trace
k8s.io/kubernetes/test/e2e/apimachinery.glob..func6.5()
test/e2e/apimachinery/crd_publish_openapi.go:299 +0x3ee
[AfterEach] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin]
test/e2e/framework/node/init/init.go:32
Nov 23 21:35:02.111: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin]
test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin]
dump namespaces | framework.go:196
STEP: dump namespace information after failure 11/23/22 21:35:02.151
STEP: Collecting events from namespace "crd-publish-openapi-319". 11/23/22 21:35:02.151
Nov 23 21:35:02.191: INFO: Unexpected error: failed to list events in namespace "crd-publish-openapi-319":
<*url.Error | 0xc00560f9b0>: {
Op: "Get",
URL: "https://35.247.28.208/api/v1/namespaces/crd-publish-openapi-319/events",
Err: <*net.OpError | 0xc002f3d090>{
Op: "dial",
Net: "tcp",
Source: nil,
Addr: <*net.TCPAddr | 0xc0047b9530>{
IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 35, 247, 28, 208],
Port: 443,
Zone: "",
},
Err: <*os.SyscallError | 0xc0050dd160>{
Syscall: "connect",
Err: <syscall.Errno>0x6f,
},
},
}
Nov 23 21:35:02.191: FAIL: failed to list events in namespace "crd-publish-openapi-319": Get "https://35.247.28.208/api/v1/namespaces/crd-publish-openapi-319/events": dial tcp 35.247.28.208:443: connect: connection refused
Full Stack Trace
k8s.io/kubernetes/test/e2e/framework/debug.dumpEventsInNamespace(0xc002d065c0, {0xc00333d470, 0x17})
test/e2e/framework/debug/dump.go:44 +0x191
k8s.io/kubernetes/test/e2e/framework/debug.DumpAllNamespaceInfo({0x801de88, 0xc0013b2340}, {0xc00333d470, 0x17})
test/e2e/framework/debug/dump.go:62 +0x8d
k8s.io/kubernetes/test/e2e/framework/debug/init.init.0.func1.1(0xc002d06650?, {0xc00333d470?, 0x7fa7740?})
test/e2e/framework/debug/init/init.go:34 +0x32
k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo.func1()
test/e2e/framework/framework.go:274 +0x6d
k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo(0xc0009cdd10)
test/e2e/framework/framework.go:271 +0x179
reflect.Value.call({0x6627cc0?, 0xc0035cd1d0?, 0xc002e0ffb0?}, {0x75b6e72, 0x4}, {0xae73300, 0x0, 0xc0013b2be8?})
/usr/local/go/src/reflect/value.go:584 +0x8c5
reflect.Value.Call({0x6627cc0?, 0xc0035cd1d0?, 0x29449fc?}, {0xae73300?, 0xc002e0ff80?, 0xc0041fe468?})
/usr/local/go/src/reflect/value.go:368 +0xbc
[DeferCleanup (Each)] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin]
tear down framework | framework.go:193
STEP: Destroying namespace "crd-publish-openapi-319" for this suite. 11/23/22 21:35:02.192
Nov 23 21:35:02.232: FAIL: Couldn't delete ns: "crd-publish-openapi-319": Delete "https://35.247.28.208/api/v1/namespaces/crd-publish-openapi-319": dial tcp 35.247.28.208:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://35.247.28.208/api/v1/namespaces/crd-publish-openapi-319", Err:(*net.OpError)(0xc002525450)})
Full Stack Trace
k8s.io/kubernetes/test/e2e/framework.(*Framework).AfterEach.func1()
test/e2e/framework/framework.go:370 +0x4fe
k8s.io/kubernetes/test/e2e/framework.(*Framework).AfterEach(0xc0009cdd10)
test/e2e/framework/framework.go:383 +0x1ca
reflect.Value.call({0x6627cc0?, 0xc0035cd150?, 0x0?}, {0x75b6e72, 0x4}, {0xae73300, 0x0, 0xc0014fd3c0?})
/usr/local/go/src/reflect/value.go:584 +0x8c5
reflect.Value.Call({0x6627cc0?, 0xc0035cd150?, 0x29449fc?}, {0xae73300?, 0xc00464ff80?, 0x2d5dcbd?})
/usr/local/go/src/reflect/value.go:368 +0xbc
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sCustomResourceValidationRules\s\[Privileged\:ClusterAdmin\]\sMUST\sfail\supdate\sof\sa\scustom\sresource\sthat\sdoes\snot\ssatisfy\sa\sx\-kubernetes\-validations\stransition\srule$'
test/e2e/framework/framework.go:241 k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc000de2a50) test/e2e/framework/framework.go:241 +0x96ffrom junit_01.xml
[BeforeEach] [sig-api-machinery] CustomResourceValidationRules [Privileged:ClusterAdmin] set up framework | framework.go:178 STEP: Creating a kubernetes client 11/23/22 20:59:48.891 Nov 23 20:59:48.891: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Building a namespace api object, basename crd-validation-expressions 11/23/22 20:59:48.893 Nov 23 20:59:48.937: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 20:59:50.978: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 20:59:52.978: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 20:59:54.977: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 20:59:56.978: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 20:59:58.977: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:00:00.978: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:00:02.977: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:00:04.978: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:00:06.977: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:00:08.978: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:00:10.978: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:00:12.977: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:00:14.977: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:00:16.976: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:00:18.978: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:00:19.017: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:00:19.017: INFO: Unexpected error: <*errors.errorString | 0xc000117c60>: { s: "timed out waiting for the condition", } Nov 23 21:00:19.018: FAIL: timed out waiting for the condition Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc000de2a50) test/e2e/framework/framework.go:241 +0x96f [AfterEach] [sig-api-machinery] CustomResourceValidationRules [Privileged:ClusterAdmin] test/e2e/framework/node/init/init.go:32 Nov 23 21:00:19.019: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-api-machinery] CustomResourceValidationRules [Privileged:ClusterAdmin] dump namespaces | framework.go:196 STEP: dump namespace information after failure 11/23/22 21:00:19.059 [DeferCleanup (Each)] [sig-api-machinery] CustomResourceValidationRules [Privileged:ClusterAdmin] tear down framework | framework.go:193
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sGarbage\scollector\sshould\sorphan\sRS\screated\sby\sdeployment\swhen\sdeleteOptions\.PropagationPolicy\sis\sOrphan\s\[Conformance\]$'
test/e2e/framework/framework.go:241 k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc001294870) test/e2e/framework/framework.go:241 +0x96ffrom junit_01.xml
[BeforeEach] [sig-api-machinery] Garbage collector set up framework | framework.go:178 STEP: Creating a kubernetes client 11/23/22 21:31:49.106 Nov 23 21:31:49.106: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Building a namespace api object, basename gc 11/23/22 21:31:49.111 ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:31:49.151: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:31:51.191: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:31:53.191: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:31:55.191: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:31:57.192: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:31:59.192: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:32:01.192: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:32:03.192: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:32:05.192: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:32:07.191: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:32:09.190: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:32:11.191: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:32:13.191: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:32:15.194: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:32:17.192: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:32:19.191: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:32:19.231: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:32:19.231: INFO: Unexpected error: <*errors.errorString | 0xc00011dd80>: { s: "timed out waiting for the condition", } Nov 23 21:32:19.232: FAIL: timed out waiting for the condition Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc001294870) test/e2e/framework/framework.go:241 +0x96f [AfterEach] [sig-api-machinery] Garbage collector test/e2e/framework/node/init/init.go:32 Nov 23 21:32:19.232: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-api-machinery] Garbage collector dump namespaces | framework.go:196 ERROR: get pod list in ephemeral-6615-3145: Get "https://35.247.28.208/api/v1/namespaces/ephemeral-6615-3145/pods": dial tcp 35.247.28.208:443: connect: connection refused STEP: dump namespace information after failure 11/23/22 21:32:19.278 [DeferCleanup (Each)] [sig-api-machinery] Garbage collector tear down framework | framework.go:193
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sGarbage\scollector\sshould\sorphan\spods\screated\sby\src\sif\sdelete\soptions\ssay\sso\s\[Conformance\]$'
test/e2e/apimachinery/garbage_collector.go:426
k8s.io/kubernetes/test/e2e/apimachinery.glob..func13.2()
test/e2e/apimachinery/garbage_collector.go:426 +0x613
There were additional failures detected after the initial failure:
[FAILED]
Nov 23 21:35:21.938: failed to list events in namespace "gc-9220": Get "https://35.247.28.208/api/v1/namespaces/gc-9220/events": dial tcp 35.247.28.208:443: connect: connection refused
In [DeferCleanup (Each)] at: test/e2e/framework/debug/dump.go:44
----------
[FAILED]
Nov 23 21:35:21.979: Couldn't delete ns: "gc-9220": Delete "https://35.247.28.208/api/v1/namespaces/gc-9220": dial tcp 35.247.28.208:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://35.247.28.208/api/v1/namespaces/gc-9220", Err:(*net.OpError)(0xc00182b810)})
In [DeferCleanup (Each)] at: test/e2e/framework/framework.go:370
[BeforeEach] [sig-api-machinery] Garbage collector
set up framework | framework.go:178
STEP: Creating a kubernetes client 11/23/22 21:34:40.265
Nov 23 21:34:40.265: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Building a namespace api object, basename gc 11/23/22 21:34:40.269
STEP: Waiting for a default service account to be provisioned in namespace 11/23/22 21:34:40.885
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 11/23/22 21:34:41.042
[BeforeEach] [sig-api-machinery] Garbage collector
test/e2e/framework/metrics/init/init.go:31
[It] should orphan pods created by rc if delete options say so [Conformance]
test/e2e/apimachinery/garbage_collector.go:370
STEP: create the rc 11/23/22 21:34:41.261
STEP: delete the rc 11/23/22 21:34:46.609
STEP: wait for the rc to be deleted 11/23/22 21:34:46.753
STEP: wait for 30 seconds to see if the garbage collector mistakenly deletes the pods 11/23/22 21:34:51.816
Nov 23 21:35:21.858: FAIL: Failed to list pods: Get "https://35.247.28.208/api/v1/namespaces/gc-9220/pods": dial tcp 35.247.28.208:443: connect: connection refused
Full Stack Trace
k8s.io/kubernetes/test/e2e/apimachinery.glob..func13.2()
test/e2e/apimachinery/garbage_collector.go:426 +0x613
[AfterEach] [sig-api-machinery] Garbage collector
test/e2e/framework/node/init/init.go:32
Nov 23 21:35:21.858: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-api-machinery] Garbage collector
test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-api-machinery] Garbage collector
dump namespaces | framework.go:196
STEP: dump namespace information after failure 11/23/22 21:35:21.897
STEP: Collecting events from namespace "gc-9220". 11/23/22 21:35:21.897
Nov 23 21:35:21.937: INFO: Unexpected error: failed to list events in namespace "gc-9220":
<*url.Error | 0xc0035453b0>: {
Op: "Get",
URL: "https://35.247.28.208/api/v1/namespaces/gc-9220/events",
Err: <*net.OpError | 0xc002657860>{
Op: "dial",
Net: "tcp",
Source: nil,
Addr: <*net.TCPAddr | 0xc0034b2480>{
IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 35, 247, 28, 208],
Port: 443,
Zone: "",
},
Err: <*os.SyscallError | 0xc000a2d6c0>{
Syscall: "connect",
Err: <syscall.Errno>0x6f,
},
},
}
Nov 23 21:35:21.938: FAIL: failed to list events in namespace "gc-9220": Get "https://35.247.28.208/api/v1/namespaces/gc-9220/events": dial tcp 35.247.28.208:443: connect: connection refused
Full Stack Trace
k8s.io/kubernetes/test/e2e/framework/debug.dumpEventsInNamespace(0xc0014d05c0, {0xc0002aab10, 0x7})
test/e2e/framework/debug/dump.go:44 +0x191
k8s.io/kubernetes/test/e2e/framework/debug.DumpAllNamespaceInfo({0x801de88, 0xc0009bf860}, {0xc0002aab10, 0x7})
test/e2e/framework/debug/dump.go:62 +0x8d
k8s.io/kubernetes/test/e2e/framework/debug/init.init.0.func1.1(0xc0014d0650?, {0xc0002aab10?, 0x7fa7740?})
test/e2e/framework/debug/init/init.go:34 +0x32
k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo.func1()
test/e2e/framework/framework.go:274 +0x6d
k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo(0xc00096eff0)
test/e2e/framework/framework.go:271 +0x179
reflect.Value.call({0x6627cc0?, 0xc0012fc6d0?, 0xc00420afb0?}, {0x75b6e72, 0x4}, {0xae73300, 0x0, 0xc0003d4d88?})
/usr/local/go/src/reflect/value.go:584 +0x8c5
reflect.Value.Call({0x6627cc0?, 0xc0012fc6d0?, 0x29449fc?}, {0xae73300?, 0xc00420af80?, 0x2d5dcbd?})
/usr/local/go/src/reflect/value.go:368 +0xbc
[DeferCleanup (Each)] [sig-api-machinery] Garbage collector
tear down framework | framework.go:193
STEP: Destroying namespace "gc-9220" for this suite. 11/23/22 21:35:21.938
Nov 23 21:35:21.979: FAIL: Couldn't delete ns: "gc-9220": Delete "https://35.247.28.208/api/v1/namespaces/gc-9220": dial tcp 35.247.28.208:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://35.247.28.208/api/v1/namespaces/gc-9220", Err:(*net.OpError)(0xc00182b810)})
Full Stack Trace
k8s.io/kubernetes/test/e2e/framework.(*Framework).AfterEach.func1()
test/e2e/framework/framework.go:370 +0x4fe
k8s.io/kubernetes/test/e2e/framework.(*Framework).AfterEach(0xc00096eff0)
test/e2e/framework/framework.go:383 +0x1ca
reflect.Value.call({0x6627cc0?, 0xc0012fc5d0?, 0x66f1c00?}, {0x75b6e72, 0x4}, {0xae73300, 0x0, 0xc00017f6e0?})
/usr/local/go/src/reflect/value.go:584 +0x8c5
reflect.Value.Call({0x6627cc0?, 0xc0012fc5d0?, 0xc00390e180?}, {0xae73300?, 0x42806bf?, 0xc00026ee10?})
/usr/local/go/src/reflect/value.go:368 +0xbc
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sResourceQuota\sshould\sapply\schanges\sto\sa\sresourcequota\sstatus\s\[Conformance\]$'
test/e2e/apimachinery/resource_quota.go:1186
k8s.io/kubernetes/test/e2e/apimachinery.glob..func20.15.6()
test/e2e/apimachinery/resource_quota.go:1186 +0x85
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.ConditionFunc.WithContext.func1({0x2742871, 0x0})
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:222 +0x1b
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext({0x7fe0bc8?, 0xc0001b0000?}, 0x262a61f?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:235 +0x57
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.WaitForWithContext({0x7fe0bc8, 0xc0001b0000}, 0xc00436fea8, 0x2fdb16a?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:662 +0x10c
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.poll({0x7fe0bc8, 0xc0001b0000}, 0x18?, 0x2fd9d05?, 0x30?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:596 +0x9a
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediateWithContext({0x7fe0bc8, 0xc0001b0000}, 0xc0011014a0?, 0xc003006d68?, 0x262a967?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:528 +0x4a
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediate(0xc00436f488?, 0x0?, 0x0?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:514 +0x50
k8s.io/kubernetes/test/e2e/apimachinery.glob..func20.15()
test/e2e/apimachinery/resource_quota.go:1184 +0x4425
There were additional failures detected after the initial failure:
[FAILED]
Nov 23 21:16:51.645: failed to list events in namespace "resourcequota-2152": Get "https://35.247.28.208/api/v1/namespaces/resourcequota-2152/events": dial tcp 35.247.28.208:443: connect: connection refused
In [DeferCleanup (Each)] at: test/e2e/framework/debug/dump.go:44
----------
[FAILED]
Nov 23 21:16:51.686: Couldn't delete ns: "resourcequota-2152": Delete "https://35.247.28.208/api/v1/namespaces/resourcequota-2152": dial tcp 35.247.28.208:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://35.247.28.208/api/v1/namespaces/resourcequota-2152", Err:(*net.OpError)(0xc00365d5e0)})
In [DeferCleanup (Each)] at: test/e2e/framework/framework.go:370
[BeforeEach] [sig-api-machinery] ResourceQuota
set up framework | framework.go:178
STEP: Creating a kubernetes client 11/23/22 21:12:10.148
Nov 23 21:12:10.148: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Building a namespace api object, basename resourcequota 11/23/22 21:12:10.151
STEP: Waiting for a default service account to be provisioned in namespace 11/23/22 21:12:10.364
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 11/23/22 21:12:10.475
[BeforeEach] [sig-api-machinery] ResourceQuota
test/e2e/framework/metrics/init/init.go:31
[It] should apply changes to a resourcequota status [Conformance]
test/e2e/apimachinery/resource_quota.go:1010
STEP: Creating resourceQuota "e2e-rq-status-phgxm" 11/23/22 21:12:10.656
Nov 23 21:12:10.807: INFO: Resource quota "e2e-rq-status-phgxm" reports spec: hard cpu limit of 500m
Nov 23 21:12:10.807: INFO: Resource quota "e2e-rq-status-phgxm" reports spec: hard memory limit of 500Mi
STEP: Updating resourceQuota "e2e-rq-status-phgxm" /status 11/23/22 21:12:10.807
STEP: Confirm /status for "e2e-rq-status-phgxm" resourceQuota via watch 11/23/22 21:12:10.933
Nov 23 21:12:10.980: INFO: observed resourceQuota "e2e-rq-status-phgxm" in namespace "resourcequota-2152" with hard status: v1.ResourceList(nil)
Nov 23 21:12:10.981: INFO: Found resourceQuota "e2e-rq-status-phgxm" in namespace "resourcequota-2152" with hard status: v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:500, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"500m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:524288000, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"500Mi", Format:"BinarySI"}}
Nov 23 21:12:10.981: INFO: ResourceQuota "e2e-rq-status-phgxm" /status was updated
STEP: Patching hard spec values for cpu & memory 11/23/22 21:12:11.065
Nov 23 21:12:11.134: INFO: Resource quota "e2e-rq-status-phgxm" reports spec: hard cpu limit of 1
Nov 23 21:12:11.134: INFO: Resource quota "e2e-rq-status-phgxm" reports spec: hard memory limit of 1Gi
STEP: Patching "e2e-rq-status-phgxm" /status 11/23/22 21:12:11.134
STEP: Confirm /status for "e2e-rq-status-phgxm" resourceQuota via watch 11/23/22 21:12:11.186
Nov 23 21:12:11.236: INFO: observed resourceQuota "e2e-rq-status-phgxm" in namespace "resourcequota-2152" with hard status: v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:500, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"500m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:524288000, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"500Mi", Format:"BinarySI"}}
Nov 23 21:12:11.236: INFO: Found resourceQuota "e2e-rq-status-phgxm" in namespace "resourcequota-2152" with hard status: v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:1, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"1", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:1073741824, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"1Gi", Format:"BinarySI"}}
Nov 23 21:12:11.236: INFO: ResourceQuota "e2e-rq-status-phgxm" /status was patched
STEP: Get "e2e-rq-status-phgxm" /status 11/23/22 21:12:11.236
Nov 23 21:12:11.296: INFO: Resourcequota "e2e-rq-status-phgxm" reports status: hard cpu of 1
Nov 23 21:12:11.296: INFO: Resourcequota "e2e-rq-status-phgxm" reports status: hard memory of 1Gi
STEP: Repatching "e2e-rq-status-phgxm" /status before checking Spec is unchanged 11/23/22 21:12:11.36
Nov 23 21:12:11.412: INFO: Resourcequota "e2e-rq-status-phgxm" reports status: hard cpu of 2
Nov 23 21:12:11.412: INFO: Resourcequota "e2e-rq-status-phgxm" reports status: hard memory of 2Gi
Nov 23 21:12:11.469: INFO: Found resourceQuota "e2e-rq-status-phgxm" in namespace "resourcequota-2152" with hard status: v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:2, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"2", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:2147483648, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"2Gi", Format:"BinarySI"}}
Nov 23 21:16:51.563: INFO: Unexpected error:
<*url.Error | 0xc004672390>: {
Op: "Get",
URL: "https://35.247.28.208/api/v1/namespaces/resourcequota-2152/resourcequotas/e2e-rq-status-phgxm",
Err: <*net.OpError | 0xc00257e500>{
Op: "dial",
Net: "tcp",
Source: nil,
Addr: <*net.TCPAddr | 0xc004672360>{
IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 35, 247, 28, 208],
Port: 443,
Zone: "",
},
Err: <*os.SyscallError | 0xc000e9c080>{
Syscall: "connect",
Err: <syscall.Errno>0x6f,
},
},
}
Nov 23 21:16:51.564: FAIL: Get "https://35.247.28.208/api/v1/namespaces/resourcequota-2152/resourcequotas/e2e-rq-status-phgxm": dial tcp 35.247.28.208:443: connect: connection refused
Full Stack Trace
k8s.io/kubernetes/test/e2e/apimachinery.glob..func20.15.6()
test/e2e/apimachinery/resource_quota.go:1186 +0x85
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.ConditionFunc.WithContext.func1({0x2742871, 0x0})
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:222 +0x1b
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext({0x7fe0bc8?, 0xc0001b0000?}, 0x262a61f?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:235 +0x57
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.WaitForWithContext({0x7fe0bc8, 0xc0001b0000}, 0xc00436fea8, 0x2fdb16a?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:662 +0x10c
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.poll({0x7fe0bc8, 0xc0001b0000}, 0x18?, 0x2fd9d05?, 0x30?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:596 +0x9a
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediateWithContext({0x7fe0bc8, 0xc0001b0000}, 0xc0011014a0?, 0xc003006d68?, 0x262a967?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:528 +0x4a
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediate(0xc00436f488?, 0x0?, 0x0?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:514 +0x50
k8s.io/kubernetes/test/e2e/apimachinery.glob..func20.15()
test/e2e/apimachinery/resource_quota.go:1184 +0x4425
E1123 21:16:51.564536 10078 runtime.go:79] Observed a panic: types.GinkgoError{Heading:"Your Test Panicked", Message:"When you, or your assertion library, calls Ginkgo's Fail(),\nGinkgo panics to prevent subsequent assertions from running.\n\nNormally Ginkgo rescues this panic so you shouldn't see it.\n\nHowever, if you make an assertion in a goroutine, Ginkgo can't capture the panic.\nTo circumvent this, you should call\n\n\tdefer GinkgoRecover()\n\nat the top of the goroutine that caused this panic.\n\nAlternatively, you may have made an assertion outside of a Ginkgo\nleaf node (e.g. in a container node or some out-of-band function) - please move your assertion to\nan appropriate Ginkgo node (e.g. a BeforeSuite, BeforeEach, It, etc...).", DocLink:"mental-model-how-ginkgo-handles-failure", CodeLocation:types.CodeLocation{FileName:"test/e2e/apimachinery/resource_quota.go", LineNumber:1186, FullStackTrace:"k8s.io/kubernetes/test/e2e/apimachinery.glob..func20.15.6()\n\ttest/e2e/apimachinery/resource_quota.go:1186 +0x85\nk8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.ConditionFunc.WithContext.func1({0x2742871, 0x0})\n\tvendor/k8s.io/apimachinery/pkg/util/wait/wait.go:222 +0x1b\nk8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext({0x7fe0bc8?, 0xc0001b0000?}, 0x262a61f?)\n\tvendor/k8s.io/apimachinery/pkg/util/wait/wait.go:235 +0x57\nk8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.WaitForWithContext({0x7fe0bc8, 0xc0001b0000}, 0xc00436fea8, 0x2fdb16a?)\n\tvendor/k8s.io/apimachinery/pkg/util/wait/wait.go:662 +0x10c\nk8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.poll({0x7fe0bc8, 0xc0001b0000}, 0x18?, 0x2fd9d05?, 0x30?)\n\tvendor/k8s.io/apimachinery/pkg/util/wait/wait.go:596 +0x9a\nk8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediateWithContext({0x7fe0bc8, 0xc0001b0000}, 0xc0011014a0?, 0xc003006d68?, 0x262a967?)\n\tvendor/k8s.io/apimachinery/pkg/util/wait/wait.go:528 +0x4a\nk8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediate(0xc00436f488?, 0x0?, 0x0?)\n\tvendor/k8s.io/apimachinery/pkg/util/wait/wait.go:514 +0x50\nk8s.io/kubernetes/test/e2e/apimachinery.glob..func20.15()\n\ttest/e2e/apimachinery/resource_quota.go:1184 +0x4425", CustomMessage:""}} (�[1m�[38;5;9mYour Test Panicked�[0m
�[38;5;243mtest/e2e/apimachinery/resource_quota.go:1186�[0m
When you, or your assertion library, calls Ginkgo's Fail(),
Ginkgo panics to prevent subsequent assertions from running.
Normally Ginkgo rescues this panic so you shouldn't see it.
However, if you make an assertion in a goroutine, Ginkgo can't capture the
panic.
To circumvent this, you should call
defer GinkgoRecover()
at the top of the goroutine that caused this panic.
Alternatively, you may have made an assertion outside of a Ginkgo
leaf node (e.g. in a container node or some out-of-band function) - please
move your assertion to
an appropriate Ginkgo node (e.g. a BeforeSuite, BeforeEach, It, etc...).
�[1mLearn more at:�[0m
�[38;5;14m�[4mhttp://onsi.github.io/ginkgo/#mental-model-how-ginkgo-handles-failure�[0m
)
goroutine 2388 [running]:
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/runtime.logPanic({0x70eb7e0?, 0xc000cc0a80})
vendor/k8s.io/apimachinery/pkg/util/runtime/runtime.go:75 +0x99
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/runtime.HandleCrash({0x0, 0x0, 0xc000cc0a80?})
vendor/k8s.io/apimachinery/pkg/util/runtime/runtime.go:49 +0x75
panic({0x70eb7e0, 0xc000cc0a80})
/usr/local/go/src/runtime/panic.go:884 +0x212
k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2.Fail({0xc000578300, 0xb1}, {0xc001b56750?, 0x75b521a?, 0xc001b56770?})
vendor/github.com/onsi/ginkgo/v2/core_dsl.go:352 +0x225
k8s.io/kubernetes/test/e2e/framework.Fail({0xc000b4a0a0, 0x9c}, {0xc001b567e8?, 0xc000b4a0a0?, 0xc001b56810?})
test/e2e/framework/log.go:61 +0x145
k8s.io/kubernetes/test/e2e/framework.ExpectNoErrorWithOffset(0x1, {0x7fadf60, 0xc004672390}, {0x0?, 0x0?, 0x0?})
test/e2e/framework/expect.go:76 +0x267
k8s.io/kubernetes/test/e2e/framework.ExpectNoError(...)
test/e2e/framework/expect.go:43
k8s.io/kubernetes/test/e2e/apimachinery.glob..func20.15.6()
test/e2e/apimachinery/resource_quota.go:1186 +0x85
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.ConditionFunc.WithContext.func1({0x2742871, 0x0})
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:222 +0x1b
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext({0x7fe0bc8?, 0xc0001b0000?}, 0x262a61f?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:235 +0x57
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.WaitForWithContext({0x7fe0bc8, 0xc0001b0000}, 0xc00436fea8, 0x2fdb16a?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:662 +0x10c
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.poll({0x7fe0bc8, 0xc0001b0000}, 0x18?, 0x2fd9d05?, 0x30?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:596 +0x9a
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediateWithContext({0x7fe0bc8, 0xc0001b0000}, 0xc0011014a0?, 0xc003006d68?, 0x262a967?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:528 +0x4a
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediate(0xc00436f488?, 0x0?, 0x0?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:514 +0x50
k8s.io/kubernetes/test/e2e/apimachinery.glob..func20.15()
test/e2e/apimachinery/resource_quota.go:1184 +0x4425
k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func3({0xc00185d830, 0xc00235c8a0})
vendor/github.com/onsi/ginkgo/v2/internal/node.go:449 +0x1b
k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func2()
vendor/github.com/onsi/ginkgo/v2/internal/suite.go:750 +0x98
created by k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode
vendor/github.com/onsi/ginkgo/v2/internal/suite.go:738 +0xe3d
[AfterEach] [sig-api-machinery] ResourceQuota
test/e2e/framework/node/init/init.go:32
Nov 23 21:16:51.565: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-api-machinery] ResourceQuota
test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-api-machinery] ResourceQuota
dump namespaces | framework.go:196
STEP: dump namespace information after failure 11/23/22 21:16:51.605
STEP: Collecting events from namespace "resourcequota-2152". 11/23/22 21:16:51.605
Nov 23 21:16:51.645: INFO: Unexpected error: failed to list events in namespace "resourcequota-2152":
<*url.Error | 0xc0046728a0>: {
Op: "Get",
URL: "https://35.247.28.208/api/v1/namespaces/resourcequota-2152/events",
Err: <*net.OpError | 0xc00257e7d0>{
Op: "dial",
Net: "tcp",
Source: nil,
Addr: <*net.TCPAddr | 0xc00269d7d0>{
IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 35, 247, 28, 208],
Port: 443,
Zone: "",
},
Err: <*os.SyscallError | 0xc000e9c4c0>{
Syscall: "connect",
Err: <syscall.Errno>0x6f,
},
},
}
Nov 23 21:16:51.645: FAIL: failed to list events in namespace "resourcequota-2152": Get "https://35.247.28.208/api/v1/namespaces/resourcequota-2152/events": dial tcp 35.247.28.208:443: connect: connection refused
Full Stack Trace
k8s.io/kubernetes/test/e2e/framework/debug.dumpEventsInNamespace(0xc001b525c0, {0xc00436f488, 0x12})
test/e2e/framework/debug/dump.go:44 +0x191
k8s.io/kubernetes/test/e2e/framework/debug.DumpAllNamespaceInfo({0x801de88, 0xc0040e9040}, {0xc00436f488, 0x12})
test/e2e/framework/debug/dump.go:62 +0x8d
k8s.io/kubernetes/test/e2e/framework/debug/init.init.0.func1.1(0xc001b52650?, {0xc00436f488?, 0x7fa7740?})
test/e2e/framework/debug/init/init.go:34 +0x32
k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo.func1()
test/e2e/framework/framework.go:274 +0x6d
k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo(0xc001209680)
test/e2e/framework/framework.go:271 +0x179
reflect.Value.call({0x6627cc0?, 0xc002750150?, 0xc00028ffb0?}, {0x75b6e72, 0x4}, {0xae73300, 0x0, 0xc000f0f5a8?})
/usr/local/go/src/reflect/value.go:584 +0x8c5
reflect.Value.Call({0x6627cc0?, 0xc002750150?, 0x29449fc?}, {0xae73300?, 0xc00028ff80?, 0x2a6d786?})
/usr/local/go/src/reflect/value.go:368 +0xbc
[DeferCleanup (Each)] [sig-api-machinery] ResourceQuota
tear down framework | framework.go:193
STEP: Destroying namespace "resourcequota-2152" for this suite. 11/23/22 21:16:51.646
Nov 23 21:16:51.686: FAIL: Couldn't delete ns: "resourcequota-2152": Delete "https://35.247.28.208/api/v1/namespaces/resourcequota-2152": dial tcp 35.247.28.208:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://35.247.28.208/api/v1/namespaces/resourcequota-2152", Err:(*net.OpError)(0xc00365d5e0)})
Full Stack Trace
k8s.io/kubernetes/test/e2e/framework.(*Framework).AfterEach.func1()
test/e2e/framework/framework.go:370 +0x4fe
k8s.io/kubernetes/test/e2e/framework.(*Framework).AfterEach(0xc001209680)
test/e2e/framework/framework.go:383 +0x1ca
reflect.Value.call({0x6627cc0?, 0xc0027500d0?, 0xc003f9dfb0?}, {0x75b6e72, 0x4}, {0xae73300, 0x0, 0x0?})
/usr/local/go/src/reflect/value.go:584 +0x8c5
reflect.Value.Call({0x6627cc0?, 0xc0027500d0?, 0x0?}, {0xae73300?, 0x5?, 0xc0017aa390?})
/usr/local/go/src/reflect/value.go:368 +0xbc
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sResourceQuota\sshould\screate\sa\sResourceQuota\sand\scapture\sthe\slife\sof\sa\spod\.\s\[Conformance\]$'
test/e2e/framework/framework.go:241 k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc00128c690) test/e2e/framework/framework.go:241 +0x96ffrom junit_01.xml
[BeforeEach] [sig-api-machinery] ResourceQuota set up framework | framework.go:178 STEP: Creating a kubernetes client 11/23/22 21:17:20.355 Nov 23 21:17:20.355: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Building a namespace api object, basename resourcequota 11/23/22 21:17:20.357 Nov 23 21:17:20.397: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:17:22.436: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:17:24.437: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:17:26.437: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:17:28.437: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:17:30.437: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:17:32.437: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:17:34.437: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:19:38.423: INFO: Unexpected error: <*fmt.wrapError | 0xc0003c4000>: { msg: "wait for service account \"default\" in namespace \"resourcequota-1407\": timed out waiting for the condition", err: <*errors.errorString | 0xc0001cba00>{ s: "timed out waiting for the condition", }, } Nov 23 21:19:38.423: FAIL: wait for service account "default" in namespace "resourcequota-1407": timed out waiting for the condition Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc00128c690) test/e2e/framework/framework.go:241 +0x96f [AfterEach] [sig-api-machinery] ResourceQuota test/e2e/framework/node/init/init.go:32 Nov 23 21:19:38.423: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-api-machinery] ResourceQuota dump namespaces | framework.go:196 STEP: dump namespace information after failure 11/23/22 21:19:38.509 STEP: Collecting events from namespace "resourcequota-1407". 11/23/22 21:19:38.509 STEP: Found 0 events. 11/23/22 21:19:38.551 Nov 23 21:19:38.595: INFO: POD NODE PHASE GRACE CONDITIONS Nov 23 21:19:38.595: INFO: Nov 23 21:19:38.640: INFO: Logging node info for node bootstrap-e2e-master Nov 23 21:19:38.685: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master e178771e-6078-4cf7-a352-1d84c66cb7be 15145 0 2022-11-23 20:56:22 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-23 20:56:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-11-23 20:56:39 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-11-23 20:56:40 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-11-23 21:17:38 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-alpha/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3858366464 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3596222464 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-23 20:56:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:39 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-23 21:17:38 +0000 UTC,LastTransitionTime:2022-11-23 20:56:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-23 21:17:38 +0000 UTC,LastTransitionTime:2022-11-23 20:56:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-23 21:17:38 +0000 UTC,LastTransitionTime:2022-11-23 20:56:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-23 21:17:38 +0000 UTC,LastTransitionTime:2022-11-23 20:56:24 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:35.247.28.208,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-jkns-gci-gce-alpha.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-jkns-gci-gce-alpha.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:15f6e783a1401075c491684ecd23ec3a,SystemUUID:15f6e783-a140-1075-c491-684ecd23ec3a,BootID:04aebf08-8ea7-4b94-843b-308a92bf91fb,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.40+9884746f0fd338,KubeProxyVersion:v1.27.0-alpha.0.40+9884746f0fd338,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-alpha.0.40_9884746f0fd338],SizeBytes:135160275,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-alpha.0.40_9884746f0fd338],SizeBytes:124989753,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:b83c1d70989e1fe87583607bf5aee1ee34e52773d4755b95f5cf5a451962f3a4 registry.k8s.io/etcd:3.5.5-0],SizeBytes:102417044,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-alpha.0.40_9884746f0fd338],SizeBytes:57659704,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:2c111f004bec24888d8cfa2a812a38fb8341350abac67dcd0ac64e709dfe389c registry.k8s.io/kas-network-proxy/proxy-server:v0.0.33],SizeBytes:22020129,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 23 21:19:38.685: INFO: Logging kubelet events for node bootstrap-e2e-master Nov 23 21:19:38.823: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-master Nov 23 21:19:38.936: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-master: error trying to reach service: No agent available Nov 23 21:19:38.936: INFO: Logging node info for node bootstrap-e2e-minion-group-3dd6 Nov 23 21:19:38.983: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-3dd6 aba1b812-4944-438f-b4bc-79f731a0b1cc 15329 0 2022-11-23 20:56:27 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-3dd6 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-3dd6 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-volumemode-5531":"bootstrap-e2e-minion-group-3dd6","csi-mock-csi-mock-volumes-1039":"bootstrap-e2e-minion-group-3dd6","csi-mock-csi-mock-volumes-4923":"bootstrap-e2e-minion-group-3dd6"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-11-23 20:56:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {kubelet Update v1 2022-11-23 20:56:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-23 21:13:33 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {node-problem-detector Update v1 2022-11-23 21:17:42 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-23 21:19:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-alpha/us-west1-b/bootstrap-e2e-minion-group-3dd6,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2022-11-23 21:17:42 +0000 UTC,LastTransitionTime:2022-11-23 21:06:58 +0000 UTC,Reason:DockerHung,Message:kernel: INFO: task docker:12345 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-23 21:17:42 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-23 21:17:42 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-23 21:17:42 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-23 21:17:42 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-23 21:17:42 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-23 21:17:42 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-23 20:56:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:39 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-23 21:16:43 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-23 21:16:43 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-23 21:16:43 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-23 21:16:43 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.83.109.94,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-3dd6.c.k8s-jkns-gci-gce-alpha.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-3dd6.c.k8s-jkns-gci-gce-alpha.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e748f2e47d098c7d59fb0c64c73041ef,SystemUUID:e748f2e4-7d09-8c7d-59fb-0c64c73041ef,BootID:7dd715f8-7985-4853-a244-581e49eff17e,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.40+9884746f0fd338,KubeProxyVersion:v1.27.0-alpha.0.40+9884746f0fd338,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.40_9884746f0fd338],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-174^0850954f-6b72-11ed-8a23-76b571dae824],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-174^0850954f-6b72-11ed-8a23-76b571dae824,DevicePath:,},},Config:nil,},} Nov 23 21:19:38.984: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-3dd6 Nov 23 21:19:39.028: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-3dd6 Nov 23 21:19:39.090: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-3dd6: error trying to reach service: No agent available Nov 23 21:19:39.090: INFO: Logging node info for node bootstrap-e2e-minion-group-3h36 Nov 23 21:19:39.137: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-3h36 ab6bfea1-ac11-4084-be81-dd72391e5606 15372 0 2022-11-23 20:56:27 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-3h36 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-3h36 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-6659":"bootstrap-e2e-minion-group-3h36","csi-hostpath-volume-7023":"bootstrap-e2e-minion-group-3h36","csi-hostpath-volume-expand-1606":"bootstrap-e2e-minion-group-3h36","csi-mock-csi-mock-volumes-2421":"bootstrap-e2e-minion-group-3h36","csi-mock-csi-mock-volumes-2701":"bootstrap-e2e-minion-group-3h36","csi-mock-csi-mock-volumes-4031":"bootstrap-e2e-minion-group-3h36","csi-mock-csi-mock-volumes-6008":"bootstrap-e2e-minion-group-3h36"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-23 20:56:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-23 20:56:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-11-23 21:13:20 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {node-problem-detector Update v1 2022-11-23 21:17:45 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-23 21:19:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-alpha/us-west1-b/bootstrap-e2e-minion-group-3h36,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815430144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553286144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2022-11-23 21:17:45 +0000 UTC,LastTransitionTime:2022-11-23 21:07:01 +0000 UTC,Reason:DockerHung,Message:kernel: INFO: task docker:12345 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-23 21:17:45 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-23 21:17:45 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-23 21:17:45 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-23 21:17:45 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-23 21:17:45 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-23 21:17:45 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-23 20:56:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:39 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-23 21:18:29 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-23 21:18:29 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-23 21:18:29 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-23 21:18:29 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:35.199.155.0,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-3h36.c.k8s-jkns-gci-gce-alpha.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-3h36.c.k8s-jkns-gci-gce-alpha.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:4aed16763bdc994e9fc6e3e0c95cb8ae,SystemUUID:4aed1676-3bdc-994e-9fc6-e3e0c95cb8ae,BootID:461d3e21-d519-43c8-ab39-0c2de0db6ed8,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.40+9884746f0fd338,KubeProxyVersion:v1.27.0-alpha.0.40+9884746f0fd338,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.40_9884746f0fd338],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 registry.k8s.io/sig-storage/snapshot-controller:v6.1.0],SizeBytes:22620891,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-6659^86e580f3-6b73-11ed-b59e-5aeca3ae5a48],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-6659^86e580f3-6b73-11ed-b59e-5aeca3ae5a48,DevicePath:,},},Config:nil,},} Nov 23 21:19:39.137: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-3h36 Nov 23 21:19:39.231: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-3h36 Nov 23 21:19:39.284: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-3h36: error trying to reach service: No agent available Nov 23 21:19:39.284: INFO: Logging node info for node bootstrap-e2e-minion-group-qss2 Nov 23 21:19:39.327: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-qss2 0f567691-be6f-4056-8e45-f5c587fd8fff 15331 0 2022-11-23 20:56:26 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-qss2 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-qss2 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-4070":"bootstrap-e2e-minion-group-qss2","csi-hostpath-ephemeral-7934":"bootstrap-e2e-minion-group-qss2","csi-hostpath-provisioning-1098":"bootstrap-e2e-minion-group-qss2"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-23 20:56:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-23 20:56:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-11-23 21:13:57 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {node-problem-detector Update v1 2022-11-23 21:17:39 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-23 21:19:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-alpha/us-west1-b/bootstrap-e2e-minion-group-qss2,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815430144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553286144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-23 21:17:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:28 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-23 21:17:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:28 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-23 21:17:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:28 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2022-11-23 21:17:39 +0000 UTC,LastTransitionTime:2022-11-23 21:07:05 +0000 UTC,Reason:DockerHung,Message:kernel: INFO: task docker:12345 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-23 21:17:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:28 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-23 21:17:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:28 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-23 21:17:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:28 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-23 20:56:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:39 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-23 21:19:03 +0000 UTC,LastTransitionTime:2022-11-23 20:56:25 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-23 21:19:03 +0000 UTC,LastTransitionTime:2022-11-23 20:56:25 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-23 21:19:03 +0000 UTC,LastTransitionTime:2022-11-23 20:56:25 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-23 21:19:03 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:34.127.127.16,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-qss2.c.k8s-jkns-gci-gce-alpha.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-qss2.c.k8s-jkns-gci-gce-alpha.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:76baa30d5979427855b04f88deaf8671,SystemUUID:76baa30d-5979-4278-55b0-4f88deaf8671,BootID:f794e29b-0541-47d9-932b-8ed3667da969,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.40+9884746f0fd338,KubeProxyVersion:v1.27.0-alpha.0.40+9884746f0fd338,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4c4bb2ffc261dd79041c1fa8a7a979520b4c08d8e535583e8fbbf22690d13bb1 registry.k8s.io/etcd:3.5.5-1],SizeBytes:102440299,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.40_9884746f0fd338],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-volume-expand-652^27b2ea4d-6b73-11ed-a3f5-da4b8a158143],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-volume-expand-652^27b2ea4d-6b73-11ed-a3f5-da4b8a158143,DevicePath:,},},Config:nil,},} Nov 23 21:19:39.328: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-qss2 Nov 23 21:19:39.379: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-qss2 Nov 23 21:19:39.479: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-qss2: error trying to reach service: No agent available [DeferCleanup (Each)] [sig-api-machinery] ResourceQuota tear down framework | framework.go:193 STEP: Destroying namespace "resourcequota-1407" for this suite. 11/23/22 21:19:39.479
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sResourceQuota\sshould\screate\sa\sResourceQuota\sand\scapture\sthe\slife\sof\sa\sreplication\scontroller\.\s\[Conformance\]$'
test/e2e/framework/framework.go:241 k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc00115f680) test/e2e/framework/framework.go:241 +0x96ffrom junit_01.xml
[BeforeEach] [sig-api-machinery] ResourceQuota set up framework | framework.go:178 STEP: Creating a kubernetes client 11/23/22 21:17:19.135 Nov 23 21:17:19.135: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Building a namespace api object, basename resourcequota 11/23/22 21:17:19.137 Nov 23 21:17:19.176: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:17:21.216: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:17:23.216: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:17:25.216: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:17:27.217: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:17:29.216: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:17:31.217: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:17:33.216: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:19:38.421: INFO: Unexpected error: <*fmt.wrapError | 0xc00156a000>: { msg: "wait for service account \"default\" in namespace \"resourcequota-8817\": timed out waiting for the condition", err: <*errors.errorString | 0xc00011dd70>{ s: "timed out waiting for the condition", }, } Nov 23 21:19:38.422: FAIL: wait for service account "default" in namespace "resourcequota-8817": timed out waiting for the condition Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc00115f680) test/e2e/framework/framework.go:241 +0x96f [AfterEach] [sig-api-machinery] ResourceQuota test/e2e/framework/node/init/init.go:32 Nov 23 21:19:38.422: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-api-machinery] ResourceQuota dump namespaces | framework.go:196 STEP: dump namespace information after failure 11/23/22 21:19:38.504 STEP: Collecting events from namespace "resourcequota-8817". 11/23/22 21:19:38.505 STEP: Found 0 events. 11/23/22 21:19:38.545 Nov 23 21:19:38.585: INFO: POD NODE PHASE GRACE CONDITIONS Nov 23 21:19:38.585: INFO: Nov 23 21:19:38.632: INFO: Logging node info for node bootstrap-e2e-master Nov 23 21:19:38.674: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master e178771e-6078-4cf7-a352-1d84c66cb7be 15145 0 2022-11-23 20:56:22 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-23 20:56:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-11-23 20:56:39 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-11-23 20:56:40 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-11-23 21:17:38 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-alpha/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3858366464 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3596222464 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-23 20:56:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:39 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-23 21:17:38 +0000 UTC,LastTransitionTime:2022-11-23 20:56:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-23 21:17:38 +0000 UTC,LastTransitionTime:2022-11-23 20:56:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-23 21:17:38 +0000 UTC,LastTransitionTime:2022-11-23 20:56:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-23 21:17:38 +0000 UTC,LastTransitionTime:2022-11-23 20:56:24 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:35.247.28.208,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-jkns-gci-gce-alpha.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-jkns-gci-gce-alpha.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:15f6e783a1401075c491684ecd23ec3a,SystemUUID:15f6e783-a140-1075-c491-684ecd23ec3a,BootID:04aebf08-8ea7-4b94-843b-308a92bf91fb,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.40+9884746f0fd338,KubeProxyVersion:v1.27.0-alpha.0.40+9884746f0fd338,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-alpha.0.40_9884746f0fd338],SizeBytes:135160275,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-alpha.0.40_9884746f0fd338],SizeBytes:124989753,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:b83c1d70989e1fe87583607bf5aee1ee34e52773d4755b95f5cf5a451962f3a4 registry.k8s.io/etcd:3.5.5-0],SizeBytes:102417044,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-alpha.0.40_9884746f0fd338],SizeBytes:57659704,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:2c111f004bec24888d8cfa2a812a38fb8341350abac67dcd0ac64e709dfe389c registry.k8s.io/kas-network-proxy/proxy-server:v0.0.33],SizeBytes:22020129,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 23 21:19:38.675: INFO: Logging kubelet events for node bootstrap-e2e-master Nov 23 21:19:38.824: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-master Nov 23 21:19:38.947: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-master: error trying to reach service: No agent available Nov 23 21:19:38.947: INFO: Logging node info for node bootstrap-e2e-minion-group-3dd6 Nov 23 21:19:38.997: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-3dd6 aba1b812-4944-438f-b4bc-79f731a0b1cc 15329 0 2022-11-23 20:56:27 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-3dd6 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-3dd6 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-volumemode-5531":"bootstrap-e2e-minion-group-3dd6","csi-mock-csi-mock-volumes-1039":"bootstrap-e2e-minion-group-3dd6","csi-mock-csi-mock-volumes-4923":"bootstrap-e2e-minion-group-3dd6"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-11-23 20:56:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {kubelet Update v1 2022-11-23 20:56:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-23 21:13:33 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {node-problem-detector Update v1 2022-11-23 21:17:42 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-23 21:19:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-alpha/us-west1-b/bootstrap-e2e-minion-group-3dd6,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2022-11-23 21:17:42 +0000 UTC,LastTransitionTime:2022-11-23 21:06:58 +0000 UTC,Reason:DockerHung,Message:kernel: INFO: task docker:12345 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-23 21:17:42 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-23 21:17:42 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-23 21:17:42 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-23 21:17:42 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-23 21:17:42 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-23 21:17:42 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-23 20:56:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:39 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-23 21:16:43 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-23 21:16:43 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-23 21:16:43 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-23 21:16:43 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.83.109.94,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-3dd6.c.k8s-jkns-gci-gce-alpha.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-3dd6.c.k8s-jkns-gci-gce-alpha.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e748f2e47d098c7d59fb0c64c73041ef,SystemUUID:e748f2e4-7d09-8c7d-59fb-0c64c73041ef,BootID:7dd715f8-7985-4853-a244-581e49eff17e,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.40+9884746f0fd338,KubeProxyVersion:v1.27.0-alpha.0.40+9884746f0fd338,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.40_9884746f0fd338],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-174^0850954f-6b72-11ed-8a23-76b571dae824],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-174^0850954f-6b72-11ed-8a23-76b571dae824,DevicePath:,},},Config:nil,},} Nov 23 21:19:38.998: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-3dd6 Nov 23 21:19:39.050: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-3dd6 Nov 23 21:19:39.101: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-3dd6: error trying to reach service: No agent available Nov 23 21:19:39.101: INFO: Logging node info for node bootstrap-e2e-minion-group-3h36 Nov 23 21:19:39.150: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-3h36 ab6bfea1-ac11-4084-be81-dd72391e5606 15372 0 2022-11-23 20:56:27 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-3h36 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-3h36 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-6659":"bootstrap-e2e-minion-group-3h36","csi-hostpath-volume-7023":"bootstrap-e2e-minion-group-3h36","csi-hostpath-volume-expand-1606":"bootstrap-e2e-minion-group-3h36","csi-mock-csi-mock-volumes-2421":"bootstrap-e2e-minion-group-3h36","csi-mock-csi-mock-volumes-2701":"bootstrap-e2e-minion-group-3h36","csi-mock-csi-mock-volumes-4031":"bootstrap-e2e-minion-group-3h36","csi-mock-csi-mock-volumes-6008":"bootstrap-e2e-minion-group-3h36"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-23 20:56:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-23 20:56:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-11-23 21:13:20 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {node-problem-detector Update v1 2022-11-23 21:17:45 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-23 21:19:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-alpha/us-west1-b/bootstrap-e2e-minion-group-3h36,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815430144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553286144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2022-11-23 21:17:45 +0000 UTC,LastTransitionTime:2022-11-23 21:07:01 +0000 UTC,Reason:DockerHung,Message:kernel: INFO: task docker:12345 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-23 21:17:45 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-23 21:17:45 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-23 21:17:45 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-23 21:17:45 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-23 21:17:45 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-23 21:17:45 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-23 20:56:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:39 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-23 21:18:29 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-23 21:18:29 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-23 21:18:29 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-23 21:18:29 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:35.199.155.0,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-3h36.c.k8s-jkns-gci-gce-alpha.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-3h36.c.k8s-jkns-gci-gce-alpha.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:4aed16763bdc994e9fc6e3e0c95cb8ae,SystemUUID:4aed1676-3bdc-994e-9fc6-e3e0c95cb8ae,BootID:461d3e21-d519-43c8-ab39-0c2de0db6ed8,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.40+9884746f0fd338,KubeProxyVersion:v1.27.0-alpha.0.40+9884746f0fd338,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.40_9884746f0fd338],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 registry.k8s.io/sig-storage/snapshot-controller:v6.1.0],SizeBytes:22620891,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-6659^86e580f3-6b73-11ed-b59e-5aeca3ae5a48],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-6659^86e580f3-6b73-11ed-b59e-5aeca3ae5a48,DevicePath:,},},Config:nil,},} Nov 23 21:19:39.151: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-3h36 Nov 23 21:19:39.249: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-3h36 Nov 23 21:19:39.317: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-3h36: error trying to reach service: No agent available Nov 23 21:19:39.317: INFO: Logging node info for node bootstrap-e2e-minion-group-qss2 Nov 23 21:19:39.361: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-qss2 0f567691-be6f-4056-8e45-f5c587fd8fff 15331 0 2022-11-23 20:56:26 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-qss2 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-qss2 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-4070":"bootstrap-e2e-minion-group-qss2","csi-hostpath-ephemeral-7934":"bootstrap-e2e-minion-group-qss2","csi-hostpath-provisioning-1098":"bootstrap-e2e-minion-group-qss2"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-23 20:56:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-23 20:56:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-11-23 21:13:57 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {node-problem-detector Update v1 2022-11-23 21:17:39 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-23 21:19:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-alpha/us-west1-b/bootstrap-e2e-minion-group-qss2,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815430144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553286144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-23 21:17:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:28 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-23 21:17:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:28 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-23 21:17:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:28 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2022-11-23 21:17:39 +0000 UTC,LastTransitionTime:2022-11-23 21:07:05 +0000 UTC,Reason:DockerHung,Message:kernel: INFO: task docker:12345 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-23 21:17:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:28 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-23 21:17:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:28 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-23 21:17:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:28 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-23 20:56:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:39 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-23 21:19:03 +0000 UTC,LastTransitionTime:2022-11-23 20:56:25 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-23 21:19:03 +0000 UTC,LastTransitionTime:2022-11-23 20:56:25 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-23 21:19:03 +0000 UTC,LastTransitionTime:2022-11-23 20:56:25 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-23 21:19:03 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:34.127.127.16,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-qss2.c.k8s-jkns-gci-gce-alpha.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-qss2.c.k8s-jkns-gci-gce-alpha.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:76baa30d5979427855b04f88deaf8671,SystemUUID:76baa30d-5979-4278-55b0-4f88deaf8671,BootID:f794e29b-0541-47d9-932b-8ed3667da969,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.40+9884746f0fd338,KubeProxyVersion:v1.27.0-alpha.0.40+9884746f0fd338,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4c4bb2ffc261dd79041c1fa8a7a979520b4c08d8e535583e8fbbf22690d13bb1 registry.k8s.io/etcd:3.5.5-1],SizeBytes:102440299,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.40_9884746f0fd338],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-volume-expand-652^27b2ea4d-6b73-11ed-a3f5-da4b8a158143],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-volume-expand-652^27b2ea4d-6b73-11ed-a3f5-da4b8a158143,DevicePath:,},},Config:nil,},} Nov 23 21:19:39.362: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-qss2 Nov 23 21:19:39.416: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-qss2 Nov 23 21:19:39.491: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-qss2: error trying to reach service: No agent available [DeferCleanup (Each)] [sig-api-machinery] ResourceQuota tear down framework | framework.go:193 STEP: Destroying namespace "resourcequota-8817" for this suite. 11/23/22 21:19:39.491
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sWatchers\sshould\sreceive\sevents\son\sconcurrent\swatches\sin\ssame\sorder\s\[Conformance\]$'
test/e2e/framework/framework.go:241 k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc001089d10) test/e2e/framework/framework.go:241 +0x96ffrom junit_01.xml
[BeforeEach] [sig-api-machinery] Watchers set up framework | framework.go:178 STEP: Creating a kubernetes client 11/23/22 21:03:47.923 Nov 23 21:03:47.923: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Building a namespace api object, basename watch 11/23/22 21:03:47.925 Nov 23 21:03:47.965: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:03:50.005: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:03:52.005: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:03:54.005: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:03:56.005: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:03:58.004: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:04:00.005: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:04:02.004: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:04:04.005: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:04:06.005: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:04:08.005: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:04:10.004: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:04:12.005: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:04:14.005: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:04:16.005: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:04:18.004: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:04:18.043: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:04:18.043: INFO: Unexpected error: <*errors.errorString | 0xc0001ffa10>: { s: "timed out waiting for the condition", } Nov 23 21:04:18.043: FAIL: timed out waiting for the condition Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc001089d10) test/e2e/framework/framework.go:241 +0x96f [AfterEach] [sig-api-machinery] Watchers test/e2e/framework/node/init/init.go:32 Nov 23 21:04:18.044: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-api-machinery] Watchers dump namespaces | framework.go:196 STEP: dump namespace information after failure 11/23/22 21:04:18.083 [DeferCleanup (Each)] [sig-api-machinery] Watchers tear down framework | framework.go:193
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sclient\-go\sshould\snegotiate\swatch\sand\sreport\serrors\swith\saccept\s\"application\/vnd\.kubernetes\.protobuf\"$'
test/e2e/framework/framework.go:241 k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc0003774a0) test/e2e/framework/framework.go:241 +0x96ffrom junit_01.xml
[BeforeEach] [sig-api-machinery] client-go should negotiate set up framework | framework.go:178 STEP: Creating a kubernetes client 11/23/22 21:16:50.184 Nov 23 21:16:50.184: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Building a namespace api object, basename protocol 11/23/22 21:16:50.186 Nov 23 21:16:50.225: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:16:52.265: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:16:54.265: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:16:56.265: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:16:58.266: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:17:00.265: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:17:02.264: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:17:04.265: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:17:06.265: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:17:08.265: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:17:10.265: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:17:12.265: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:17:14.265: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:17:16.265: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:17:18.265: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:17:20.265: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:17:20.304: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused Nov 23 21:17:20.304: INFO: Unexpected error: <*errors.errorString | 0xc000115d80>: { s: "timed out waiting for the condition", } Nov 23 21:17:20.304: FAIL: timed out waiting for the condition Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc0003774a0) test/e2e/framework/framework.go:241 +0x96f [AfterEach] [sig-api-machinery] client-go should negotiate test/e2e/framework/node/init/init.go:32 Nov 23 21:17:20.305: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-api-machinery] client-go should negotiate dump namespaces | framework.go:196 STEP: dump namespace information after failure 11/23/22 21:17:20.344 [DeferCleanup (Each)] [sig-api-machinery] client-go should negotiate tear down framework | framework.go:193
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-apps\]\sCronJob\sshould\sdelete\sfailed\sfinished\sjobs\swith\slimit\sof\sone\sjob$'
test/e2e/apps/cronjob.go:488
k8s.io/kubernetes/test/e2e/apps.ensureHistoryLimits({0x801de88, 0xc00329e000}, {0xc0027c5860, 0xc}, 0x75cbeab?)
test/e2e/apps/cronjob.go:488 +0x1dd
k8s.io/kubernetes/test/e2e/apps.glob..func2.9()
test/e2e/apps/cronjob.go:298 +0xf6
There were additional failures detected after the initial failure:
[FAILED]
Nov 23 21:35:03.998: failed to list events in namespace "cronjob-3650": Get "https://35.247.28.208/api/v1/namespaces/cronjob-3650/events": dial tcp 35.247.28.208:443: connect: connection refused
In [DeferCleanup (Each)] at: test/e2e/framework/debug/dump.go:44
----------
[FAILED]
Nov 23 21:35:04.040: Couldn't delete ns: "cronjob-3650": Delete "https://35.247.28.208/api/v1/namespaces/cronjob-3650": dial tcp 35.247.28.208:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://35.247.28.208/api/v1/namespaces/cronjob-3650", Err:(*net.OpError)(0xc0051a86e0)})
In [DeferCleanup (Each)] at: test/e2e/framework/framework.go:370
[BeforeEach] [sig-apps] CronJob
set up framework | framework.go:178
STEP: Creating a kubernetes client 11/23/22 21:34:36.366
Nov 23 21:34:36.366: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Building a namespace api object, basename cronjob 11/23/22 21:34:36.37
STEP: Waiting for a default service account to be provisioned in namespace 11/23/22 21:34:37.328
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 11/23/22 21:34:37.531
[BeforeEach] [sig-apps] CronJob
test/e2e/framework/metrics/init/init.go:31
[It] should delete failed finished jobs with limit of one job
test/e2e/apps/cronjob.go:291
STEP: Creating an AllowConcurrent cronjob with custom history limit 11/23/22 21:34:37.71
STEP: Ensuring a finished job exists 11/23/22 21:34:37.875
Nov 23 21:35:03.917: INFO: Unexpected error: Failed to ensure a finished cronjob exists in namespace cronjob-3650:
<*url.Error | 0xc004dc8000>: {
Op: "Get",
URL: "https://35.247.28.208/apis/batch/v1/namespaces/cronjob-3650/jobs",
Err: <*net.OpError | 0xc0028aa0a0>{
Op: "dial",
Net: "tcp",
Source: nil,
Addr: <*net.TCPAddr | 0xc003f944e0>{
IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 35, 247, 28, 208],
Port: 443,
Zone: "",
},
Err: <*os.SyscallError | 0xc003ac0000>{
Syscall: "connect",
Err: <syscall.Errno>0x6f,
},
},
}
Nov 23 21:35:03.917: FAIL: Failed to ensure a finished cronjob exists in namespace cronjob-3650: Get "https://35.247.28.208/apis/batch/v1/namespaces/cronjob-3650/jobs": dial tcp 35.247.28.208:443: connect: connection refused
Full Stack Trace
k8s.io/kubernetes/test/e2e/apps.ensureHistoryLimits({0x801de88, 0xc00329e000}, {0xc0027c5860, 0xc}, 0x75cbeab?)
test/e2e/apps/cronjob.go:488 +0x1dd
k8s.io/kubernetes/test/e2e/apps.glob..func2.9()
test/e2e/apps/cronjob.go:298 +0xf6
[AfterEach] [sig-apps] CronJob
test/e2e/framework/node/init/init.go:32
Nov 23 21:35:03.918: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-apps] CronJob
test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-apps] CronJob
dump namespaces | framework.go:196
STEP: dump namespace information after failure 11/23/22 21:35:03.958
STEP: Collecting events from namespace "cronjob-3650". 11/23/22 21:35:03.958
Nov 23 21:35:03.998: INFO: Unexpected error: failed to list events in namespace "cronjob-3650":
<*url.Error | 0xc003f94510>: {
Op: "Get",
URL: "https://35.247.28.208/api/v1/namespaces/cronjob-3650/events",
Err: <*net.OpError | 0xc0024325a0>{
Op: "dial",
Net: "tcp",
Source: nil,
Addr: <*net.TCPAddr | 0xc0027c1050>{
IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 35, 247, 28, 208],
Port: 443,
Zone: "",
},
Err: <*os.SyscallError | 0xc0018881e0>{
Syscall: "connect",
Err: <syscall.Errno>0x6f,
},
},
}
Nov 23 21:35:03.998: FAIL: failed to list events in namespace "cronjob-3650": Get "https://35.247.28.208/api/v1/namespaces/cronjob-3650/events": dial tcp 35.247.28.208:443: connect: connection refused
Full Stack Trace
k8s.io/kubernetes/test/e2e/framework/debug.dumpEventsInNamespace(0xc00133a5c0, {0xc0027c5860, 0xc})
test/e2e/framework/debug/dump.go:44 +0x191
k8s.io/kubernetes/test/e2e/framework/debug.DumpAllNamespaceInfo({0x801de88, 0xc00329e000}, {0xc0027c5860, 0xc})
test/e2e/framework/debug/dump.go:62 +0x8d
k8s.io/kubernetes/test/e2e/framework/debug/init.init.0.func1.1(0xc00133a650?, {0xc0027c5860?, 0x7fa7740?})
test/e2e/framework/debug/init/init.go:34 +0x32
k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo.func1()
test/e2e/framework/framework.go:274 +0x6d
k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo(0xc00112ea50)
test/e2e/framework/framework.go:271 +0x179
reflect.Value.call({0x6627cc0?, 0xc00191be00?, 0xc0026b0fb0?}, {0x75b6e72, 0x4}, {0xae73300, 0x0, 0xc0025f6228?})
/usr/local/go/src/reflect/value.go:584 +0x8c5
reflect.Value.Call({0x6627cc0?, 0xc00191be00?, 0x29449fc?}, {0xae73300?, 0xc0026b0f80?, 0x2fdb5c0?})
/usr/local/go/src/reflect/value.go:368 +0xbc
[DeferCleanup (Each)] [sig-apps] CronJob
tear down framework | framework.go:193
STEP: Destroying namespace "cronjob-3650" for this suite. 11/23/22 21:35:03.999
Nov 23 21:35:04.040: FAIL: Couldn't delete ns: "cronjob-3650": Delete "https://35.247.28.208/api/v1/namespaces/cronjob-3650": dial tcp 35.247.28.208:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://35.247.28.208/api/v1/namespaces/cronjob-3650", Err:(*net.OpError)(0xc0051a86e0)})
Full Stack Trace
k8s.io/kubernetes/test/e2e/framework.(*Framework).AfterEach.func1()
test/e2e/framework/framework.go:370 +0x4fe
k8s.io/kubernetes/test/e2e/framework.(*Framework).AfterEach(0xc00112ea50)
test/e2e/framework/framework.go:383 +0x1ca
reflect.Value.call({0x6627cc0?, 0xc00191bd30?, 0xc002f48fb0?}, {0x75b6e72, 0x4}, {0xae73300, 0x0, 0x0?})
/usr/local/go/src/reflect/value.go:584 +0x8c5
reflect.Value.Call({0x6627cc0?, 0xc00191bd30?, 0x0?}, {0xae73300?, 0x5?, 0xc003890168?})
/usr/local/go/src/reflect/value.go:368 +0xbc
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-apps\]\sCronJob\sshould\sremove\sfrom\sactive\slist\sjobs\sthat\shave\sbeen\sdeleted$'
test/e2e/apps/cronjob.go:250
k8s.io/kubernetes/test/e2e/apps.glob..func2.7()
test/e2e/apps/cronjob.go:250 +0x2b6
There were additional failures detected after the initial failure:
[FAILED]
Nov 23 20:59:48.975: failed to list events in namespace "cronjob-1037": Get "https://35.247.28.208/api/v1/namespaces/cronjob-1037/events": dial tcp 35.247.28.208:443: connect: connection refused
In [DeferCleanup (Each)] at: test/e2e/framework/debug/dump.go:44
----------
[FAILED]
Nov 23 20:59:49.022: Couldn't delete ns: "cronjob-1037": Delete "https://35.247.28.208/api/v1/namespaces/cronjob-1037": dial tcp 35.247.28.208:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://35.247.28.208/api/v1/namespaces/cronjob-1037", Err:(*net.OpError)(0xc0015d8140)})
In [DeferCleanup (Each)] at: test/e2e/framework/framework.go:370
[BeforeEach] [sig-apps] CronJob
set up framework | framework.go:178
STEP: Creating a kubernetes client 11/23/22 20:59:04.352
Nov 23 20:59:04.353: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Building a namespace api object, basename cronjob 11/23/22 20:59:04.357
STEP: Waiting for a default service account to be provisioned in namespace 11/23/22 20:59:04.563
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 11/23/22 20:59:04.656
[BeforeEach] [sig-apps] CronJob
test/e2e/framework/metrics/init/init.go:31
[It] should remove from active list jobs that have been deleted
test/e2e/apps/cronjob.go:241
STEP: Creating a ForbidConcurrent cronjob 11/23/22 20:59:04.764
STEP: Ensuring a job is scheduled 11/23/22 20:59:04.848
Nov 23 20:59:48.891: INFO: Unexpected error: Failed to ensure a forbid cronjob is scheduled in namespace cronjob-1037:
<*url.Error | 0xc001b78720>: {
Op: "Get",
URL: "https://35.247.28.208/apis/batch/v1/namespaces/cronjob-1037/cronjobs/forbid",
Err: <*net.OpError | 0xc0033e0b40>{
Op: "dial",
Net: "tcp",
Source: nil,
Addr: <*net.TCPAddr | 0xc001a13260>{
IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 35, 247, 28, 208],
Port: 443,
Zone: "",
},
Err: <*os.SyscallError | 0xc0016bbbe0>{
Syscall: "connect",
Err: <syscall.Errno>0x6f,
},
},
}
Nov 23 20:59:48.891: FAIL: Failed to ensure a forbid cronjob is scheduled in namespace cronjob-1037: Get "https://35.247.28.208/apis/batch/v1/namespaces/cronjob-1037/cronjobs/forbid": dial tcp 35.247.28.208:443: connect: connection refused
Full Stack Trace
k8s.io/kubernetes/test/e2e/apps.glob..func2.7()
test/e2e/apps/cronjob.go:250 +0x2b6
[AfterEach] [sig-apps] CronJob
test/e2e/framework/node/init/init.go:32
Nov 23 20:59:48.892: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-apps] CronJob
test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-apps] CronJob
dump namespaces | framework.go:196
STEP: dump namespace information after failure 11/23/22 20:59:48.933
STEP: Collecting events from namespace "cronjob-1037". 11/23/22 20:59:48.933
Nov 23 20:59:48.975: INFO: Unexpected error: failed to list events in namespace "cronjob-1037":
<*url.Error | 0xc001b78bd0>: {
Op: "Get",
URL: "https://35.247.28.208/api/v1/namespaces/cronjob-1037/events",
Err: <*net.OpError | 0xc0033e0e10>{
Op: "dial",
Net: "tcp",
Source: nil,
Addr: <*net.TCPAddr | 0xc001a137a0>{
IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 35, 247, 28, 208],
Port: 443,
Zone: "",
},
Err: <*os.SyscallError | 0xc0016bbf40>{
Syscall: "connect",
Err: <syscall.Errno>0x6f,
},
},
}
Nov 23 20:59:48.975: FAIL: failed to list events in namespace "cronjob-1037": Get "https://35.247.28.208/api/v1/namespaces/cronjob-1037/events": dial tcp 35.247.28.208:443: connect: connection refused
Full Stack Trace
k8s.io/kubernetes/test/e2e/framework/debug.dumpEventsInNamespace(0xc0017705c0, {0xc0035aebe0, 0xc})
test/e2e/framework/debug/dump.go:44 +0x191
k8s.io/kubernetes/test/e2e/framework/debug.DumpAllNamespaceInfo({0x801de88, 0xc003344820}, {0xc0035aebe0, 0xc})
test/e2e/framework/debug/dump.go:62 +0x8d
k8s.io/kubernetes/test/e2e/framework/debug/init.init.0.func1.1(0xc001770650?, {0xc0035aebe0?, 0x7fa7740?})
test/e2e/framework/debug/init/init.go:34 +0x32
k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo.func1()
test/e2e/framework/framework.go:274 +0x6d
k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo(0xc000997680)
test/e2e/framework/framework.go:271 +0x179
reflect.Value.call({0x6627cc0?, 0xc0013c97f0?, 0xc0000cbfb0?}, {0x75b6e72, 0x4}, {0xae73300, 0x0, 0xc00341da88?})
/usr/local/go/src/reflect/value.go:584 +0x8c5
reflect.Value.Call({0x6627cc0?, 0xc0013c97f0?, 0x29449fc?}, {0xae73300?, 0xc0000cbf80?, 0x0?})
/usr/local/go/src/reflect/value.go:368 +0xbc
[DeferCleanup (Each)] [sig-apps] CronJob
tear down framework | framework.go:193
STEP: Destroying namespace "cronjob-1037" for this suite. 11/23/22 20:59:48.977
Nov 23 20:59:49.022: FAIL: Couldn't delete ns: "cronjob-1037": Delete "https://35.247.28.208/api/v1/namespaces/cronjob-1037": dial tcp 35.247.28.208:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://35.247.28.208/api/v1/namespaces/cronjob-1037", Err:(*net.OpError)(0xc0015d8140)})
Full Stack Trace
k8s.io/kubernetes/test/e2e/framework.(*Framework).AfterEach.func1()
test/e2e/framework/framework.go:370 +0x4fe
k8s.io/kubernetes/test/e2e/framework.(*Framework).AfterEach(0xc000997680)
test/e2e/framework/framework.go:383 +0x1ca
reflect.Value.call({0x6627cc0?, 0xc0013c9740?, 0xc0036e9fb0?}, {0x75b6e72, 0x4}, {0xae73300, 0x0, 0x0?})
/usr/local/go/src/reflect/value.go:584 +0x8c5
reflect.Value.Call({0x6627cc0?, 0xc0013c9740?, 0x0?}, {0xae73300?, 0x5?, 0xc001afc7e0?})
/usr/local/go/src/reflect/value.go:368 +0xbc
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-apps\]\sDeployment\sdeployment\sshould\ssupport\sproportional\sscaling\s\[Conformance\]$'
test/e2e/framework/framework.go:241 k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc0011e43c0) test/e2e/framework/framework.go:241 +0x96ffrom junit_01.xml
[BeforeEach] [sig-apps] Deployment set up framework | framework.go:178 STEP: Creating a kubernetes client 11/23/22 21:17:39.52 Nov 23 21:17:39.520: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Building a namespace api object, basename deployment 11/23/22 21:17:39.523 Nov 23 21:19:39.570: INFO: Unexpected error: <*fmt.wrapError | 0xc003f64020>: { msg: "wait for service account \"default\" in namespace \"deployment-7447\": timed out waiting for the condition", err: <*errors.errorString | 0xc0001ffa30>{ s: "timed out waiting for the condition", }, } Nov 23 21:19:39.570: FAIL: wait for service account "default" in namespace "deployment-7447": timed out waiting for the condition Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc0011e43c0) test/e2e/framework/framework.go:241 +0x96f [AfterEach] [sig-apps] Deployment test/e2e/apps/deployment.go:84 Nov 23 21:19:39.612: INFO: Log out all the ReplicaSets if there is no deployment created [AfterEach] [sig-apps] Deployment test/e2e/framework/node/init/init.go:32 Nov 23 21:19:39.653: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-apps] Deployment dump namespaces | framework.go:196 STEP: dump namespace information after failure 11/23/22 21:19:39.698 STEP: Collecting events from namespace "deployment-7447". 11/23/22 21:19:39.698 STEP: Found 0 events. 11/23/22 21:19:39.739 Nov 23 21:19:39.780: INFO: POD NODE PHASE GRACE CONDITIONS Nov 23 21:19:39.780: INFO: Nov 23 21:19:39.828: INFO: Logging node info for node bootstrap-e2e-master Nov 23 21:19:39.869: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master e178771e-6078-4cf7-a352-1d84c66cb7be 15145 0 2022-11-23 20:56:22 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-23 20:56:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-11-23 20:56:39 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-11-23 20:56:40 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-11-23 21:17:38 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-alpha/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3858366464 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3596222464 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-23 20:56:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:39 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-23 21:17:38 +0000 UTC,LastTransitionTime:2022-11-23 20:56:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-23 21:17:38 +0000 UTC,LastTransitionTime:2022-11-23 20:56:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-23 21:17:38 +0000 UTC,LastTransitionTime:2022-11-23 20:56:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-23 21:17:38 +0000 UTC,LastTransitionTime:2022-11-23 20:56:24 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:35.247.28.208,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-jkns-gci-gce-alpha.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-jkns-gci-gce-alpha.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:15f6e783a1401075c491684ecd23ec3a,SystemUUID:15f6e783-a140-1075-c491-684ecd23ec3a,BootID:04aebf08-8ea7-4b94-843b-308a92bf91fb,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.40+9884746f0fd338,KubeProxyVersion:v1.27.0-alpha.0.40+9884746f0fd338,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-alpha.0.40_9884746f0fd338],SizeBytes:135160275,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-alpha.0.40_9884746f0fd338],SizeBytes:124989753,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:b83c1d70989e1fe87583607bf5aee1ee34e52773d4755b95f5cf5a451962f3a4 registry.k8s.io/etcd:3.5.5-0],SizeBytes:102417044,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-alpha.0.40_9884746f0fd338],SizeBytes:57659704,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:2c111f004bec24888d8cfa2a812a38fb8341350abac67dcd0ac64e709dfe389c registry.k8s.io/kas-network-proxy/proxy-server:v0.0.33],SizeBytes:22020129,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 23 21:19:39.870: INFO: Logging kubelet events for node bootstrap-e2e-master Nov 23 21:19:39.913: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-master Nov 23 21:19:39.955: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-master: error trying to reach service: No agent available Nov 23 21:19:39.955: INFO: Logging node info for node bootstrap-e2e-minion-group-3dd6 Nov 23 21:19:39.997: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-3dd6 aba1b812-4944-438f-b4bc-79f731a0b1cc 15329 0 2022-11-23 20:56:27 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-3dd6 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-3dd6 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-volumemode-5531":"bootstrap-e2e-minion-group-3dd6","csi-mock-csi-mock-volumes-1039":"bootstrap-e2e-minion-group-3dd6","csi-mock-csi-mock-volumes-4923":"bootstrap-e2e-minion-group-3dd6"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-11-23 20:56:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {kubelet Update v1 2022-11-23 20:56:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-23 21:13:33 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {node-problem-detector Update v1 2022-11-23 21:17:42 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-23 21:19:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-alpha/us-west1-b/bootstrap-e2e-minion-group-3dd6,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2022-11-23 21:17:42 +0000 UTC,LastTransitionTime:2022-11-23 21:06:58 +0000 UTC,Reason:DockerHung,Message:kernel: INFO: task docker:12345 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-23 21:17:42 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-23 21:17:42 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-23 21:17:42 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-23 21:17:42 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-23 21:17:42 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-23 21:17:42 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-23 20:56:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:39 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-23 21:16:43 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-23 21:16:43 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-23 21:16:43 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-23 21:16:43 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.83.109.94,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-3dd6.c.k8s-jkns-gci-gce-alpha.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-3dd6.c.k8s-jkns-gci-gce-alpha.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e748f2e47d098c7d59fb0c64c73041ef,SystemUUID:e748f2e4-7d09-8c7d-59fb-0c64c73041ef,BootID:7dd715f8-7985-4853-a244-581e49eff17e,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.40+9884746f0fd338,KubeProxyVersion:v1.27.0-alpha.0.40+9884746f0fd338,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.40_9884746f0fd338],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-174^0850954f-6b72-11ed-8a23-76b571dae824],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-174^0850954f-6b72-11ed-8a23-76b571dae824,DevicePath:,},},Config:nil,},} Nov 23 21:19:39.998: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-3dd6 Nov 23 21:19:40.043: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-3dd6 Nov 23 21:19:40.110: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-3dd6: error trying to reach service: No agent available Nov 23 21:19:40.110: INFO: Logging node info for node bootstrap-e2e-minion-group-3h36 Nov 23 21:19:40.172: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-3h36 ab6bfea1-ac11-4084-be81-dd72391e5606 15372 0 2022-11-23 20:56:27 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-3h36 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-3h36 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-6659":"bootstrap-e2e-minion-group-3h36","csi-hostpath-volume-7023":"bootstrap-e2e-minion-group-3h36","csi-hostpath-volume-expand-1606":"bootstrap-e2e-minion-group-3h36","csi-mock-csi-mock-volumes-2421":"bootstrap-e2e-minion-group-3h36","csi-mock-csi-mock-volumes-2701":"bootstrap-e2e-minion-group-3h36","csi-mock-csi-mock-volumes-4031":"bootstrap-e2e-minion-group-3h36","csi-mock-csi-mock-volumes-6008":"bootstrap-e2e-minion-group-3h36"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-23 20:56:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-23 20:56:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-11-23 21:13:20 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {node-problem-detector Update v1 2022-11-23 21:17:45 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-23 21:19:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-alpha/us-west1-b/bootstrap-e2e-minion-group-3h36,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815430144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553286144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2022-11-23 21:17:45 +0000 UTC,LastTransitionTime:2022-11-23 21:07:01 +0000 UTC,Reason:DockerHung,Message:kernel: INFO: task docker:12345 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-23 21:17:45 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-23 21:17:45 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-23 21:17:45 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-23 21:17:45 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-23 21:17:45 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-23 21:17:45 +0000 UTC,LastTransitionTime:2022-11-23 20:56:30 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-23 20:56:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:39 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-23 21:18:29 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-23 21:18:29 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-23 21:18:29 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-23 21:18:29 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:35.199.155.0,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-3h36.c.k8s-jkns-gci-gce-alpha.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-3h36.c.k8s-jkns-gci-gce-alpha.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:4aed16763bdc994e9fc6e3e0c95cb8ae,SystemUUID:4aed1676-3bdc-994e-9fc6-e3e0c95cb8ae,BootID:461d3e21-d519-43c8-ab39-0c2de0db6ed8,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.40+9884746f0fd338,KubeProxyVersion:v1.27.0-alpha.0.40+9884746f0fd338,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.40_9884746f0fd338],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 registry.k8s.io/sig-storage/snapshot-controller:v6.1.0],SizeBytes:22620891,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-6659^86e580f3-6b73-11ed-b59e-5aeca3ae5a48],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-6659^86e580f3-6b73-11ed-b59e-5aeca3ae5a48,DevicePath:,},},Config:nil,},} Nov 23 21:19:40.172: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-3h36 Nov 23 21:19:40.219: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-3h36 Nov 23 21:19:40.315: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-3h36: error trying to reach service: No agent available Nov 23 21:19:40.315: INFO: Logging node info for node bootstrap-e2e-minion-group-qss2 Nov 23 21:19:40.358: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-qss2 0f567691-be6f-4056-8e45-f5c587fd8fff 15331 0 2022-11-23 20:56:26 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-qss2 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-qss2 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-4070":"bootstrap-e2e-minion-group-qss2","csi-hostpath-ephemeral-7934":"bootstrap-e2e-minion-group-qss2","csi-hostpath-provisioning-1098":"bootstrap-e2e-minion-group-qss2"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-23 20:56:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-23 20:56:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-11-23 21:13:57 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {node-problem-detector Update v1 2022-11-23 21:17:39 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-23 21:19:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gci-gce-alpha/us-west1-b/bootstrap-e2e-minion-group-qss2,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815430144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553286144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-23 21:17:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:28 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-23 21:17:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:28 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-23 21:17:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:28 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2022-11-23 21:17:39 +0000 UTC,LastTransitionTime:2022-11-23 21:07:05 +0000 UTC,Reason:DockerHung,Message:kernel: INFO: task docker:12345 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-23 21:17:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:28 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-23 21:17:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:28 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-23 21:17:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:28 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-23 20:56:39 +0000 UTC,LastTransitionTime:2022-11-23 20:56:39 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-23 21:19:03 +0000 UTC,LastTransitionTime:2022-11-23 20:56:25 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-23 21:19:03 +0000 UTC,LastTransitionTime:2022-11-23 20:56:25 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-23 21:19:03 +0000 UTC,LastTransitionTime:2022-11-23 20:56:25 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-23 21:19:03 +0000 UTC,LastTransitionTime:2022-11-23 20:56:27 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:34.127.127.16,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-qss2.c.k8s-jkns-gci-gce-alpha.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-qss2.c.k8s-jkns-gci-gce-alpha.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:76baa30d5979427855b04f88deaf8671,SystemUUID:76baa30d-5979-4278-55b0-4f88deaf8671,BootID:f794e29b-0541-47d9-932b-8ed3667da969,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.40+9884746f0fd338,KubeProxyVersion:v1.27.0-alpha.0.40+9884746f0fd338,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4c4bb2ffc261dd79041c1fa8a7a979520b4c08d8e535583e8fbbf22690d13bb1 registry.k8s.io/etcd:3.5.5-1],SizeBytes:102440299,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.40_9884746f0fd338],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-volume-expand-652^27b2ea4d-6b73-11ed-a3f5-da4b8a158143],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-volume-expand-652^27b2ea4d-6b73-11ed-a3f5-da4b8a158143,DevicePath:,},},Config:nil,},} Nov 23 21:19:40.358: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-qss2 Nov 23 21:19:40.404: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-qss2 Nov 23 21:19:40.446: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-qss2: error trying to reach service: No agent available [DeferCleanup (Each)] [sig-apps] Deployment tear down framework | framework.go:193 STEP: Destroying namespace "deployment-7447" for this suite. 11/23/22 21:19:40.446
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-apps\]\sDeployment\siterative\srollouts\sshould\seventually\sprogress$'
test/e2e/apps/deployment.go:1079
k8s.io/kubernetes/test/e2e/apps.testIterativeDeployments(0xc003308720?)
test/e2e/apps/deployment.go:1079 +0xa7c
k8s.io/kubernetes/test/e2e/apps.glob..func5.8()
test/e2e/apps/deployment.go:136 +0x1d
There were additional failures detected after the initial failure:
[FAILED]
Nov 23 21:03:47.450: failed to list events in namespace "deployment-7324": Get "https://35.247.28.208/api/v1/namespaces/deployment-7324/events": dial tcp 35.247.28.208:443: connect: connection refused
In [DeferCleanup (Each)] at: test/e2e/framework/debug/dump.go:44
----------
[FAILED]
Nov 23 21:03:47.490: Couldn't delete ns: "deployment-7324": Delete "https://35.247.28.208/api/v1/namespaces/deployment-7324": dial tcp 35.247.28.208:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://35.247.28.208/api/v1/namespaces/deployment-7324", Err:(*net.OpError)(0xc002c67f40)})
In [DeferCleanup (Each)] at: test/e2e/framework/framework.go:370
[BeforeEach] [sig-apps] Deployment
set up framework | framework.go:178
STEP: Creating a kubernetes client 11/23/22 21:03:42.011
Nov 23 21:03:42.012: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Building a namespace api object, basename deployment 11/23/22 21:03:42.014
STEP: Waiting for a default service account to be provisioned in namespace 11/23/22 21:03:42.244
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 11/23/22 21:03:42.427
[BeforeEach] [sig-apps] Deployment
test/e2e/framework/metrics/init/init.go:31
[BeforeEach] [sig-apps] Deployment
test/e2e/apps/deployment.go:91
[It] iterative rollouts should eventually progress
test/e2e/apps/deployment.go:135
Nov 23 21:03:43.216: INFO: Creating deployment "webserver"
Nov 23 21:03:43.309: INFO: 00: scaling deployment "webserver"
Nov 23 21:03:45.539: INFO: 00: scaling down
Nov 23 21:03:45.597: INFO: Updating deployment webserver
Nov 23 21:03:45.624: INFO: 01: triggering a new rollout for deployment "webserver"
Nov 23 21:03:45.751: INFO: Updating deployment webserver
Nov 23 21:03:45.751: INFO: 02: triggering a new rollout for deployment "webserver"
Nov 23 21:03:45.885: INFO: Updating deployment webserver
Nov 23 21:03:47.292: INFO: 03: arbitrarily deleting one or more deployment pods for deployment "webserver"
Nov 23 21:03:47.331: INFO: Unexpected error:
<*url.Error | 0xc0028156e0>: {
Op: "Get",
URL: "https://35.247.28.208/api/v1/namespaces/deployment-7324/pods?labelSelector=name%3Dhttpd",
Err: <*net.OpError | 0xc002755310>{
Op: "dial",
Net: "tcp",
Source: nil,
Addr: <*net.TCPAddr | 0xc003484300>{
IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 35, 247, 28, 208],
Port: 443,
Zone: "",
},
Err: <*os.SyscallError | 0xc001395e60>{
Syscall: "connect",
Err: <syscall.Errno>0x6f,
},
},
}
Nov 23 21:03:47.331: FAIL: Get "https://35.247.28.208/api/v1/namespaces/deployment-7324/pods?labelSelector=name%3Dhttpd": dial tcp 35.247.28.208:443: connect: connection refused
Full Stack Trace
k8s.io/kubernetes/test/e2e/apps.testIterativeDeployments(0xc003308720?)
test/e2e/apps/deployment.go:1079 +0xa7c
k8s.io/kubernetes/test/e2e/apps.glob..func5.8()
test/e2e/apps/deployment.go:136 +0x1d
[AfterEach] [sig-apps] Deployment
test/e2e/apps/deployment.go:84
Nov 23 21:03:47.371: INFO: Could not list Deployments in namespace "deployment-7324": Get "https://35.247.28.208/apis/apps/v1/namespaces/deployment-7324/deployments": dial tcp 35.247.28.208:443: connect: connection refused
[AfterEach] [sig-apps] Deployment
test/e2e/framework/node/init/init.go:32
Nov 23 21:03:47.371: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-apps] Deployment
test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-apps] Deployment
dump namespaces | framework.go:196
STEP: dump namespace information after failure 11/23/22 21:03:47.41
STEP: Collecting events from namespace "deployment-7324". 11/23/22 21:03:47.41
Nov 23 21:03:47.450: INFO: Unexpected error: failed to list events in namespace "deployment-7324":
<*url.Error | 0xc0034846c0>: {
Op: "Get",
URL: "https://35.247.28.208/api/v1/namespaces/deployment-7324/events",
Err: <*net.OpError | 0xc003197720>{
Op: "dial",
Net: "tcp",
Source: nil,
Addr: <*net.TCPAddr | 0xc0033cad50>{
IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 35, 247, 28, 208],
Port: 443,
Zone: "",
},
Err: <*os.SyscallError | 0xc003bd6900>{
Syscall: "connect",
Err: <syscall.Errno>0x6f,
},
},
}
Nov 23 21:03:47.450: FAIL: failed to list events in namespace "deployment-7324": Get "https://35.247.28.208/api/v1/namespaces/deployment-7324/events": dial tcp 35.247.28.208:443: connect: connection refused
Full Stack Trace
k8s.io/kubernetes/test/e2e/framework/debug.dumpEventsInNamespace(0xc003ca65c0, {0xc002fe7bb0, 0xf})
test/e2e/framework/debug/dump.go:44 +0x191
k8s.io/kubernetes/test/e2e/framework/debug.DumpAllNamespaceInfo({0x801de88, 0xc00318a1a0}, {0xc002fe7bb0, 0xf})
test/e2e/framework/debug/dump.go:62 +0x8d
k8s.io/kubernetes/test/e2e/framework/debug/init.init.0.func1.1(0xc003ca6650?, {0xc002fe7bb0?, 0x7fa7740?})
test/e2e/framework/debug/init/init.go:34 +0x32
k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo.func1()
test/e2e/framework/framework.go:274 +0x6d
k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo(0xc0005583c0)
test/e2e/framework/framework.go:271 +0x179
reflect.Value.call({0x6627cc0?, 0xc001789510?, 0xc004c08fb0?}, {0x75b6e72, 0x4}, {0xae73300, 0x0, 0xc00069c088?})
/usr/local/go/src/reflect/value.go:584 +0x8c5
reflect.Value.Call({0x6627cc0?, 0xc001789510?, 0x29449fc?}, {0xae73300?, 0xc004c08f80?, 0xc001a95f80?})
/usr/local/go/src/reflect/value.go:368 +0xbc
[DeferCleanup (Each)] [sig-apps] Deployment
tear down framework | framework.go:193
STEP: Destroying namespace "deployment-7324" for this suite. 11/23/22 21:03:47.45
Nov 23 21:03:47.490: FAIL: Couldn't delete ns: "deployment-7324": Delete "https://35.247.28.208/api/v1/namespaces/deployment-7324": dial tcp 35.247.28.208:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://35.247.28.208/api/v1/namespaces/deployment-7324", Err:(*net.OpError)(0xc002c67f40)})
Full Stack Trace
k8s.io/kubernetes/test/e2e/framework.(*Framework).AfterEach.func1()
test/e2e/framework/framework.go:370 +0x4fe
k8s.io/kubernetes/test/e2e/framework.(*Framework).AfterEach(0xc0005583c0)
test/e2e/framework/framework.go:383 +0x1ca
reflect.Value.call({0x6627cc0?, 0xc001789460?, 0x0?}, {0x75b6e72, 0x4}, {0xae73300, 0x0, 0x0?})
/usr/local/go/src/reflect/value.go:584 +0x8c5
reflect.Value.Call({0x6627cc0?, 0xc001789460?, 0x7fe0bc8?}, {0xae73300?, 0x10000c001c1b501?, 0xc003300000?})
/usr/local/go/src/reflect/value.go:368 +0xbc
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-apps\]\sDeployment\sshould\snot\sdisrupt\sa\scloud\sload\-balancer\'s\sconnectivity\sduring\srollout$'
test/e2e/framework/framework.go:241
k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc00121c4b0)
test/e2e/framework/framework.go:241 +0x96f
There were additional failures detected after the initial failure:
[PANICKED]
Test Panicked
In [AfterEach] at: /usr/local/go/src/runtime/panic.go:260
runtime error: invalid memory address or nil pointer dereference
Full Stack Trace
k8s.io/kubernetes/test/e2e/apps.failureTrap({0x0, 0x0}, {0x0, 0x0})
test/e2e/apps/deployment.go:615 +0x51
k8s.io/kubernetes/test/e2e/apps.glob..func5.1()
test/e2e/apps/deployment.go:85 +0x2f
[BeforeEach] [sig-apps] Deployment
set up framework | framework.go:178
STEP: Creating a kubernetes client 11/23/22 21:35:32.64
Nov 23 21:35:32.640: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Building a namespace api object, basename deployment 11/23/22 21:35:32.643
Nov 23 21:35:32.683: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:35:34.723: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:35:36.723: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:35:38.723: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:35:40.724: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:35:42.724: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:35:44.724: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:35:46.724: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:35:48.724: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:35:50.723: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:35:52.723: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:35:54.724: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:35:56.724: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:35:58.724: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:36:00.723: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:36:02.723: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:36:02.763: INFO: Unexpected error while creating namespace: Post "https://35.247.28.208/api/v1/namespaces": dial tcp 35.247.28.208:443: connect: connection refused
Nov 23 21:36:02.763: INFO: Unexpected error:
<*errors.errorString | 0xc0001cb9a0>: {
s: "timed out waiting for the condition",
}
Nov 23 21:36:02.763: FAIL: timed out waiting for the condition
Full Stack Trace
k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc00121c4b0)
test/e2e/framework/framework.go:241 +0x96f
[AfterEach] [sig-apps] Deployment
test/e2e/apps/deployment.go:84
[AfterEach] [sig-apps] Deployment
test/e2e/framework/node/init/init.go:32
Nov 23 21:36:02.764: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-apps] Deployment
dump namespaces | framework.go:196
STEP: dump namespace information after failure 11/23/22 21:36:02.804
[DeferCleanup (Each)] [sig-apps] Deployment
tear down framework | framework.go:193
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-apps\]\sDeployment\sshould\srun\sthe\slifecycle\sof\sa\sDeployment\s\[Conformance\]$'
test/e2e/apps/deployment.go:390 k8s.io/kubernetes/test/e2e/apps.glob..func5.13() test/e2e/apps/deployment.go:390 +0x22fc
[BeforeEach] [sig-apps] Deployment set up framework | framework.go:178 STEP: Creating a kubernetes client 11/23/22 21:20:32.24 Nov 23 21:20:32.240: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Building a namespace api object, basename deployment 11/23/22 21:20:32.242 STEP: Waiting for a default service account to be provisioned in namespace 11/23/22 21:20:32.444 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 11/23/22 21:20:32.611 [BeforeEach] [sig-apps] Deployment test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-apps] Deployment test/e2e/apps/deployment.go:91 [It] should run the lifecycle of a Deployment [Conformance] test/e2e/apps/deployment.go:185 STEP: creating a Deployment 11/23/22 21:20:34.563 STEP: waiting for Deployment to be created 11/23/22 21:20:34.671 STEP: waiting for all Replicas to be Ready 11/23/22 21:20:34.751 Nov 23 21:20:34.829: INFO: observed Deployment test-deployment in namespace deployment-840 with ReadyReplicas 0 and labels map[test-deployment-static:true] Nov 23 21:20:34.829: INFO: observed Deployment test-deployment in namespace deployment-840 with ReadyReplicas 0 and labels map[test-deployment-static:true] Nov 23 21:20:34.829: INFO: observed Deployment test-deployment in namespace deployment-840 with ReadyReplicas 0 and labels map[test-deployment-static:true] Nov 23 21:20:34.829: INFO: observed Deployment test-deployment in namespace deployment-840 with ReadyReplicas 0 and labels map[test-deployment-static:true] Nov 23 21:20:34.873: INFO: observed Deployment test-deployment in namespace deployment-840 with ReadyReplicas 0 and labels map[test-deployment-static:true] Nov 23 21:20:34.873: INFO: observed Deployment test-deployment in namespace deployment-840 with ReadyReplicas 0 and labels map[test-deployment-static:true] Nov 23 21:20:35.015: INFO: observed Deployment test-deployment in namespace deployment-840 with ReadyReplicas 0 and labels map[test-deployment-static:true] Nov 23 21:20:35.015: INFO: observed Deployment test-deployment in namespace deployment-840 with ReadyReplicas 0 and labels map[test-deployment-static:true] Nov 23 21:20:53.818: INFO: observed Deployment test-deployment in namespace deployment-840 with ReadyReplicas 1 and labels map[test-deployment-static:true] Nov 23 21:20:53.818: INFO: observed Deployment test-deployment in namespace deployment-840 with ReadyReplicas 1 and labels map[test-deployment-static:true] Nov 23 21:20:53.926: INFO: observed Deployment test-deployment in namespace deployment-840 with ReadyReplicas 2 and labels map[test-deployment-static:true] STEP: patching the Deployment 11/23/22 21:20:53.926 W1123 21:20:54.081668 10143 warnings.go:70] unknown field "spec.template.spec.TerminationGracePeriodSeconds" Nov 23 21:20:54.142: INFO: observed event type ADDED STEP: waiting for Replicas to scale 11/23/22 21:20:54.143 Nov 23 21:20:54.236: INFO: observed Deployment test-deployment in namespace deployment-840 with ReadyReplicas 0 Nov 23 21:20:54.236: INFO: observed Deployment test-deployment in namespace deployment-840 with ReadyReplicas 0 Nov 23 21:20:54.236: INFO: observed Deployment test-deployment in namespace deployment-840 with ReadyReplicas 0 Nov 23 21:20:54.236: INFO: observed Deployment test-deployment in namespace deployment-840 with ReadyReplicas 0 Nov 23 21:20:54.237: INFO: observed Deployment test-deployment in namespace deployment-840 with ReadyReplicas 0 Nov 23 21:20:54.238: INFO: observed Deployment test-deployment in namespace deployment-840 with ReadyReplicas 0 Nov 23 21:20:54.238: INFO: observed Deployment test-deployment in namespace deployment-840 with ReadyReplicas 0 Nov 23 21:20:54.238: INFO: observed Deployment test-deployment in namespace deployment-840 with ReadyReplicas 0 Nov 23 21:20:54.239: INFO: observed Deployment test-deployment in namespace deployment-840 with ReadyReplicas 1 Nov 23 21:20:54.239: INFO: observed Deployment test-deployment in namespace deployment-840 with ReadyReplicas 1 Nov 23 21:20:54.239: INFO: observed Deployment test-deployment in namespace deployment-840 with ReadyReplicas 2 Nov 23 21:20:54.239: INFO: observed Deployment test-deployment in namespace deployment-840 with ReadyReplicas 2 Nov 23 21:20:54.239: INFO: observed Deployment test-deployment in namespace deployment-840 with ReadyReplicas 2 Nov 23 21:20:54.239: INFO: observed Deployment test-deployment in namespace deployment-840 with ReadyReplicas 2 Nov 23 21:20:54.239: INFO: observed Deployment test-deployment in namespace deployment-840 with ReadyReplicas 2 Nov 23 21:20:54.239: INFO: observed Deployment test-deployment in namespace deployment-840 with ReadyReplicas 2 Nov 23 21:20:54.404: INFO: observed Deployment test-deployment in namespace deployment-840 with ReadyReplicas 2 Nov 23 21:20:54.404: INFO: observed Deployment test-deployment in namespace deployment-840 with ReadyReplicas 2 Nov 23 21:20:54.766: INFO: observed Deployment test-deployment in namespace deployment-840 with ReadyReplicas 1 Nov 23 21:20:54.766: INFO: observed Deployment test-deployment in namespace deployment-840 with ReadyReplicas 1 Nov 23 21:20:57.651: INFO: observed Deployment test-deployment in namespace deployment-840 with ReadyReplicas 2 Nov 23 21:20:57.651: INFO: observed Deployment test-deployment in namespace deployment-840 with ReadyReplicas 2 Nov 23 21:20:57.810: INFO: observed Deployment test-deployment in namespace deployment-840 with ReadyReplicas 1 STEP: listing Deployments 11/23/22 21:20:57.81 Nov 23 21:20:57.917: INFO: Found test-deployment with labels: map[test-deployment:patched test-deployment-static:true] STEP: updating the Deployment 11/23/22 21:20:57.917 Nov 23 21:20:58.079: INFO: observed Deployment test-deployment in namespace deployment-840 with ReadyReplicas 1 STEP: fetching the DeploymentStatus 11/23/22 21:20:58.08 Nov 23 21:20:58.245: INFO: observed Deployment test-deployment in namespace deployment-840 with ReadyReplicas 1 and labels map[test-deployment:updated test-deployment-static:true] Nov 23 21:20:58.246: INFO: observed Deployment test-deployment in namespace deployment-840 with ReadyReplicas 1 and labels map[test-deployment:updated test-deployment-static:true] Nov 23 21:20:58.302: INFO: observed Deployment test-deployment in namespace deployment-840 with ReadyReplicas 1 and labels map[test-deployment:updated test-deployment-static:true] Nov 23 21:20:58.400: INFO: observed Deployment test-deployment in namespace deployment-840 with ReadyReplicas 1 and labels map[test-deployment:updated test-deployment-static:true] Nov 23 21:20:58.455: INFO: observed Deployment test-deployment in namespace deployment-840 with ReadyReplicas 1 and labels map[test-deployment:updated test-deployment-static:true] Nov 23 21:20:59.846: INFO: observed Deployment test-deployment in namespace deployment-840 with ReadyReplicas 0 and labels map[test-deployment:updated test-deployment-static:true] Nov 23 21:21:00.980: INFO: observed Deployment test-deployment in namespace deployment-840 with ReadyReplicas 1 and labels map[test-deployment:updated test-deployment-static:true] Nov 23 21:23:50.107: INFO: observed Deployment test-deployment in namespace deployment-840 with ReadyReplicas 0 and labels map[test-deployment:updated test-deployment-static:true] Nov 23 21:24:04.205: INFO: observed Deployment test-deployment in namespace deployment-840 with ReadyReplicas 1 and labels map[test-deployment:updated test-deployment-static:true] ------------------------------ Progress Report for Ginkgo Process #12 Automatically polling progress: [sig-apps] Deployment should run the lifecycle of a Deployment [Conformance] (Spec Runtime: 5m2.265s) test/e2e/apps/deployment.go:185 In [It] (Node Runtime: 5m0.001s) test/e2e/apps/deployment.go:185 At [By Step] fetching the DeploymentStatus (Step Runtime: 4m36.425s) test/e2e/apps/deployment.go:365 Spec Goroutine goroutine 2161 [select, 2 minutes] k8s.io/kubernetes/vendor/k8s.io/client-go/tools/watch.UntilWithoutRetry({0x7fe0c00, 0xc0053858c0}, {0x7fbcaa0, 0xc00340c300}, {0xc003895858, 0x1, 0x45d964b800?}) vendor/k8s.io/client-go/tools/watch/until.go:73 k8s.io/kubernetes/vendor/k8s.io/client-go/tools/watch.Until({0x7fe0c00, 0xc0053858c0}, {0xc000dd6850?, 0x7f98da0?}, {0x7facee0?, 0xc00106cca8?}, {0xc003895858, 0x1, 0x1}) vendor/k8s.io/client-go/tools/watch/until.go:114 > k8s.io/kubernetes/test/e2e/apps.glob..func5.13() test/e2e/apps/deployment.go:376 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func3({0xc001f93170, 0xc003465920}) vendor/github.com/onsi/ginkgo/v2/internal/node.go:449 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func2() vendor/github.com/onsi/ginkgo/v2/internal/suite.go:750 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode vendor/github.com/onsi/ginkgo/v2/internal/suite.go:738 ------------------------------ ------------------------------ Progress Report for Ginkgo Process #12 Automatically polling progress: [sig-apps] Deployment should run the lifecycle of a Deployment [Conformance] (Spec Runtime: 5m22.267s) test/e2e/apps/deployment.go:185 In [It] (Node Runtime: 5m20.003s) test/e2e/apps/deployment.go:185 At [By Step] fetching the DeploymentStatus (Step Runtime: 4m56.427s) test/e2e/apps/deployment.go:365 Spec Goroutine goroutine 2161 [select, 3 minutes] k8s.io/kubernetes/vendor/k8s.io/client-go/tools/watch.UntilWithoutRetry({0x7fe0c00, 0xc0053858c0}, {0x7fbcaa0, 0xc00340c300}, {0xc003895858, 0x1, 0x45d964b800?}) vendor/k8s.io/client-go/tools/watch/until.go:73 k8s.io/kubernetes/vendor/k8s.io/client-go/tools/watch.Until({0x7fe0c00, 0xc0053858c0}, {0xc000dd6850?, 0x7f98da0?}, {0x7facee0?, 0xc00106cca8?}, {0xc003895858, 0x1, 0x1}) vendor/k8s.io/client-go/tools/watch/until.go:114 > k8s.io/kubernetes/test/e2e/apps.glob..func5.13() test/e2e/apps/deployment.go:376 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func3({0xc001f93170, 0xc003465920}) vendor/github.com/onsi/ginkgo/v2/internal/node.go:449 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func2() vendor/github.com/onsi/ginkgo/v2/internal/suite.go:750 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode vendor/github.com/onsi/ginkgo/v2/internal/suite.go:738 ------------------------------ Nov 23 21:25:58.167: INFO: Unexpected error: failed to see replicas of test-deployment in namespace deployment-840 scale to requested amount of 2: <*errors.errorString | 0xc00011dd70>: { s: "timed out waiting for the condition", } Nov 23 21:25:58.167: FAIL: failed to see replicas of test-deployment in namespace deployment-840 scale to requested amount of 2: timed out waiting for the condition Full Stack Trace k8s.io/kubernetes/test/e2e/apps.glob..func5.13() test/e2e/apps/deployment.go:390 +0x22fc [AfterEach] [sig-apps] Deployment test/e2e/apps/deployment.go:84 Nov 23 21:25:58.292: INFO: Deployment "test-deployment": &Deployment{ObjectMeta:{test-deployment deployment-840 983b5dfe-125f-4386-98de-ddbabe03b61c 18785 3 2022-11-23 21:20:34 +0000 UTC <nil> <nil> map[test-deployment:updated test-deployment-static:true] map[deployment.kubernetes.io/revision:3] [] [] [{e2e.test Update apps/v1 2022-11-23 21:20:57 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{".":{},"f:test-deployment":{},"f:test-deployment-static":{}}},"f:spec":{"f:progressDeadlineSeconds":{},"f:replicas":{},"f:revisionHistoryLimit":{},"f:selector":{},"f:strategy":{"f:rollingUpdate":{".":{},"f:maxSurge":{},"f:maxUnavailable":{}},"f:type":{}},"f:template":{"f:metadata":{"f:labels":{".":{},"f:test-deployment-static":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"test-deployment\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}}} } {kube-controller-manager Update apps/v1 2022-11-23 21:24:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:deployment.kubernetes.io/revision":{}}},"f:status":{"f:availableReplicas":{},"f:conditions":{".":{},"k:{\"type\":\"Available\"}":{".":{},"f:lastTransitionTime":{},"f:lastUpdateTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Progressing\"}":{".":{},"f:lastTransitionTime":{},"f:lastUpdateTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:observedGeneration":{},"f:readyReplicas":{},"f:replicas":{},"f:unavailableReplicas":{},"f:updatedReplicas":{}}} status}]},Spec:DeploymentSpec{Replicas:*2,Selector:&v1.LabelSelector{MatchLabels:map[string]string{test-deployment-static: true,},MatchExpressions:[]LabelSelectorRequirement{},},Template:{{ 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[test-deployment-static:true] map[] [] [] []} {[] [] [{test-deployment registry.k8s.io/e2e-test-images/httpd:2.4.38-4 [] [] [] [] [] {map[] map[] []} [] [] nil nil nil nil /dev/termination-log File IfNotPresent SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,} false false false}] [] Always 0xc001352368 <nil> ClusterFirst map[] <nil> false false false <nil> &PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,} [] nil default-scheduler [] [] <nil> nil [] <nil> <nil> <nil> map[] [] <nil> nil <nil> [] []}},Strategy:DeploymentStrategy{Type:RollingUpdate,RollingUpdate:&RollingUpdateDeployment{MaxUnavailable:25%!,(MISSING)MaxSurge:25%!,(MISSING)},},MinReadySeconds:0,RevisionHistoryLimit:*10,Paused:false,ProgressDeadlineSeconds:*600,},Status:DeploymentStatus{ObservedGeneration:3,Replicas:3,UpdatedReplicas:1,AvailableReplicas:1,UnavailableReplicas:2,Conditions:[]DeploymentCondition{DeploymentCondition{Type:Available,Status:False,Reason:MinimumReplicasUnavailable,Message:Deployment does not have minimum availability.,LastUpdateTime:2022-11-23 21:20:58 +0000 UTC,LastTransitionTime:2022-11-23 21:20:58 +0000 UTC,},DeploymentCondition{Type:Progressing,Status:True,Reason:ReplicaSetUpdated,Message:ReplicaSet "test-deployment-7b7876f9d6" is progressing.,LastUpdateTime:2022-11-23 21:24:04 +0000 UTC,LastTransitionTime:2022-11-23 21:20:34 +0000 UTC,},},ReadyReplicas:1,CollisionCount:nil,},} Nov 23 21:25:58.389: INFO: New ReplicaSet "test-deployment-7b7876f9d6" of Deployment "test-deployment": &ReplicaSet{ObjectMeta:{test-deployment-7b7876f9d6 deployment-840 f28bef30-fd10-455b-b9a7-4e5946721ed5 16712 1 2022-11-23 21:20:58 +0000 UTC <nil> <nil> map[pod-template-hash:7b7876f9d6 test-deployment-static:true] map[deployment.kubernetes.io/desired-replicas:2 deployment.kubernetes.io/max-replicas:3 deployment.kubernetes.io/revision:3] [{apps/v1 Deployment test-deployment 983b5dfe-125f-4386-98de-ddbabe03b61c 0xc003a0c387 0xc003a0c388}] [] [{kube-controller-manager Update apps/v1 2022-11-23 21:20:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:deployment.kubernetes.io/desired-replicas":{},"f:deployment.kubernetes.io/max-replicas":{},"f:deployment.kubernetes.io/revision":{}},"f:labels":{".":{},"f:pod-template-hash":{},"f:test-deployment-static":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"983b5dfe-125f-4386-98de-ddbabe03b61c\"}":{}}},"f:spec":{"f:replicas":{},"f:selector":{},"f:template":{"f:metadata":{"f:labels":{".":{},"f:pod-template-hash":{},"f:test-deployment-static":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"test-deployment\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}}} } {kube-controller-manager Update apps/v1 2022-11-23 21:20:58 +0000 UTC FieldsV1 {"f:status":{"f:fullyLabeledReplicas":{},"f:observedGeneration":{},"f:replicas":{}}} status}]},Spec:ReplicaSetSpec{Replicas:*1,Selector:&v1.LabelSelector{MatchLabels:map[string]string{pod-template-hash: 7b7876f9d6,test-deployment-static: true,},MatchExpressions:[]LabelSelectorRequirement{},},Template:{{ 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[pod-template-hash:7b7876f9d6 test-deployment-static:true] map[] [] [] []} {[] [] [{test-deployment registry.k8s.io/e2e-test-images/httpd:2.4.38-4 [] [] [] [] [] {map[] map[] []} [] [] nil nil nil nil /dev/termination-log File IfNotPresent SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,} false false false}] [] Always 0xc003a0c440 <nil> ClusterFirst map[] <nil> false false false <nil> &PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,} [] nil default-scheduler [] [] <nil> nil [] <nil> <nil> <nil> map[] [] <nil> nil <nil> [] []}},MinReadySeconds:0,},Status:ReplicaSetStatus{Replicas:1,FullyLabeledReplicas:1,ObservedGeneration:1,ReadyReplicas:0,AvailableReplicas:0,Conditions:[]ReplicaSetCondition{},},} Nov 23 21:25:58.389: INFO: All old ReplicaSets of Deployment "test-deployment": Nov 23 21:25:58.389: INFO: &ReplicaSet{ObjectMeta:{test-deployment-f4dbc4647 deployment-840 116bd8a0-d080-4510-9e7d-26ffc68703a9 16670 3 2022-11-23 21:20:34 +0000 UTC <nil> <nil> map[pod-template-hash:f4dbc4647 test-deployment-static:true] map[deployment.kubernetes.io/desired-replicas:1 deployment.kubernetes.io/max-replicas:2 deployment.kubernetes.io/revision:1] [{apps/v1 Deployment test-deployment 983b5dfe-125f-4386-98de-ddbabe03b61c 0xc003a0c5e7 0xc003a0c5e8}] [] [{kube-controller-manager Update apps/v1 2022-11-23 21:20:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:deployment.kubernetes.io/desired-replicas":{},"f:deployment.kubernetes.io/max-replicas":{},"f:deployment.kubernetes.io/revision":{}},"f:labels":{".":{},"f:pod-template-hash":{},"f:test-deployment-static":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"983b5dfe-125f-4386-98de-ddbabe03b61c\"}":{}}},"f:spec":{"f:replicas":{},"f:selector":{},"f:template":{"f:metadata":{"f:labels":{".":{},"f:pod-template-hash":{},"f:test-deployment-static":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"test-deployment\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}}} } {kube-controller-manager Update apps/v1 2022-11-23 21:20:57 +0000 UTC FieldsV1 {"f:status":{"f:observedGeneration":{},"f:replicas":{}}} status}]},Spec:ReplicaSetSpec{Replicas:*0,Selector:&v1.LabelSelector{MatchLabels:map[string]string{pod-template-hash: f4dbc4647,test-deployment-static: true,},MatchExpressions:[]LabelSelectorRequirement{},},Template:{{ 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[pod-template-hash:f4dbc4647 test-deployment-static:true] map[] [] [] []} {[] [] [{test-deployment registry.k8s.io/e2e-test-images/agnhost:2.43 [] [] [] [] [] {map[] map[] []} [] [] nil nil nil nil /dev/termination-log File IfNotPresent SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,} false false false}] [] Always 0xc003a0c6e0 <nil> ClusterFirst map[] <nil> false false false <nil> &PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,} [] nil default-scheduler [] [] <nil> nil [] <nil> <nil> <nil> map[] [] <nil> nil <nil> [] []}},MinReadySeconds:0,},Status:ReplicaSetStatus{Replicas:0,FullyLabeledReplicas:0,ObservedGeneration:3,ReadyReplicas:0,AvailableReplicas:0,Conditions:[]ReplicaSetCondition{},},} Nov 23 21:25:58.389: INFO: &ReplicaSet{ObjectMeta:{test-deployment-7df74c55ff deployment-840 16922ba0-8ccc-4876-8b31-c29c1981617a 18784 2 2022-11-23 21:20:54 +0000 UTC <nil> <nil> map[pod-template-hash:7df74c55ff test-deployment-static:true] map[deployment.kubernetes.io/desired-replicas:2 deployment.kubernetes.io/max-replicas:3 deployment.kubernetes.io/revision:2] [{apps/v1 Deployment test-deployment 983b5dfe-125f-4386-98de-ddbabe03b61c 0xc003a0c4a7 0xc003a0c4a8}] [] [{kube-controller-manager Update apps/v1 2022-11-23 21:20:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:deployment.kubernetes.io/desired-replicas":{},"f:deployment.kubernetes.io/max-replicas":{},"f:deployment.kubernetes.io/revision":{}},"f:labels":{".":{},"f:pod-template-hash":{},"f:test-deployment-static":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"983b5dfe-125f-4386-98de-ddbabe03b61c\"}":{}}},"f:spec":{"f:replicas":{},"f:selector":{},"f:template":{"f:metadata":{"f:labels":{".":{},"f:pod-template-hash":{},"f:test-deployment-static":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"test-deployment\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}}} } {kube-controller-manager Update apps/v1 2022-11-23 21:24:04 +0000 UTC FieldsV1 {"f:status":{"f:availableReplicas":{},"f:fullyLabeledReplicas":{},"f:observedGeneration":{},"f:readyReplicas":{},"f:replicas":{}}} status}]},Spec:ReplicaSetSpec{Replicas:*2,Selector:&v1.LabelSelector{MatchLabels:map[string]string{pod-template-hash: 7df74c55ff,test-deployment-static: true,},MatchExpressions:[]LabelSelectorRequirement{},},Template:{{ 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[pod-template-hash:7df74c55ff test-deployment-static:true] map[] [] [] []} {[] [] [{test-deployment registry.k8s.io/pause:3.9 [] [] [] [] [] {map[] map[] []} [] [] nil nil nil nil /dev/termination-log File IfNotPresent SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,} false false false}] [] Always 0xc003a0c580 <nil> ClusterFirst map[] <nil> false false false <nil> &PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,} [] nil default-scheduler [] [] <nil> nil [] <nil> <nil> <nil> map[] [] <nil> nil <nil> [] []}},MinReadySeconds:0,},Status:ReplicaSetStatus{Replicas:2,FullyLabeledReplicas:2,ObservedGeneration:2,ReadyReplicas:1,AvailableReplicas:1,Conditions:[]ReplicaSetCondition{},},} Nov 23 21:25:58.474: INFO: Pod "test-deployment-7b7876f9d6-hl5ks" is not available: &Pod{ObjectMeta:{test-deployment-7b7876f9d6-hl5ks test-deployment-7b7876f9d6- deployment-840 80fce6a3-27eb-4a29-bd50-a0a67164c9dc 16703 0 2022-11-23 21:20:58 +0000 UTC <nil> <nil> map[pod-template-hash:7b7876f9d6 test-deployment-static:true] map[] [{apps/v1 ReplicaSet test-deployment-7b7876f9d6 f28bef30-fd10-455b-b9a7-4e5946721ed5 0xc003a0ce27 0xc003a0ce28}] [] [{kube-controller-manager Update v1 2022-11-23 21:20:58 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:pod-template-hash":{},"f:test-deployment-static":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"f28bef30-fd10-455b-b9a7-4e5946721ed5\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"test-deployment\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}} }]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-qr7c2,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:test-deployment,Image:registry.k8s.io/e2e-test-images/httpd:2.4.38-4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-qr7c2,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*1,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,OS:nil,HostUsers:nil,SchedulingGates:[]PodSchedulingGate{},ResourceClaims:[]PodResourceClaim{},},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{},Message:,Reason:,HostIP:,PodIP:,StartTime:<nil>,ContainerStatuses:[]ContainerStatus{},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{},EphemeralContainerStatuses:[]ContainerStatus{},},} Nov 23 21:25:58.474: INFO: Pod "test-deployment-7df74c55ff-cjjjm" is available: &Pod{ObjectMeta:{test-deployment-7df74c55ff-cjjjm test-deployment-7df74c55ff- deployment-840 4bb4839f-b67e-4198-9f46-925bd061eb5d 18782 0 2022-11-23 21:20:54 +0000 UTC <nil> <nil> map[pod-template-hash:7df74c55ff test-deployment-static:true] map[] [{apps/v1 ReplicaSet test-deployment-7df74c55ff 16922ba0-8ccc-4876-8b31-c29c1981617a 0xc003a0cf67 0xc003a0cf68}] [] [{kube-controller-manager Update v1 2022-11-23 21:20:54 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:pod-template-hash":{},"f:test-deployment-static":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"16922ba0-8ccc-4876-8b31-c29c1981617a\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"test-deployment\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}} } {kubelet Update v1 2022-11-23 21:24:04 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\&