go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\slisting\smutating\swebhooks\sshould\swork\s\[Conformance\]$'
test/e2e/apimachinery/webhook.go:826 k8s.io/kubernetes/test/e2e/apimachinery.deployWebhookAndService(0xc000a0fe00, {0xc00174a900, 0x2c}, 0xc0032a47d0, 0x20fb, 0x20fc) test/e2e/apimachinery/webhook.go:826 +0xed2 k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.1() test/e2e/apimachinery/webhook.go:102 +0x226 There were additional failures detected after the initial failure: [FAILED] Nov 26 23:26:08.946: failed to list events in namespace "webhook-9834": Get "https://34.83.128.61/api/v1/namespaces/webhook-9834/events": dial tcp 34.83.128.61:443: connect: connection refused In [DeferCleanup (Each)] at: test/e2e/framework/debug/dump.go:44 ---------- [FAILED] Nov 26 23:26:09.026: Couldn't delete ns: "webhook-9834": Delete "https://34.83.128.61/api/v1/namespaces/webhook-9834": dial tcp 34.83.128.61:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://34.83.128.61/api/v1/namespaces/webhook-9834", Err:(*net.OpError)(0xc0032a48c0)}),Couldn't delete ns: "webhook-9834-markers": Delete "https://34.83.128.61/api/v1/namespaces/webhook-9834-markers": dial tcp 34.83.128.61:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://34.83.128.61/api/v1/namespaces/webhook-9834-markers", Err:(*net.OpError)(0xc00341afa0)}) In [DeferCleanup (Each)] at: test/e2e/framework/framework.go:370from junit_01.xml
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] set up framework | framework.go:178 STEP: Creating a kubernetes client 11/26/22 23:21:38.18 Nov 26 23:21:38.180: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Building a namespace api object, basename webhook 11/26/22 23:21:38.182 Nov 26 23:21:38.221: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:21:40.261: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:21:42.261: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:21:44.262: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:21:46.261: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:21:48.262: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:21:50.262: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:21:52.262: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:21:54.261: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused STEP: Waiting for a default service account to be provisioned in namespace 11/26/22 23:23:41.727 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 11/26/22 23:23:41.81 [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/apimachinery/webhook.go:90 STEP: Setting up server cert 11/26/22 23:23:42.025 STEP: Create role binding to let webhook read extension-apiserver-authentication 11/26/22 23:23:42.376 STEP: Deploying the webhook pod 11/26/22 23:23:42.421 STEP: Wait for the deployment to be ready 11/26/22 23:23:42.522 Nov 26 23:23:42.668: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:23:44.711: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:23:46.721: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:23:48.729: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:23:50.737: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:23:52.725: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:23:54.755: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:23:56.779: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:23:58.726: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:24:00.747: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:24:02.746: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:24:04.842: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:24:06.771: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:24:08.770: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:24:10.894: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:24:12.951: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:24:14.732: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:25:01.307: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:25:02.711: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:25:04.712: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:25:06.711: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:25:08.719: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:25:10.763: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:25:12.712: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:25:14.714: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:25:16.711: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:25:18.710: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:25:20.712: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:25:22.712: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:25:24.712: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:25:26.711: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:25:28.710: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:25:30.711: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:25:32.720: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:25:34.712: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:25:36.711: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:25:38.713: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:25:40.711: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:25:42.712: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:25:44.713: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:25:46.712: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:25:48.712: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:25:50.711: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:25:52.712: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:25:54.713: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:25:56.711: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:25:58.715: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:26:00.711: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:26:02.711: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:26:04.713: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:26:06.712: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 42, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:26:08.709: INFO: Unexpected error: waiting for the deployment status valid%!(EXTRA string=registry.k8s.io/e2e-test-images/agnhost:2.43, string=sample-webhook-deployment, string=webhook-9834): <*errors.errorString | 0xc000972b00>: { s: "error waiting for deployment \"sample-webhook-deployment\" status to match expectation: Get \"https://34.83.128.61/apis/apps/v1/namespaces/webhook-9834/deployments/sample-webhook-deployment\": dial tcp 34.83.128.61:443: connect: connection refused", } Nov 26 23:26:08.709: FAIL: waiting for the deployment status valid%!(EXTRA string=registry.k8s.io/e2e-test-images/agnhost:2.43, string=sample-webhook-deployment, string=webhook-9834): error waiting for deployment "sample-webhook-deployment" status to match expectation: Get "https://34.83.128.61/apis/apps/v1/namespaces/webhook-9834/deployments/sample-webhook-deployment": dial tcp 34.83.128.61:443: connect: connection refused Full Stack Trace k8s.io/kubernetes/test/e2e/apimachinery.deployWebhookAndService(0xc000a0fe00, {0xc00174a900, 0x2c}, 0xc0032a47d0, 0x20fb, 0x20fc) test/e2e/apimachinery/webhook.go:826 +0xed2 k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.1() test/e2e/apimachinery/webhook.go:102 +0x226 [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/framework/node/init/init.go:32 Nov 26 23:26:08.710: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/apimachinery/webhook.go:105 [DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] dump namespaces | framework.go:196 STEP: dump namespace information after failure 11/26/22 23:26:08.907 STEP: Collecting events from namespace "webhook-9834". 11/26/22 23:26:08.907 Nov 26 23:26:08.946: INFO: Unexpected error: failed to list events in namespace "webhook-9834": <*url.Error | 0xc003ae4cf0>: { Op: "Get", URL: "https://34.83.128.61/api/v1/namespaces/webhook-9834/events", Err: <*net.OpError | 0xc00341abe0>{ Op: "dial", Net: "tcp", Source: nil, Addr: <*net.TCPAddr | 0xc002d258f0>{ IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 34, 83, 128, 61], Port: 443, Zone: "", }, Err: <*os.SyscallError | 0xc000fb6dc0>{ Syscall: "connect", Err: <syscall.Errno>0x6f, }, }, } Nov 26 23:26:08.946: FAIL: failed to list events in namespace "webhook-9834": Get "https://34.83.128.61/api/v1/namespaces/webhook-9834/events": dial tcp 34.83.128.61:443: connect: connection refused Full Stack Trace k8s.io/kubernetes/test/e2e/framework/debug.dumpEventsInNamespace(0xc00174e5c0, {0xc0034fa8a0, 0xc}) test/e2e/framework/debug/dump.go:44 +0x191 k8s.io/kubernetes/test/e2e/framework/debug.DumpAllNamespaceInfo({0x801de88, 0xc0024c6340}, {0xc0034fa8a0, 0xc}) test/e2e/framework/debug/dump.go:62 +0x8d k8s.io/kubernetes/test/e2e/framework/debug/init.init.0.func1.1(0xc00174e650?, {0xc0034fa8a0?, 0x7fa7740?}) test/e2e/framework/debug/init/init.go:34 +0x32 k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo.func1() test/e2e/framework/framework.go:274 +0x6d k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo(0xc000a0fe00) test/e2e/framework/framework.go:271 +0x179 reflect.Value.call({0x6627cc0?, 0xc001709240?, 0xc004238fb0?}, {0x75b6e72, 0x4}, {0xae73300, 0x0, 0xc0043b9268?}) /usr/local/go/src/reflect/value.go:584 +0x8c5 reflect.Value.Call({0x6627cc0?, 0xc001709240?, 0x29449fc?}, {0xae73300?, 0xc004238f80?, 0x2a6d786?}) /usr/local/go/src/reflect/value.go:368 +0xbc [DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] tear down framework | framework.go:193 STEP: Destroying namespace "webhook-9834" for this suite. 11/26/22 23:26:08.947 STEP: Destroying namespace "webhook-9834-markers" for this suite. 11/26/22 23:26:08.986 Nov 26 23:26:09.026: FAIL: Couldn't delete ns: "webhook-9834": Delete "https://34.83.128.61/api/v1/namespaces/webhook-9834": dial tcp 34.83.128.61:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://34.83.128.61/api/v1/namespaces/webhook-9834", Err:(*net.OpError)(0xc0032a48c0)}),Couldn't delete ns: "webhook-9834-markers": Delete "https://34.83.128.61/api/v1/namespaces/webhook-9834-markers": dial tcp 34.83.128.61:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://34.83.128.61/api/v1/namespaces/webhook-9834-markers", Err:(*net.OpError)(0xc00341afa0)}) Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).AfterEach.func1() test/e2e/framework/framework.go:370 +0x4fe k8s.io/kubernetes/test/e2e/framework.(*Framework).AfterEach(0xc000a0fe00) test/e2e/framework/framework.go:383 +0x1ca reflect.Value.call({0x6627cc0?, 0xc001709170?, 0xc000918fb0?}, {0x75b6e72, 0x4}, {0xae73300, 0x0, 0x0?}) /usr/local/go/src/reflect/value.go:584 +0x8c5 reflect.Value.Call({0x6627cc0?, 0xc001709170?, 0x0?}, {0xae73300?, 0x5?, 0xc003a9ef60?}) /usr/local/go/src/reflect/value.go:368 +0xbc
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\spatching\/updating\sa\smutating\swebhook\sshould\swork\s\[Conformance\]$'
test/e2e/framework/framework.go:241 k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc000b71e00) test/e2e/framework/framework.go:241 +0x96ffrom junit_01.xml
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] set up framework | framework.go:178 STEP: Creating a kubernetes client 11/26/22 23:39:22.2 Nov 26 23:39:22.200: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Building a namespace api object, basename webhook 11/26/22 23:39:22.201 Nov 26 23:41:22.258: INFO: Unexpected error: <*fmt.wrapError | 0xc002b56020>: { msg: "wait for service account \"default\" in namespace \"webhook-9414\": timed out waiting for the condition", err: <*errors.errorString | 0xc000305cb0>{ s: "timed out waiting for the condition", }, } Nov 26 23:41:22.258: FAIL: wait for service account "default" in namespace "webhook-9414": timed out waiting for the condition Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc000b71e00) test/e2e/framework/framework.go:241 +0x96f [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/framework/node/init/init.go:32 Nov 26 23:41:22.259: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/apimachinery/webhook.go:105 [DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] dump namespaces | framework.go:196 STEP: dump namespace information after failure 11/26/22 23:41:22.479 STEP: Collecting events from namespace "webhook-9414". 11/26/22 23:41:22.479 STEP: Found 0 events. 11/26/22 23:41:57.475 Nov 26 23:41:57.537: INFO: POD NODE PHASE GRACE CONDITIONS Nov 26 23:41:57.537: INFO: Nov 26 23:41:57.764: INFO: Logging node info for node bootstrap-e2e-master Nov 26 23:41:57.816: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master c85fbb04-d865-42ae-b40a-365f0873d077 12050 0 2022-11-26 23:10:47 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 23:10:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-11-26 23:11:08 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-11-26 23:11:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-11-26 23:39:53 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-6-1-5-ctl-skew/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3858374656 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3596230656 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 23:11:08 +0000 UTC,LastTransitionTime:2022-11-26 23:11:08 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 23:39:53 +0000 UTC,LastTransitionTime:2022-11-26 23:10:47 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 23:39:53 +0000 UTC,LastTransitionTime:2022-11-26 23:10:47 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 23:39:53 +0000 UTC,LastTransitionTime:2022-11-26 23:10:47 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 23:39:53 +0000 UTC,LastTransitionTime:2022-11-26 23:11:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:34.83.128.61,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:51f618a4ea82aa4d3795e4cfa76e3a28,SystemUUID:51f618a4-ea82-aa4d-3795-e4cfa76e3a28,BootID:eb1eb4fb-e105-4d49-9289-0d31902f8c4d,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:135160272,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:124990265,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:57660216,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:2c111f004bec24888d8cfa2a812a38fb8341350abac67dcd0ac64e709dfe389c registry.k8s.io/kas-network-proxy/proxy-server:v0.0.33],SizeBytes:22020129,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 26 23:41:57.817: INFO: Logging kubelet events for node bootstrap-e2e-master Nov 26 23:41:57.923: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-master Nov 26 23:41:57.995: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-master: error trying to reach service: No agent available Nov 26 23:41:57.995: INFO: Logging node info for node bootstrap-e2e-minion-group-dr7t Nov 26 23:41:58.044: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-dr7t b4041686-ad54-48f5-95c3-e848d9a8f0a7 12244 0 2022-11-26 23:10:49 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-dr7t kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-dr7t topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-5218":"bootstrap-e2e-minion-group-dr7t","csi-hostpath-ephemeral-5883":"bootstrap-e2e-minion-group-dr7t","csi-hostpath-ephemeral-8027":"bootstrap-e2e-minion-group-dr7t","csi-hostpath-volume-expand-3788":"bootstrap-e2e-minion-group-dr7t","csi-mock-csi-mock-volumes-7211":"bootstrap-e2e-minion-group-dr7t"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 23:10:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 23:10:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-11-26 23:30:04 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2022-11-26 23:39:41 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-26 23:41:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-6-1-5-ctl-skew/us-west1-b/bootstrap-e2e-minion-group-dr7t,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 23:39:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 23:39:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 23:39:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 23:39:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 23:39:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 23:39:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 23:39:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 23:11:08 +0000 UTC,LastTransitionTime:2022-11-26 23:11:08 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 23:41:10 +0000 UTC,LastTransitionTime:2022-11-26 23:10:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 23:41:10 +0000 UTC,LastTransitionTime:2022-11-26 23:10:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 23:41:10 +0000 UTC,LastTransitionTime:2022-11-26 23:10:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 23:41:10 +0000 UTC,LastTransitionTime:2022-11-26 23:10:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:35.185.223.63,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-dr7t.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-dr7t.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:29f409e413f0ebfffc6ee0c012a074c7,SystemUUID:29f409e4-13f0-ebff-fc6e-e0c012a074c7,BootID:a3bfef7b-2d61-4ac5-a15e-34631edb66c9,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 26 23:41:58.045: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-dr7t Nov 26 23:41:58.121: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-dr7t Nov 26 23:41:58.209: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-dr7t: error trying to reach service: No agent available Nov 26 23:41:58.209: INFO: Logging node info for node bootstrap-e2e-minion-group-l8ht Nov 26 23:41:58.266: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-l8ht 3e5210d0-ba6b-4f56-896c-40aaae5093d0 12052 0 2022-11-26 23:10:52 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-l8ht kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-l8ht topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-2215":"bootstrap-e2e-minion-group-l8ht","csi-hostpath-volume-expand-7512":"bootstrap-e2e-minion-group-l8ht","csi-mock-csi-mock-volumes-2107":"bootstrap-e2e-minion-group-l8ht","csi-mock-csi-mock-volumes-355":"bootstrap-e2e-minion-group-l8ht"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 23:10:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 23:10:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-11-26 23:36:53 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {node-problem-detector Update v1 2022-11-26 23:39:41 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-26 23:39:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-6-1-5-ctl-skew/us-west1-b/bootstrap-e2e-minion-group-l8ht,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 23:39:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 23:39:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 23:39:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 23:39:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 23:39:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 23:39:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 23:39:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 23:11:08 +0000 UTC,LastTransitionTime:2022-11-26 23:11:08 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 23:38:54 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 23:38:54 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 23:38:54 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 23:38:54 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:34.168.47.71,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-l8ht.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-l8ht.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:89b0fd3f78d194fccba6eb2ce27680f6,SystemUUID:89b0fd3f-78d1-94fc-cba6-eb2ce27680f6,BootID:ec1fa0a7-81b7-48ec-8da0-cc1b45a14fc8,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-55^28d8d761-6de0-11ed-8c44-7ec558aa6670],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-55^28d8d761-6de0-11ed-8c44-7ec558aa6670,DevicePath:,},},Config:nil,},} Nov 26 23:41:58.266: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-l8ht Nov 26 23:41:58.347: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-l8ht Nov 26 23:41:58.487: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-l8ht: error trying to reach service: No agent available Nov 26 23:41:58.487: INFO: Logging node info for node bootstrap-e2e-minion-group-n9b1 Nov 26 23:41:58.576: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-n9b1 796907e0-52c8-4c84-815a-6442939836c4 12338 0 2022-11-26 23:10:52 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-n9b1 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-n9b1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-5727":"bootstrap-e2e-minion-group-n9b1","csi-hostpath-provisioning-6336":"bootstrap-e2e-minion-group-n9b1","csi-mock-csi-mock-volumes-7584":"bootstrap-e2e-minion-group-n9b1"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 23:10:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 23:10:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-11-26 23:36:53 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {node-problem-detector Update v1 2022-11-26 23:39:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-26 23:41:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-6-1-5-ctl-skew/us-west1-b/bootstrap-e2e-minion-group-n9b1,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 23:39:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 23:39:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 23:39:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 23:39:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 23:39:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 23:39:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 23:39:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 23:11:08 +0000 UTC,LastTransitionTime:2022-11-26 23:11:08 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 23:38:59 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 23:38:59 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 23:38:59 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 23:38:59 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.145.73.48,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-n9b1.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-n9b1.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:47bcd2b143b08ae3cf2e280a7c6e673a,SystemUUID:47bcd2b1-43b0-8ae3-cf2e-280a7c6e673a,BootID:c567f407-918f-4298-a12f-a33a4e211fcf,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 registry.k8s.io/sig-storage/snapshot-controller:v6.1.0],SizeBytes:22620891,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-5727^70b85a3d-6de1-11ed-852d-36e7a9ac0592 kubernetes.io/csi/csi-hostpath-provisioning-169^c8e3d50b-6de0-11ed-aed4-6a12d5ab5936],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-5727^70b85a3d-6de1-11ed-852d-36e7a9ac0592,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-169^c8e3d50b-6de0-11ed-aed4-6a12d5ab5936,DevicePath:,},},Config:nil,},} Nov 26 23:41:58.576: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-n9b1 Nov 26 23:41:58.694: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-n9b1 Nov 26 23:41:58.764: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-n9b1: error trying to reach service: No agent available [DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] tear down framework | framework.go:193 STEP: Destroying namespace "webhook-9414" for this suite. 11/26/22 23:41:58.765
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\spatching\/updating\sa\svalidating\swebhook\sshould\swork\s\[Conformance\]$'
test/e2e/framework/framework.go:241 k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc0010f5e00) test/e2e/framework/framework.go:241 +0x96f There were additional failures detected after the initial failure: [PANICKED] Test Panicked In [AfterEach] at: /usr/local/go/src/runtime/panic.go:260 runtime error: invalid memory address or nil pointer dereference Full Stack Trace k8s.io/kubernetes/test/e2e/apimachinery.cleanWebhookTest({0x0, 0x0}, {0x0, 0x0}) test/e2e/apimachinery/webhook.go:1680 +0x46 k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.2() test/e2e/apimachinery/webhook.go:106 +0x2ffrom junit_01.xml
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] set up framework | framework.go:178 STEP: Creating a kubernetes client 11/26/22 23:28:15.969 Nov 26 23:28:15.969: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Building a namespace api object, basename webhook 11/26/22 23:28:15.971 ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:28:16.010: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:28:18.050: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:28:20.050: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:28:22.050: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:28:24.050: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:28:26.051: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:28:28.050: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:28:30.051: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:28:32.050: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:28:34.050: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:28:36.050: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:28:38.050: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:28:40.050: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:28:42.050: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:28:44.050: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:28:46.050: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:28:46.090: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:28:46.090: INFO: Unexpected error: <*errors.errorString | 0xc000205d10>: { s: "timed out waiting for the condition", } Nov 26 23:28:46.090: FAIL: timed out waiting for the condition Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc0010f5e00) test/e2e/framework/framework.go:241 +0x96f [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/framework/node/init/init.go:32 Nov 26 23:28:46.090: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready ERROR: get pod list in provisioning-5952-4707: Get "https://34.83.128.61/api/v1/namespaces/provisioning-5952-4707/pods": dial tcp 34.83.128.61:443: connect: connection refused [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/apimachinery/webhook.go:105 [DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] dump namespaces | framework.go:196 STEP: dump namespace information after failure 11/26/22 23:28:46.13 [DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] tear down framework | framework.go:193
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\sshould\sbe\sable\sto\sdeny\sattaching\spod\s\[Conformance\]$'
test/e2e/apimachinery/webhook.go:826 k8s.io/kubernetes/test/e2e/apimachinery.deployWebhookAndService(0xc000b71e00, {0xc00193a450, 0x2c}, 0xc001c4b900, 0x20fb, 0x20fc) test/e2e/apimachinery/webhook.go:826 +0xed2 k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.1() test/e2e/apimachinery/webhook.go:102 +0x226from junit_01.xml
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] set up framework | framework.go:178 STEP: Creating a kubernetes client 11/26/22 23:36:54.241 Nov 26 23:36:54.241: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Building a namespace api object, basename webhook 11/26/22 23:36:54.242 STEP: Waiting for a default service account to be provisioned in namespace 11/26/22 23:36:54.373 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 11/26/22 23:36:54.51 [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/apimachinery/webhook.go:90 STEP: Setting up server cert 11/26/22 23:37:00.23 STEP: Create role binding to let webhook read extension-apiserver-authentication 11/26/22 23:37:01.148 Nov 26 23:37:01.358: INFO: role binding webhook-auth-reader already exists STEP: Deploying the webhook pod 11/26/22 23:37:01.358 STEP: Wait for the deployment to be ready 11/26/22 23:37:01.812 Nov 26 23:37:02.207: INFO: deployment "sample-webhook-deployment" doesn't have the required revision set Nov 26 23:37:04.790: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 37, 2, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 37, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 37, 2, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 37, 1, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:37:06.841: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 37, 2, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 37, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 37, 2, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 37, 1, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:38:08.833: INFO: Unexpected error: waiting for the deployment status valid%!(EXTRA string=registry.k8s.io/e2e-test-images/agnhost:2.43, string=sample-webhook-deployment, string=webhook-8715): <*errors.errorString | 0xc001276090>: { s: "error waiting for deployment \"sample-webhook-deployment\" status to match expectation: Get \"https://34.83.128.61/apis/apps/v1/namespaces/webhook-8715/deployments/sample-webhook-deployment\": stream error: stream ID 429; INTERNAL_ERROR; received from peer", } Nov 26 23:38:08.833: FAIL: waiting for the deployment status valid%!(EXTRA string=registry.k8s.io/e2e-test-images/agnhost:2.43, string=sample-webhook-deployment, string=webhook-8715): error waiting for deployment "sample-webhook-deployment" status to match expectation: Get "https://34.83.128.61/apis/apps/v1/namespaces/webhook-8715/deployments/sample-webhook-deployment": stream error: stream ID 429; INTERNAL_ERROR; received from peer Full Stack Trace k8s.io/kubernetes/test/e2e/apimachinery.deployWebhookAndService(0xc000b71e00, {0xc00193a450, 0x2c}, 0xc001c4b900, 0x20fb, 0x20fc) test/e2e/apimachinery/webhook.go:826 +0xed2 k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.1() test/e2e/apimachinery/webhook.go:102 +0x226 [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/framework/node/init/init.go:32 Nov 26 23:38:08.834: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/apimachinery/webhook.go:105 [DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] dump namespaces | framework.go:196 STEP: dump namespace information after failure 11/26/22 23:39:08.328 STEP: Collecting events from namespace "webhook-8715". 11/26/22 23:39:08.328 STEP: Found 12 events. 11/26/22 23:39:19.97 Nov 26 23:39:19.970: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for sample-webhook-deployment-865554f4d9-l2k7f: { } Scheduled: Successfully assigned webhook-8715/sample-webhook-deployment-865554f4d9-l2k7f to bootstrap-e2e-minion-group-n9b1 Nov 26 23:39:19.970: INFO: At 2022-11-26 23:37:01 +0000 UTC - event for sample-webhook-deployment: {deployment-controller } ScalingReplicaSet: Scaled up replica set sample-webhook-deployment-865554f4d9 to 1 Nov 26 23:39:19.970: INFO: At 2022-11-26 23:37:02 +0000 UTC - event for sample-webhook-deployment-865554f4d9: {replicaset-controller } SuccessfulCreate: Created pod: sample-webhook-deployment-865554f4d9-l2k7f Nov 26 23:39:19.970: INFO: At 2022-11-26 23:37:08 +0000 UTC - event for sample-webhook-deployment-865554f4d9-l2k7f: {kubelet bootstrap-e2e-minion-group-n9b1} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Nov 26 23:39:19.970: INFO: At 2022-11-26 23:37:08 +0000 UTC - event for sample-webhook-deployment-865554f4d9-l2k7f: {kubelet bootstrap-e2e-minion-group-n9b1} Created: Created container sample-webhook Nov 26 23:39:19.970: INFO: At 2022-11-26 23:37:09 +0000 UTC - event for sample-webhook-deployment-865554f4d9-l2k7f: {kubelet bootstrap-e2e-minion-group-n9b1} Started: Started container sample-webhook Nov 26 23:39:19.970: INFO: At 2022-11-26 23:37:11 +0000 UTC - event for sample-webhook-deployment-865554f4d9-l2k7f: {kubelet bootstrap-e2e-minion-group-n9b1} Killing: Stopping container sample-webhook Nov 26 23:39:19.970: INFO: At 2022-11-26 23:37:11 +0000 UTC - event for sample-webhook-deployment-865554f4d9-l2k7f: {kubelet bootstrap-e2e-minion-group-n9b1} Unhealthy: Readiness probe failed: Get "https://10.64.3.206:8444/readyz": read tcp 10.64.3.1:49536->10.64.3.206:8444: read: connection reset by peer Nov 26 23:39:19.970: INFO: At 2022-11-26 23:37:12 +0000 UTC - event for sample-webhook-deployment-865554f4d9-l2k7f: {kubelet bootstrap-e2e-minion-group-n9b1} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Nov 26 23:39:19.970: INFO: At 2022-11-26 23:37:17 +0000 UTC - event for sample-webhook-deployment-865554f4d9-l2k7f: {kubelet bootstrap-e2e-minion-group-n9b1} Unhealthy: Readiness probe failed: Get "https://10.64.3.218:8444/readyz": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) Nov 26 23:39:19.970: INFO: At 2022-11-26 23:37:18 +0000 UTC - event for sample-webhook-deployment-865554f4d9-l2k7f: {kubelet bootstrap-e2e-minion-group-n9b1} BackOff: Back-off restarting failed container sample-webhook in pod sample-webhook-deployment-865554f4d9-l2k7f_webhook-8715(65584e90-3d5c-40cf-aaa7-d693f0a8cd8b) Nov 26 23:39:19.970: INFO: At 2022-11-26 23:37:33 +0000 UTC - event for sample-webhook-deployment-865554f4d9-l2k7f: {kubelet bootstrap-e2e-minion-group-n9b1} Unhealthy: Readiness probe failed: Get "https://10.64.3.222:8444/readyz": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) Nov 26 23:39:20.023: INFO: POD NODE PHASE GRACE CONDITIONS Nov 26 23:39:20.023: INFO: sample-webhook-deployment-865554f4d9-l2k7f bootstrap-e2e-minion-group-n9b1 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-11-26 23:37:02 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-11-26 23:37:02 +0000 UTC ContainersNotReady containers with unready status: [sample-webhook]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2022-11-26 23:37:02 +0000 UTC ContainersNotReady containers with unready status: [sample-webhook]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-11-26 23:37:02 +0000 UTC }] Nov 26 23:39:20.023: INFO: Nov 26 23:39:20.155: INFO: Unable to fetch webhook-8715/sample-webhook-deployment-865554f4d9-l2k7f/sample-webhook logs: an error on the server ("unknown") has prevented the request from succeeding (get pods sample-webhook-deployment-865554f4d9-l2k7f) Nov 26 23:39:20.208: INFO: Logging node info for node bootstrap-e2e-master Nov 26 23:39:20.251: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master c85fbb04-d865-42ae-b40a-365f0873d077 10686 0 2022-11-26 23:10:47 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 23:10:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-11-26 23:11:08 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-11-26 23:11:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-11-26 23:34:45 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-6-1-5-ctl-skew/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3858374656 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3596230656 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 23:11:08 +0000 UTC,LastTransitionTime:2022-11-26 23:11:08 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 23:34:45 +0000 UTC,LastTransitionTime:2022-11-26 23:10:47 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 23:34:45 +0000 UTC,LastTransitionTime:2022-11-26 23:10:47 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 23:34:45 +0000 UTC,LastTransitionTime:2022-11-26 23:10:47 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 23:34:45 +0000 UTC,LastTransitionTime:2022-11-26 23:11:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:34.83.128.61,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:51f618a4ea82aa4d3795e4cfa76e3a28,SystemUUID:51f618a4-ea82-aa4d-3795-e4cfa76e3a28,BootID:eb1eb4fb-e105-4d49-9289-0d31902f8c4d,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:135160272,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:124990265,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:57660216,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:2c111f004bec24888d8cfa2a812a38fb8341350abac67dcd0ac64e709dfe389c registry.k8s.io/kas-network-proxy/proxy-server:v0.0.33],SizeBytes:22020129,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 26 23:39:20.252: INFO: Logging kubelet events for node bootstrap-e2e-master Nov 26 23:39:20.319: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-master Nov 26 23:39:20.369: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-master: error trying to reach service: No agent available Nov 26 23:39:20.369: INFO: Logging node info for node bootstrap-e2e-minion-group-dr7t Nov 26 23:39:20.417: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-dr7t b4041686-ad54-48f5-95c3-e848d9a8f0a7 11536 0 2022-11-26 23:10:49 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-dr7t kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-dr7t topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-5218":"bootstrap-e2e-minion-group-dr7t","csi-hostpath-ephemeral-5883":"bootstrap-e2e-minion-group-dr7t","csi-hostpath-ephemeral-8027":"bootstrap-e2e-minion-group-dr7t","csi-hostpath-volume-expand-3788":"bootstrap-e2e-minion-group-dr7t","csi-mock-csi-mock-volumes-7211":"bootstrap-e2e-minion-group-dr7t"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 23:10:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 23:10:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-11-26 23:30:04 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2022-11-26 23:34:41 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-26 23:37:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-6-1-5-ctl-skew/us-west1-b/bootstrap-e2e-minion-group-dr7t,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 23:11:08 +0000 UTC,LastTransitionTime:2022-11-26 23:11:08 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 23:36:03 +0000 UTC,LastTransitionTime:2022-11-26 23:10:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 23:36:03 +0000 UTC,LastTransitionTime:2022-11-26 23:10:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 23:36:03 +0000 UTC,LastTransitionTime:2022-11-26 23:10:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 23:36:03 +0000 UTC,LastTransitionTime:2022-11-26 23:10:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:35.185.223.63,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-dr7t.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-dr7t.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:29f409e413f0ebfffc6ee0c012a074c7,SystemUUID:29f409e4-13f0-ebff-fc6e-e0c012a074c7,BootID:a3bfef7b-2d61-4ac5-a15e-34631edb66c9,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 26 23:39:20.417: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-dr7t Nov 26 23:39:20.477: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-dr7t Nov 26 23:39:20.541: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-dr7t: error trying to reach service: No agent available Nov 26 23:39:20.541: INFO: Logging node info for node bootstrap-e2e-minion-group-l8ht Nov 26 23:39:20.587: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-l8ht 3e5210d0-ba6b-4f56-896c-40aaae5093d0 11854 0 2022-11-26 23:10:52 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-l8ht kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-l8ht topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-2215":"bootstrap-e2e-minion-group-l8ht","csi-hostpath-volume-expand-7512":"bootstrap-e2e-minion-group-l8ht","csi-mock-csi-mock-volumes-2107":"bootstrap-e2e-minion-group-l8ht","csi-mock-csi-mock-volumes-355":"bootstrap-e2e-minion-group-l8ht"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 23:10:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 23:10:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {node-problem-detector Update v1 2022-11-26 23:34:41 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-11-26 23:36:53 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2022-11-26 23:39:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-6-1-5-ctl-skew/us-west1-b/bootstrap-e2e-minion-group-l8ht,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 23:11:08 +0000 UTC,LastTransitionTime:2022-11-26 23:11:08 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 23:38:54 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 23:38:54 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 23:38:54 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 23:38:54 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:34.168.47.71,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-l8ht.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-l8ht.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:89b0fd3f78d194fccba6eb2ce27680f6,SystemUUID:89b0fd3f-78d1-94fc-cba6-eb2ce27680f6,BootID:ec1fa0a7-81b7-48ec-8da0-cc1b45a14fc8,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-55^28d8d761-6de0-11ed-8c44-7ec558aa6670],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-55^28d8d761-6de0-11ed-8c44-7ec558aa6670,DevicePath:,},},Config:nil,},} Nov 26 23:39:20.587: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-l8ht Nov 26 23:39:20.673: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-l8ht Nov 26 23:39:20.857: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-l8ht: error trying to reach service: No agent available Nov 26 23:39:20.857: INFO: Logging node info for node bootstrap-e2e-minion-group-n9b1 Nov 26 23:39:20.934: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-n9b1 796907e0-52c8-4c84-815a-6442939836c4 11882 0 2022-11-26 23:10:52 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-n9b1 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-n9b1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-5727":"bootstrap-e2e-minion-group-n9b1","csi-hostpath-provisioning-254":"bootstrap-e2e-minion-group-n9b1","csi-hostpath-provisioning-6336":"bootstrap-e2e-minion-group-n9b1","csi-mock-csi-mock-volumes-7180":"bootstrap-e2e-minion-group-n9b1","csi-mock-csi-mock-volumes-7256":"bootstrap-e2e-minion-group-n9b1","csi-mock-csi-mock-volumes-7584":"bootstrap-e2e-minion-group-n9b1","csi-mock-csi-mock-volumes-7940":"bootstrap-e2e-minion-group-n9b1"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 23:10:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 23:10:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {node-problem-detector Update v1 2022-11-26 23:34:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-11-26 23:36:53 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2022-11-26 23:39:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-6-1-5-ctl-skew/us-west1-b/bootstrap-e2e-minion-group-n9b1,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 23:34:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 23:34:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 23:34:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 23:34:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 23:34:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 23:34:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 23:34:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 23:11:08 +0000 UTC,LastTransitionTime:2022-11-26 23:11:08 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 23:38:59 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 23:38:59 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 23:38:59 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 23:38:59 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.145.73.48,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-n9b1.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-n9b1.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:47bcd2b143b08ae3cf2e280a7c6e673a,SystemUUID:47bcd2b1-43b0-8ae3-cf2e-280a7c6e673a,BootID:c567f407-918f-4298-a12f-a33a4e211fcf,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 registry.k8s.io/sig-storage/snapshot-controller:v6.1.0],SizeBytes:22620891,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-5727^70b85a3d-6de1-11ed-852d-36e7a9ac0592 kubernetes.io/csi/csi-hostpath-provisioning-169^c8e3d50b-6de0-11ed-aed4-6a12d5ab5936],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-5727^70b85a3d-6de1-11ed-852d-36e7a9ac0592,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-169^c8e3d50b-6de0-11ed-aed4-6a12d5ab5936,DevicePath:,},},Config:nil,},} Nov 26 23:39:20.935: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-n9b1 Nov 26 23:39:21.026: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-n9b1 Nov 26 23:39:21.093: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-n9b1: error trying to reach service: No agent available STEP: Collecting events from namespace "webhook-8715-markers". 11/26/22 23:39:21.093 STEP: Found 0 events. 11/26/22 23:39:21.146 Nov 26 23:39:21.188: INFO: POD NODE PHASE GRACE CONDITIONS Nov 26 23:39:21.188: INFO: Nov 26 23:39:21.233: INFO: Logging node info for node bootstrap-e2e-master Nov 26 23:39:21.275: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master c85fbb04-d865-42ae-b40a-365f0873d077 10686 0 2022-11-26 23:10:47 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 23:10:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-11-26 23:11:08 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-11-26 23:11:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-11-26 23:34:45 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-6-1-5-ctl-skew/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3858374656 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3596230656 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 23:11:08 +0000 UTC,LastTransitionTime:2022-11-26 23:11:08 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 23:34:45 +0000 UTC,LastTransitionTime:2022-11-26 23:10:47 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 23:34:45 +0000 UTC,LastTransitionTime:2022-11-26 23:10:47 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 23:34:45 +0000 UTC,LastTransitionTime:2022-11-26 23:10:47 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 23:34:45 +0000 UTC,LastTransitionTime:2022-11-26 23:11:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:34.83.128.61,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:51f618a4ea82aa4d3795e4cfa76e3a28,SystemUUID:51f618a4-ea82-aa4d-3795-e4cfa76e3a28,BootID:eb1eb4fb-e105-4d49-9289-0d31902f8c4d,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:135160272,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:124990265,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:57660216,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:2c111f004bec24888d8cfa2a812a38fb8341350abac67dcd0ac64e709dfe389c registry.k8s.io/kas-network-proxy/proxy-server:v0.0.33],SizeBytes:22020129,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 26 23:39:21.276: INFO: Logging kubelet events for node bootstrap-e2e-master Nov 26 23:39:21.319: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-master Nov 26 23:39:21.362: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-master: error trying to reach service: No agent available Nov 26 23:39:21.362: INFO: Logging node info for node bootstrap-e2e-minion-group-dr7t Nov 26 23:39:21.404: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-dr7t b4041686-ad54-48f5-95c3-e848d9a8f0a7 11536 0 2022-11-26 23:10:49 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-dr7t kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-dr7t topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-5218":"bootstrap-e2e-minion-group-dr7t","csi-hostpath-ephemeral-5883":"bootstrap-e2e-minion-group-dr7t","csi-hostpath-ephemeral-8027":"bootstrap-e2e-minion-group-dr7t","csi-hostpath-volume-expand-3788":"bootstrap-e2e-minion-group-dr7t","csi-mock-csi-mock-volumes-7211":"bootstrap-e2e-minion-group-dr7t"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 23:10:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 23:10:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-11-26 23:30:04 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2022-11-26 23:34:41 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-26 23:37:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-6-1-5-ctl-skew/us-west1-b/bootstrap-e2e-minion-group-dr7t,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 23:11:08 +0000 UTC,LastTransitionTime:2022-11-26 23:11:08 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 23:36:03 +0000 UTC,LastTransitionTime:2022-11-26 23:10:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 23:36:03 +0000 UTC,LastTransitionTime:2022-11-26 23:10:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 23:36:03 +0000 UTC,LastTransitionTime:2022-11-26 23:10:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 23:36:03 +0000 UTC,LastTransitionTime:2022-11-26 23:10:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:35.185.223.63,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-dr7t.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-dr7t.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:29f409e413f0ebfffc6ee0c012a074c7,SystemUUID:29f409e4-13f0-ebff-fc6e-e0c012a074c7,BootID:a3bfef7b-2d61-4ac5-a15e-34631edb66c9,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 26 23:39:21.404: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-dr7t Nov 26 23:39:21.447: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-dr7t Nov 26 23:39:21.493: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-dr7t: error trying to reach service: No agent available Nov 26 23:39:21.493: INFO: Logging node info for node bootstrap-e2e-minion-group-l8ht Nov 26 23:39:21.534: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-l8ht 3e5210d0-ba6b-4f56-896c-40aaae5093d0 11854 0 2022-11-26 23:10:52 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-l8ht kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-l8ht topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-2215":"bootstrap-e2e-minion-group-l8ht","csi-hostpath-volume-expand-7512":"bootstrap-e2e-minion-group-l8ht","csi-mock-csi-mock-volumes-2107":"bootstrap-e2e-minion-group-l8ht","csi-mock-csi-mock-volumes-355":"bootstrap-e2e-minion-group-l8ht"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 23:10:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 23:10:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {node-problem-detector Update v1 2022-11-26 23:34:41 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-11-26 23:36:53 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2022-11-26 23:39:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-6-1-5-ctl-skew/us-west1-b/bootstrap-e2e-minion-group-l8ht,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 23:11:08 +0000 UTC,LastTransitionTime:2022-11-26 23:11:08 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 23:38:54 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 23:38:54 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 23:38:54 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 23:38:54 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:34.168.47.71,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-l8ht.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-l8ht.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:89b0fd3f78d194fccba6eb2ce27680f6,SystemUUID:89b0fd3f-78d1-94fc-cba6-eb2ce27680f6,BootID:ec1fa0a7-81b7-48ec-8da0-cc1b45a14fc8,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-55^28d8d761-6de0-11ed-8c44-7ec558aa6670],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-55^28d8d761-6de0-11ed-8c44-7ec558aa6670,DevicePath:,},},Config:nil,},} Nov 26 23:39:21.534: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-l8ht Nov 26 23:39:21.577: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-l8ht Nov 26 23:39:21.623: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-l8ht: error trying to reach service: No agent available Nov 26 23:39:21.623: INFO: Logging node info for node bootstrap-e2e-minion-group-n9b1 Nov 26 23:39:21.665: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-n9b1 796907e0-52c8-4c84-815a-6442939836c4 11882 0 2022-11-26 23:10:52 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-n9b1 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-n9b1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-5727":"bootstrap-e2e-minion-group-n9b1","csi-hostpath-provisioning-254":"bootstrap-e2e-minion-group-n9b1","csi-hostpath-provisioning-6336":"bootstrap-e2e-minion-group-n9b1","csi-mock-csi-mock-volumes-7180":"bootstrap-e2e-minion-group-n9b1","csi-mock-csi-mock-volumes-7256":"bootstrap-e2e-minion-group-n9b1","csi-mock-csi-mock-volumes-7584":"bootstrap-e2e-minion-group-n9b1","csi-mock-csi-mock-volumes-7940":"bootstrap-e2e-minion-group-n9b1"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 23:10:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 23:10:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {node-problem-detector Update v1 2022-11-26 23:34:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-11-26 23:36:53 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2022-11-26 23:39:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-6-1-5-ctl-skew/us-west1-b/bootstrap-e2e-minion-group-n9b1,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 23:34:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 23:34:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 23:34:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 23:34:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 23:34:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 23:34:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 23:34:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 23:11:08 +0000 UTC,LastTransitionTime:2022-11-26 23:11:08 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 23:38:59 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 23:38:59 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 23:38:59 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 23:38:59 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.145.73.48,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-n9b1.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-n9b1.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:47bcd2b143b08ae3cf2e280a7c6e673a,SystemUUID:47bcd2b1-43b0-8ae3-cf2e-280a7c6e673a,BootID:c567f407-918f-4298-a12f-a33a4e211fcf,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 registry.k8s.io/sig-storage/snapshot-controller:v6.1.0],SizeBytes:22620891,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-5727^70b85a3d-6de1-11ed-852d-36e7a9ac0592 kubernetes.io/csi/csi-hostpath-provisioning-169^c8e3d50b-6de0-11ed-aed4-6a12d5ab5936],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-5727^70b85a3d-6de1-11ed-852d-36e7a9ac0592,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-169^c8e3d50b-6de0-11ed-aed4-6a12d5ab5936,DevicePath:,},},Config:nil,},} Nov 26 23:39:21.665: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-n9b1 Nov 26 23:39:21.712: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-n9b1 Nov 26 23:39:21.755: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-n9b1: error trying to reach service: No agent available [DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] tear down framework | framework.go:193 STEP: Destroying namespace "webhook-8715" for this suite. 11/26/22 23:39:21.755 STEP: Destroying namespace "webhook-8715-markers" for this suite. 11/26/22 23:39:21.799
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\sshould\sbe\sable\sto\sdeny\scustom\sresource\screation\,\supdate\sand\sdeletion\s\[Conformance\]$'
test/e2e/apimachinery/webhook.go:826 k8s.io/kubernetes/test/e2e/apimachinery.deployWebhookAndService(0xc00103fe00, {0xc00515f260, 0x2c}, 0xc0032249b0, 0x20fb, 0x20fc) test/e2e/apimachinery/webhook.go:826 +0xed2 k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.1() test/e2e/apimachinery/webhook.go:102 +0x226from junit_01.xml
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] set up framework | framework.go:178 STEP: Creating a kubernetes client 11/26/22 23:30:54.848 Nov 26 23:30:54.848: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Building a namespace api object, basename webhook 11/26/22 23:30:54.851 STEP: Waiting for a default service account to be provisioned in namespace 11/26/22 23:30:55.361 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 11/26/22 23:30:55.537 [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/apimachinery/webhook.go:90 STEP: Setting up server cert 11/26/22 23:30:55.947 STEP: Create role binding to let webhook read extension-apiserver-authentication 11/26/22 23:30:56.682 Nov 26 23:30:56.759: INFO: role binding webhook-auth-reader already exists STEP: Deploying the webhook pod 11/26/22 23:30:56.759 STEP: Wait for the deployment to be ready 11/26/22 23:30:56.885 Nov 26 23:30:57.148: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 30, 56, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 30, 56, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 30, 57, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 30, 56, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:30:59.233: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 30, 56, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 30, 56, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 30, 57, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 30, 56, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:31:01.260: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 30, 56, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 30, 56, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 30, 57, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 30, 56, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:31:03.210: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 30, 56, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 30, 56, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 30, 57, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 30, 56, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:31:05.196: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 30, 56, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 30, 56, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 30, 57, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 30, 56, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:31:07.246: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 30, 56, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 30, 56, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 30, 57, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 30, 56, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:32:09.188: INFO: Unexpected error: waiting for the deployment status valid%!(EXTRA string=registry.k8s.io/e2e-test-images/agnhost:2.43, string=sample-webhook-deployment, string=webhook-9710): <*errors.errorString | 0xc0012d6110>: { s: "error waiting for deployment \"sample-webhook-deployment\" status to match expectation: the server was unable to return a response in the time allotted, but may still be processing the request (get deployments.apps sample-webhook-deployment)", } Nov 26 23:32:09.188: FAIL: waiting for the deployment status valid%!(EXTRA string=registry.k8s.io/e2e-test-images/agnhost:2.43, string=sample-webhook-deployment, string=webhook-9710): error waiting for deployment "sample-webhook-deployment" status to match expectation: the server was unable to return a response in the time allotted, but may still be processing the request (get deployments.apps sample-webhook-deployment) Full Stack Trace k8s.io/kubernetes/test/e2e/apimachinery.deployWebhookAndService(0xc00103fe00, {0xc00515f260, 0x2c}, 0xc0032249b0, 0x20fb, 0x20fc) test/e2e/apimachinery/webhook.go:826 +0xed2 k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.1() test/e2e/apimachinery/webhook.go:102 +0x226 [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/framework/node/init/init.go:32 Nov 26 23:32:09.189: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/apimachinery/webhook.go:105 [DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] dump namespaces | framework.go:196 STEP: dump namespace information after failure 11/26/22 23:32:13.043 STEP: Collecting events from namespace "webhook-9710". 11/26/22 23:32:13.043 STEP: Found 7 events. 11/26/22 23:32:13.084 Nov 26 23:32:13.084: INFO: At 2022-11-26 23:30:56 +0000 UTC - event for sample-webhook-deployment: {deployment-controller } ScalingReplicaSet: Scaled up replica set sample-webhook-deployment-865554f4d9 to 1 Nov 26 23:32:13.084: INFO: At 2022-11-26 23:30:56 +0000 UTC - event for sample-webhook-deployment-865554f4d9: {replicaset-controller } SuccessfulCreate: Created pod: sample-webhook-deployment-865554f4d9-l9hxx Nov 26 23:32:13.084: INFO: At 2022-11-26 23:30:56 +0000 UTC - event for sample-webhook-deployment-865554f4d9-l9hxx: {default-scheduler } Scheduled: Successfully assigned webhook-9710/sample-webhook-deployment-865554f4d9-l9hxx to bootstrap-e2e-minion-group-dr7t Nov 26 23:32:13.084: INFO: At 2022-11-26 23:31:01 +0000 UTC - event for sample-webhook-deployment-865554f4d9-l9hxx: {kubelet bootstrap-e2e-minion-group-dr7t} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Nov 26 23:32:13.084: INFO: At 2022-11-26 23:31:02 +0000 UTC - event for sample-webhook-deployment-865554f4d9-l9hxx: {kubelet bootstrap-e2e-minion-group-dr7t} Created: Created container sample-webhook Nov 26 23:32:13.084: INFO: At 2022-11-26 23:31:02 +0000 UTC - event for sample-webhook-deployment-865554f4d9-l9hxx: {kubelet bootstrap-e2e-minion-group-dr7t} Started: Started container sample-webhook Nov 26 23:32:13.084: INFO: At 2022-11-26 23:31:02 +0000 UTC - event for sample-webhook-deployment-865554f4d9-l9hxx: {kubelet bootstrap-e2e-minion-group-dr7t} Unhealthy: Readiness probe failed: Get "https://10.64.1.62:8444/readyz": dial tcp 10.64.1.62:8444: connect: connection refused Nov 26 23:32:13.126: INFO: POD NODE PHASE GRACE CONDITIONS Nov 26 23:32:13.126: INFO: sample-webhook-deployment-865554f4d9-l9hxx bootstrap-e2e-minion-group-dr7t Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-11-26 23:30:56 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-11-26 23:31:02 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-11-26 23:31:02 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-11-26 23:30:56 +0000 UTC }] Nov 26 23:32:13.126: INFO: Nov 26 23:32:13.220: INFO: Logging node info for node bootstrap-e2e-master Nov 26 23:32:13.260: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master c85fbb04-d865-42ae-b40a-365f0873d077 8475 0 2022-11-26 23:10:47 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 23:10:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-11-26 23:11:08 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-11-26 23:11:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-11-26 23:29:38 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-6-1-5-ctl-skew/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3858374656 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3596230656 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 23:11:08 +0000 UTC,LastTransitionTime:2022-11-26 23:11:08 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 23:29:38 +0000 UTC,LastTransitionTime:2022-11-26 23:10:47 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 23:29:38 +0000 UTC,LastTransitionTime:2022-11-26 23:10:47 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 23:29:38 +0000 UTC,LastTransitionTime:2022-11-26 23:10:47 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 23:29:38 +0000 UTC,LastTransitionTime:2022-11-26 23:11:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:34.83.128.61,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:51f618a4ea82aa4d3795e4cfa76e3a28,SystemUUID:51f618a4-ea82-aa4d-3795-e4cfa76e3a28,BootID:eb1eb4fb-e105-4d49-9289-0d31902f8c4d,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:135160272,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:124990265,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:57660216,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:2c111f004bec24888d8cfa2a812a38fb8341350abac67dcd0ac64e709dfe389c registry.k8s.io/kas-network-proxy/proxy-server:v0.0.33],SizeBytes:22020129,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 26 23:32:13.261: INFO: Logging kubelet events for node bootstrap-e2e-master Nov 26 23:32:13.324: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-master Nov 26 23:32:13.396: INFO: metadata-proxy-v0.1-cs4d8 started at 2022-11-26 23:11:29 +0000 UTC (0+2 container statuses recorded) Nov 26 23:32:13.396: INFO: Container metadata-proxy ready: true, restart count 0 Nov 26 23:32:13.396: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Nov 26 23:32:13.396: INFO: etcd-server-events-bootstrap-e2e-master started at 2022-11-26 23:10:04 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.396: INFO: Container etcd-container ready: true, restart count 3 Nov 26 23:32:13.396: INFO: kube-controller-manager-bootstrap-e2e-master started at 2022-11-26 23:10:04 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.396: INFO: Container kube-controller-manager ready: false, restart count 7 Nov 26 23:32:13.396: INFO: kube-addon-manager-bootstrap-e2e-master started at 2022-11-26 23:10:21 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.396: INFO: Container kube-addon-manager ready: true, restart count 2 Nov 26 23:32:13.396: INFO: l7-lb-controller-bootstrap-e2e-master started at 2022-11-26 23:10:21 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.396: INFO: Container l7-lb-controller ready: false, restart count 7 Nov 26 23:32:13.396: INFO: kube-scheduler-bootstrap-e2e-master started at 2022-11-26 23:10:04 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.396: INFO: Container kube-scheduler ready: false, restart count 5 Nov 26 23:32:13.396: INFO: etcd-server-bootstrap-e2e-master started at 2022-11-26 23:10:04 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.396: INFO: Container etcd-container ready: true, restart count 4 Nov 26 23:32:13.396: INFO: konnectivity-server-bootstrap-e2e-master started at 2022-11-26 23:10:04 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.396: INFO: Container konnectivity-server-container ready: true, restart count 1 Nov 26 23:32:13.396: INFO: kube-apiserver-bootstrap-e2e-master started at 2022-11-26 23:10:04 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.396: INFO: Container kube-apiserver ready: false, restart count 4 Nov 26 23:32:13.618: INFO: Latency metrics for node bootstrap-e2e-master Nov 26 23:32:13.618: INFO: Logging node info for node bootstrap-e2e-minion-group-dr7t Nov 26 23:32:13.661: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-dr7t b4041686-ad54-48f5-95c3-e848d9a8f0a7 9571 0 2022-11-26 23:10:49 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-dr7t kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-dr7t topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-5883":"bootstrap-e2e-minion-group-dr7t","csi-hostpath-ephemeral-8027":"bootstrap-e2e-minion-group-dr7t","csi-hostpath-volume-expand-3788":"bootstrap-e2e-minion-group-dr7t","csi-mock-csi-mock-volumes-28":"bootstrap-e2e-minion-group-dr7t","csi-mock-csi-mock-volumes-7211":"bootstrap-e2e-minion-group-dr7t"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 23:10:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 23:10:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {node-problem-detector Update v1 2022-11-26 23:29:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-11-26 23:30:04 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-11-26 23:30:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-6-1-5-ctl-skew/us-west1-b/bootstrap-e2e-minion-group-dr7t,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 23:29:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 23:29:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 23:29:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 23:29:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 23:29:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 23:29:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 23:29:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 23:11:08 +0000 UTC,LastTransitionTime:2022-11-26 23:11:08 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 23:30:56 +0000 UTC,LastTransitionTime:2022-11-26 23:10:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 23:30:56 +0000 UTC,LastTransitionTime:2022-11-26 23:10:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 23:30:56 +0000 UTC,LastTransitionTime:2022-11-26 23:10:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 23:30:56 +0000 UTC,LastTransitionTime:2022-11-26 23:10:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:35.185.223.63,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-dr7t.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-dr7t.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:29f409e413f0ebfffc6ee0c012a074c7,SystemUUID:29f409e4-13f0-ebff-fc6e-e0c012a074c7,BootID:a3bfef7b-2d61-4ac5-a15e-34631edb66c9,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 26 23:32:13.662: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-dr7t Nov 26 23:32:13.710: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-dr7t Nov 26 23:32:13.927: INFO: hostpath-symlink-prep-provisioning-2423 started at 2022-11-26 23:14:01 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container init-volume-provisioning-2423 ready: false, restart count 0 Nov 26 23:32:13.927: INFO: netserver-0 started at 2022-11-26 23:18:54 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container webserver ready: true, restart count 6 Nov 26 23:32:13.927: INFO: netserver-0 started at 2022-11-26 23:19:06 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container webserver ready: false, restart count 6 Nov 26 23:32:13.927: INFO: simpletest.rc-v5cwl started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:13.927: INFO: simpletest.rc-5xfcl started at 2022-11-26 23:24:10 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container nginx ready: false, restart count 1 Nov 26 23:32:13.927: INFO: csi-hostpathplugin-0 started at 2022-11-26 23:13:45 +0000 UTC (0+7 container statuses recorded) Nov 26 23:32:13.927: INFO: Container csi-attacher ready: false, restart count 6 Nov 26 23:32:13.927: INFO: Container csi-provisioner ready: false, restart count 6 Nov 26 23:32:13.927: INFO: Container csi-resizer ready: false, restart count 6 Nov 26 23:32:13.927: INFO: Container csi-snapshotter ready: false, restart count 6 Nov 26 23:32:13.927: INFO: Container hostpath ready: false, restart count 6 Nov 26 23:32:13.927: INFO: Container liveness-probe ready: false, restart count 6 Nov 26 23:32:13.927: INFO: Container node-driver-registrar ready: false, restart count 6 Nov 26 23:32:13.927: INFO: csi-hostpathplugin-0 started at 2022-11-26 23:15:48 +0000 UTC (0+7 container statuses recorded) Nov 26 23:32:13.927: INFO: Container csi-attacher ready: true, restart count 2 Nov 26 23:32:13.927: INFO: Container csi-provisioner ready: true, restart count 2 Nov 26 23:32:13.927: INFO: Container csi-resizer ready: true, restart count 2 Nov 26 23:32:13.927: INFO: Container csi-snapshotter ready: true, restart count 2 Nov 26 23:32:13.927: INFO: Container hostpath ready: true, restart count 2 Nov 26 23:32:13.927: INFO: Container liveness-probe ready: true, restart count 2 Nov 26 23:32:13.927: INFO: Container node-driver-registrar ready: true, restart count 2 Nov 26 23:32:13.927: INFO: simpletest.rc-lmsws started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container nginx ready: true, restart count 3 Nov 26 23:32:13.927: INFO: concurrent-27825091-kqhhk started at 2022-11-26 23:31:00 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container c ready: false, restart count 0 Nov 26 23:32:13.927: INFO: csi-mockplugin-0 started at 2022-11-26 23:13:58 +0000 UTC (0+3 container statuses recorded) Nov 26 23:32:13.927: INFO: Container csi-provisioner ready: true, restart count 5 Nov 26 23:32:13.927: INFO: Container driver-registrar ready: true, restart count 5 Nov 26 23:32:13.927: INFO: Container mock ready: true, restart count 5 Nov 26 23:32:13.927: INFO: simpletest.rc-vmjnr started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:13.927: INFO: simpletest.rc-jz7rl started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:13.927: INFO: simpletest.rc-fgdjw started at 2022-11-26 23:24:11 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:13.927: INFO: metadata-proxy-v0.1-5cxbq started at 2022-11-26 23:10:50 +0000 UTC (0+2 container statuses recorded) Nov 26 23:32:13.927: INFO: Container metadata-proxy ready: true, restart count 0 Nov 26 23:32:13.927: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Nov 26 23:32:13.927: INFO: pod-hostip-ca4d6a7e-d19f-41f7-a0c0-3ba1daa0f976 started at 2022-11-26 23:23:56 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container test ready: true, restart count 2 Nov 26 23:32:13.927: INFO: simpletest.rc-vqn8l started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:13.927: INFO: external-provisioner-fslzm started at 2022-11-26 23:30:55 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container nfs-provisioner ready: true, restart count 2 Nov 26 23:32:13.927: INFO: simpletest.rc-4xnc8 started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:13.927: INFO: csi-mockplugin-resizer-0 started at 2022-11-26 23:13:58 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container csi-resizer ready: true, restart count 5 Nov 26 23:32:13.927: INFO: simpletest.rc-c9cjf started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:13.927: INFO: sample-webhook-deployment-865554f4d9-l9hxx started at 2022-11-26 23:30:56 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container sample-webhook ready: true, restart count 0 Nov 26 23:32:13.927: INFO: backofflimit-k6h5t started at 2022-11-26 23:31:02 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container c ready: false, restart count 0 Nov 26 23:32:13.927: INFO: coredns-6d97d5ddb-tfljm started at 2022-11-26 23:11:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container coredns ready: false, restart count 7 Nov 26 23:32:13.927: INFO: konnectivity-agent-bdgkf started at 2022-11-26 23:11:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container konnectivity-agent ready: false, restart count 6 Nov 26 23:32:13.927: INFO: inline-volume-tester-mndlt started at 2022-11-26 23:14:00 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container csi-volume-tester ready: false, restart count 0 Nov 26 23:32:13.927: INFO: csi-hostpathplugin-0 started at 2022-11-26 23:20:01 +0000 UTC (0+7 container statuses recorded) Nov 26 23:32:13.927: INFO: Container csi-attacher ready: false, restart count 5 Nov 26 23:32:13.927: INFO: Container csi-provisioner ready: false, restart count 5 Nov 26 23:32:13.927: INFO: Container csi-resizer ready: false, restart count 5 Nov 26 23:32:13.927: INFO: Container csi-snapshotter ready: false, restart count 5 Nov 26 23:32:13.927: INFO: Container hostpath ready: false, restart count 5 Nov 26 23:32:13.927: INFO: Container liveness-probe ready: false, restart count 5 Nov 26 23:32:13.927: INFO: Container node-driver-registrar ready: false, restart count 5 Nov 26 23:32:13.927: INFO: simpletest.rc-r48g7 started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container nginx ready: true, restart count 4 Nov 26 23:32:13.927: INFO: simpletest.rc-ns9qh started at 2022-11-26 23:24:10 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:13.927: INFO: externalip-test-glqb4 started at 2022-11-26 23:18:39 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container externalip-test ready: true, restart count 4 Nov 26 23:32:13.927: INFO: simpletest.rc-74l76 started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:13.927: INFO: ss2-0 started at 2022-11-26 23:30:57 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container webserver ready: true, restart count 0 Nov 26 23:32:13.927: INFO: simpletest.rc-k6n62 started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:13.927: INFO: simpletest.rc-pwcsr started at 2022-11-26 23:24:10 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:13.927: INFO: kube-proxy-bootstrap-e2e-minion-group-dr7t started at 2022-11-26 23:10:49 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container kube-proxy ready: false, restart count 7 Nov 26 23:32:13.927: INFO: simpletest.rc-gqz24 started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container nginx ready: false, restart count 2 Nov 26 23:32:13.927: INFO: csi-hostpathplugin-0 started at 2022-11-26 23:15:49 +0000 UTC (0+7 container statuses recorded) Nov 26 23:32:13.927: INFO: Container csi-attacher ready: true, restart count 4 Nov 26 23:32:13.927: INFO: Container csi-provisioner ready: true, restart count 4 Nov 26 23:32:13.927: INFO: Container csi-resizer ready: true, restart count 4 Nov 26 23:32:13.927: INFO: Container csi-snapshotter ready: true, restart count 4 Nov 26 23:32:13.927: INFO: Container hostpath ready: true, restart count 4 Nov 26 23:32:13.927: INFO: Container liveness-probe ready: true, restart count 4 Nov 26 23:32:13.927: INFO: Container node-driver-registrar ready: true, restart count 4 Nov 26 23:32:13.927: INFO: simpletest.rc-k5zrz started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container nginx ready: false, restart count 4 Nov 26 23:32:13.927: INFO: simpletest.rc-c5h8h started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:13.927: INFO: simpletest.rc-t7xqp started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:13.927: INFO: e2e-2gjr9-9fzdt started at 2022-11-26 23:13:41 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container c ready: false, restart count 0 Nov 26 23:32:13.927: INFO: client-envvars-94091b6a-29ad-4b9a-9ad7-528612eb4de4 started at 2022-11-26 23:13:52 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container env3cont ready: false, restart count 0 Nov 26 23:32:13.927: INFO: simpletest.rc-v9jc5 started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:13.927: INFO: externalname-service-kgwxz started at 2022-11-26 23:30:56 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container externalname-service ready: true, restart count 0 Nov 26 23:32:13.927: INFO: netserver-0 started at 2022-11-26 23:13:40 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container webserver ready: true, restart count 7 Nov 26 23:32:13.927: INFO: simpletest.rc-z4cfk started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:13.927: INFO: e2e-2gjr9-mw95z started at 2022-11-26 23:13:46 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container c ready: false, restart count 0 Nov 26 23:32:13.927: INFO: simpletest.rc-5lcbg started at 2022-11-26 23:24:11 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container nginx ready: true, restart count 5 Nov 26 23:32:13.927: INFO: test-rs-7t6dx started at 2022-11-26 23:30:55 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container httpd ready: false, restart count 1 Nov 26 23:32:13.927: INFO: simpletest.rc-grs4f started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:13.927: INFO: simpletest.rc-d4qlz started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container nginx ready: true, restart count 3 Nov 26 23:32:13.927: INFO: kube-dns-autoscaler-5f6455f985-2twl5 started at 2022-11-26 23:11:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container autoscaler ready: false, restart count 7 Nov 26 23:32:13.927: INFO: hostexec-bootstrap-e2e-minion-group-dr7t-ssljm started at 2022-11-26 23:13:55 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container agnhost-container ready: true, restart count 4 Nov 26 23:32:13.927: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 23:13:58 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container csi-attacher ready: true, restart count 5 Nov 26 23:32:13.927: INFO: test-rs-zwkkr started at 2022-11-26 23:19:54 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container httpd ready: true, restart count 5 Nov 26 23:32:13.927: INFO: csi-mockplugin-0 started at 2022-11-26 23:23:56 +0000 UTC (0+3 container statuses recorded) Nov 26 23:32:13.927: INFO: Container csi-provisioner ready: true, restart count 4 Nov 26 23:32:13.927: INFO: Container driver-registrar ready: true, restart count 5 Nov 26 23:32:13.927: INFO: Container mock ready: true, restart count 4 Nov 26 23:32:13.927: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 23:23:56 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container csi-attacher ready: true, restart count 4 Nov 26 23:32:13.927: INFO: simpletest.rc-fvdxd started at 2022-11-26 23:24:10 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:13.927: INFO: simpletest.rc-hrx7l started at 2022-11-26 23:24:11 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:13.927: INFO: replace-27825091-d7l4n started at 2022-11-26 23:31:00 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container c ready: true, restart count 1 Nov 26 23:32:13.927: INFO: external-provisioner-wrpbw started at 2022-11-26 23:14:05 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container nfs-provisioner ready: true, restart count 4 Nov 26 23:32:13.927: INFO: pod1 started at 2022-11-26 23:18:15 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container agnhost-container ready: false, restart count 3 Nov 26 23:32:13.927: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 23:15:48 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container csi-attacher ready: false, restart count 5 Nov 26 23:32:13.927: INFO: inline-volume-tester-65qqv started at 2022-11-26 23:23:51 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container csi-volume-tester ready: false, restart count 0 Nov 26 23:32:13.927: INFO: simpletest.rc-cvkmj started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:13.927: INFO: csi-mockplugin-0 started at 2022-11-26 23:16:14 +0000 UTC (0+4 container statuses recorded) Nov 26 23:32:13.927: INFO: Container busybox ready: false, restart count 6 Nov 26 23:32:13.927: INFO: Container csi-provisioner ready: false, restart count 6 Nov 26 23:32:13.927: INFO: Container driver-registrar ready: true, restart count 6 Nov 26 23:32:13.927: INFO: Container mock ready: true, restart count 6 Nov 26 23:32:13.927: INFO: successful-jobs-history-limit-27825091-mr7tr started at 2022-11-26 23:31:00 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container c ready: false, restart count 0 Nov 26 23:32:13.927: INFO: simpletest.rc-7c2t4 started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:13.927: INFO: simpletest.rc-mvsml started at 2022-11-26 23:24:10 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container nginx ready: false, restart count 1 Nov 26 23:32:13.927: INFO: external-provisioner-9dc9l started at 2022-11-26 23:13:43 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container nfs-provisioner ready: true, restart count 4 Nov 26 23:32:13.927: INFO: simpletest.rc-fwmr7 started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container nginx ready: true, restart count 3 Nov 26 23:32:13.927: INFO: hostexec-bootstrap-e2e-minion-group-dr7t-4qhfn started at 2022-11-26 23:24:03 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container agnhost-container ready: true, restart count 2 Nov 26 23:32:13.927: INFO: ss2-2 started at 2022-11-26 23:30:33 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container webserver ready: true, restart count 2 Nov 26 23:32:13.927: INFO: simpletest.rc-m6r9w started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:13.927: INFO: simpletest.rc-vj7jd started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container nginx ready: false, restart count 4 Nov 26 23:32:13.927: INFO: netserver-0 started at 2022-11-26 23:30:55 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container webserver ready: true, restart count 2 Nov 26 23:32:13.927: INFO: client-containers-a07ad6d5-f09c-4873-aa1a-59d19e7db754 started at 2022-11-26 23:30:56 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container agnhost-container ready: true, restart count 0 Nov 26 23:32:13.927: INFO: external-provisioner-fwvdj started at 2022-11-26 23:13:53 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container nfs-provisioner ready: true, restart count 5 Nov 26 23:32:13.927: INFO: csi-mockplugin-0 started at 2022-11-26 23:15:48 +0000 UTC (0+3 container statuses recorded) Nov 26 23:32:13.927: INFO: Container csi-provisioner ready: false, restart count 5 Nov 26 23:32:13.927: INFO: Container driver-registrar ready: true, restart count 6 Nov 26 23:32:13.927: INFO: Container mock ready: false, restart count 5 Nov 26 23:32:13.927: INFO: simpletest.rc-bbtzn started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container nginx ready: false, restart count 2 Nov 26 23:32:13.927: INFO: simpletest.rc-kkv97 started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:13.927: INFO: hostexec-bootstrap-e2e-minion-group-dr7t-8hn6w started at 2022-11-26 23:30:33 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.927: INFO: Container agnhost-container ready: true, restart count 0 Nov 26 23:32:14.482: INFO: Latency metrics for node bootstrap-e2e-minion-group-dr7t Nov 26 23:32:14.482: INFO: Logging node info for node bootstrap-e2e-minion-group-l8ht Nov 26 23:32:14.523: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-l8ht 3e5210d0-ba6b-4f56-896c-40aaae5093d0 9667 0 2022-11-26 23:10:52 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-l8ht kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-l8ht topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-2215":"bootstrap-e2e-minion-group-l8ht","csi-hostpath-ephemeral-3757":"bootstrap-e2e-minion-group-l8ht","csi-mock-csi-mock-volumes-1468":"bootstrap-e2e-minion-group-l8ht","csi-mock-csi-mock-volumes-355":"bootstrap-e2e-minion-group-l8ht","csi-mock-csi-mock-volumes-7659":"bootstrap-e2e-minion-group-l8ht"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 23:10:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 23:10:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {node-problem-detector Update v1 2022-11-26 23:29:41 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-11-26 23:30:56 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2022-11-26 23:30:59 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-6-1-5-ctl-skew/us-west1-b/bootstrap-e2e-minion-group-l8ht,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 23:29:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 23:29:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 23:29:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 23:29:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 23:29:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 23:29:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 23:29:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 23:11:08 +0000 UTC,LastTransitionTime:2022-11-26 23:11:08 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 23:30:56 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 23:30:56 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 23:30:56 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 23:30:56 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:34.168.47.71,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-l8ht.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-l8ht.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:89b0fd3f78d194fccba6eb2ce27680f6,SystemUUID:89b0fd3f-78d1-94fc-cba6-eb2ce27680f6,BootID:ec1fa0a7-81b7-48ec-8da0-cc1b45a14fc8,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-2215^54ec9437-6de2-11ed-a59d-c2129b99100c kubernetes.io/csi/csi-hostpath-ephemeral-2215^5e526a82-6de2-11ed-a59d-c2129b99100c kubernetes.io/csi/csi-hostpath-provisioning-55^28d8d761-6de0-11ed-8c44-7ec558aa6670],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-2215^5e526a82-6de2-11ed-a59d-c2129b99100c,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-55^28d8d761-6de0-11ed-8c44-7ec558aa6670,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-2215^54ec9437-6de2-11ed-a59d-c2129b99100c,DevicePath:,},},Config:nil,},} Nov 26 23:32:14.524: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-l8ht Nov 26 23:32:14.572: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-l8ht Nov 26 23:32:14.676: INFO: pod-2c9ca969-f71c-470c-a591-eddc5680ebb6 started at 2022-11-26 23:15:47 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container write-pod ready: false, restart count 0 Nov 26 23:32:14.677: INFO: simpletest.rc-hvsd4 started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:14.677: INFO: simpletest.rc-95pbd started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:14.677: INFO: simpletest.rc-czsr7 started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:14.677: INFO: simpletest.rc-mvdr4 started at 2022-11-26 23:24:10 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:14.677: INFO: inline-volume-tester2-4fbtj started at 2022-11-26 23:30:54 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container csi-volume-tester ready: true, restart count 0 Nov 26 23:32:14.677: INFO: externalname-service-6jhjf started at 2022-11-26 23:30:56 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container externalname-service ready: true, restart count 0 Nov 26 23:32:14.677: INFO: csi-hostpathplugin-0 started at 2022-11-26 23:14:04 +0000 UTC (0+7 container statuses recorded) Nov 26 23:32:14.677: INFO: Container csi-attacher ready: false, restart count 7 Nov 26 23:32:14.677: INFO: Container csi-provisioner ready: false, restart count 7 Nov 26 23:32:14.677: INFO: Container csi-resizer ready: false, restart count 7 Nov 26 23:32:14.677: INFO: Container csi-snapshotter ready: false, restart count 7 Nov 26 23:32:14.677: INFO: Container hostpath ready: false, restart count 7 Nov 26 23:32:14.677: INFO: Container liveness-probe ready: false, restart count 7 Nov 26 23:32:14.677: INFO: Container node-driver-registrar ready: false, restart count 6 Nov 26 23:32:14.677: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 23:15:47 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container csi-attacher ready: true, restart count 4 Nov 26 23:32:14.677: INFO: liveness-d534e81f-ba57-43f0-a7ed-ae77c4a39ae7 started at 2022-11-26 23:23:58 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container agnhost-container ready: true, restart count 1 Nov 26 23:32:14.677: INFO: simpletest.rc-d8tnq started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:14.677: INFO: simpletest.rc-tmr7r started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:14.677: INFO: concurrent-27825091-4rnxd started at 2022-11-26 23:31:00 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container c ready: false, restart count 0 Nov 26 23:32:14.677: INFO: csi-hostpathplugin-0 started at 2022-11-26 23:30:33 +0000 UTC (0+7 container statuses recorded) Nov 26 23:32:14.677: INFO: Container csi-attacher ready: true, restart count 0 Nov 26 23:32:14.677: INFO: Container csi-provisioner ready: true, restart count 0 Nov 26 23:32:14.677: INFO: Container csi-resizer ready: true, restart count 0 Nov 26 23:32:14.677: INFO: Container csi-snapshotter ready: true, restart count 0 Nov 26 23:32:14.677: INFO: Container hostpath ready: true, restart count 0 Nov 26 23:32:14.677: INFO: Container liveness-probe ready: true, restart count 0 Nov 26 23:32:14.677: INFO: Container node-driver-registrar ready: true, restart count 0 Nov 26 23:32:14.677: INFO: simpletest.rc-t7wx8 started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:14.677: INFO: simpletest.rc-p9bpg started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container nginx ready: true, restart count 3 Nov 26 23:32:14.677: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 23:24:11 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container csi-attacher ready: true, restart count 2 Nov 26 23:32:14.677: INFO: kube-proxy-bootstrap-e2e-minion-group-l8ht started at 2022-11-26 23:10:52 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container kube-proxy ready: false, restart count 7 Nov 26 23:32:14.677: INFO: netserver-1 started at 2022-11-26 23:19:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container webserver ready: true, restart count 2 Nov 26 23:32:14.677: INFO: simpletest.rc-8kjlk started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:14.677: INFO: simpletest.rc-wzrjg started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:14.677: INFO: csi-mockplugin-0 started at 2022-11-26 23:30:33 +0000 UTC (0+3 container statuses recorded) Nov 26 23:32:14.677: INFO: Container csi-provisioner ready: true, restart count 0 Nov 26 23:32:14.677: INFO: Container driver-registrar ready: true, restart count 0 Nov 26 23:32:14.677: INFO: Container mock ready: true, restart count 0 Nov 26 23:32:14.677: INFO: forbid-27825091-7wspw started at 2022-11-26 23:31:00 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container c ready: false, restart count 0 Nov 26 23:32:14.677: INFO: metadata-proxy-v0.1-n8dk7 started at 2022-11-26 23:10:53 +0000 UTC (0+2 container statuses recorded) Nov 26 23:32:14.677: INFO: Container metadata-proxy ready: true, restart count 0 Nov 26 23:32:14.677: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Nov 26 23:32:14.677: INFO: simpletest.rc-zr9cg started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:14.677: INFO: simpletest.rc-2j7wd started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:14.677: INFO: e2e-2gjr9-n7ngv started at 2022-11-26 23:13:53 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container c ready: false, restart count 0 Nov 26 23:32:14.677: INFO: csi-mockplugin-0 started at 2022-11-26 23:15:47 +0000 UTC (0+3 container statuses recorded) Nov 26 23:32:14.677: INFO: Container csi-provisioner ready: false, restart count 6 Nov 26 23:32:14.677: INFO: Container driver-registrar ready: false, restart count 6 Nov 26 23:32:14.677: INFO: Container mock ready: false, restart count 6 Nov 26 23:32:14.677: INFO: csi-hostpathplugin-0 started at 2022-11-26 23:19:22 +0000 UTC (0+7 container statuses recorded) Nov 26 23:32:14.677: INFO: Container csi-attacher ready: false, restart count 6 Nov 26 23:32:14.677: INFO: Container csi-provisioner ready: false, restart count 6 Nov 26 23:32:14.677: INFO: Container csi-resizer ready: false, restart count 6 Nov 26 23:32:14.677: INFO: Container csi-snapshotter ready: false, restart count 6 Nov 26 23:32:14.677: INFO: Container hostpath ready: false, restart count 6 Nov 26 23:32:14.677: INFO: Container liveness-probe ready: false, restart count 6 Nov 26 23:32:14.677: INFO: Container node-driver-registrar ready: false, restart count 6 Nov 26 23:32:14.677: INFO: simpletest.rc-vfphz started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container nginx ready: false, restart count 3 Nov 26 23:32:14.677: INFO: simpletest.rc-dhxfz started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:14.677: INFO: simpletest.rc-s4mxg started at 2022-11-26 23:24:10 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:14.677: INFO: csi-mockplugin-0 started at 2022-11-26 23:24:10 +0000 UTC (0+3 container statuses recorded) Nov 26 23:32:14.677: INFO: Container csi-provisioner ready: true, restart count 3 Nov 26 23:32:14.677: INFO: Container driver-registrar ready: true, restart count 3 Nov 26 23:32:14.677: INFO: Container mock ready: true, restart count 3 Nov 26 23:32:14.677: INFO: csi-mockplugin-0 started at 2022-11-26 23:13:55 +0000 UTC (0+4 container statuses recorded) Nov 26 23:32:14.677: INFO: Container busybox ready: false, restart count 7 Nov 26 23:32:14.677: INFO: Container csi-provisioner ready: false, restart count 7 Nov 26 23:32:14.677: INFO: Container driver-registrar ready: false, restart count 7 Nov 26 23:32:14.677: INFO: Container mock ready: false, restart count 7 Nov 26 23:32:14.677: INFO: concurrent-27825084-6s8hd started at 2022-11-26 23:24:00 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container c ready: false, restart count 0 Nov 26 23:32:14.677: INFO: pod2 started at 2022-11-26 23:18:17 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container agnhost-container ready: true, restart count 4 Nov 26 23:32:14.677: INFO: csi-hostpathplugin-0 started at 2022-11-26 23:18:19 +0000 UTC (0+7 container statuses recorded) Nov 26 23:32:14.677: INFO: Container csi-attacher ready: false, restart count 3 Nov 26 23:32:14.677: INFO: Container csi-provisioner ready: false, restart count 3 Nov 26 23:32:14.677: INFO: Container csi-resizer ready: false, restart count 3 Nov 26 23:32:14.677: INFO: Container csi-snapshotter ready: false, restart count 3 Nov 26 23:32:14.677: INFO: Container hostpath ready: false, restart count 3 Nov 26 23:32:14.677: INFO: Container liveness-probe ready: false, restart count 3 Nov 26 23:32:14.677: INFO: Container node-driver-registrar ready: false, restart count 3 Nov 26 23:32:14.677: INFO: simpletest.rc-wrg78 started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:14.677: INFO: simpletest.rc-9zsmr started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:14.677: INFO: sample-webhook-deployment-865554f4d9-k8x2c started at 2022-11-26 23:30:56 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container sample-webhook ready: true, restart count 3 Nov 26 23:32:14.677: INFO: csi-hostpathplugin-0 started at 2022-11-26 23:13:43 +0000 UTC (0+7 container statuses recorded) Nov 26 23:32:14.677: INFO: Container csi-attacher ready: false, restart count 4 Nov 26 23:32:14.677: INFO: Container csi-provisioner ready: false, restart count 4 Nov 26 23:32:14.677: INFO: Container csi-resizer ready: false, restart count 4 Nov 26 23:32:14.677: INFO: Container csi-snapshotter ready: false, restart count 4 Nov 26 23:32:14.677: INFO: Container hostpath ready: false, restart count 4 Nov 26 23:32:14.677: INFO: Container liveness-probe ready: false, restart count 4 Nov 26 23:32:14.677: INFO: Container node-driver-registrar ready: false, restart count 5 Nov 26 23:32:14.677: INFO: external-provisioner-l4hjd started at 2022-11-26 23:18:15 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container nfs-provisioner ready: true, restart count 4 Nov 26 23:32:14.677: INFO: simpletest.rc-47jfp started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container nginx ready: true, restart count 3 Nov 26 23:32:14.677: INFO: simpletest.rc-768cr started at 2022-11-26 23:24:11 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:14.677: INFO: netserver-1 started at 2022-11-26 23:30:55 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container webserver ready: true, restart count 2 Nov 26 23:32:14.677: INFO: konnectivity-agent-rhvvx started at 2022-11-26 23:11:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container konnectivity-agent ready: false, restart count 7 Nov 26 23:32:14.677: INFO: ss2-1 started at 2022-11-26 23:30:42 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container webserver ready: true, restart count 2 Nov 26 23:32:14.677: INFO: test-rs-4vhzr started at 2022-11-26 23:31:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container httpd ready: true, restart count 0 Nov 26 23:32:14.677: INFO: simpletest.rc-7n2qg started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:14.677: INFO: simpletest.rc-lslmb started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:14.677: INFO: test-cleanup-controller-w66lq started at 2022-11-26 23:14:02 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container httpd ready: true, restart count 3 Nov 26 23:32:14.677: INFO: simpletest.rc-vzb6t started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:14.677: INFO: simpletest.rc-7ppxt started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:14.677: INFO: simpletest.rc-rczdt started at 2022-11-26 23:24:10 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container nginx ready: true, restart count 3 Nov 26 23:32:14.677: INFO: inline-volume-tester-rx8k7 started at 2022-11-26 23:30:38 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container csi-volume-tester ready: false, restart count 0 Nov 26 23:32:14.677: INFO: netserver-1 started at 2022-11-26 23:13:40 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container webserver ready: false, restart count 8 Nov 26 23:32:14.677: INFO: test-rs-rlcd5 started at 2022-11-26 23:19:54 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container httpd ready: true, restart count 1 Nov 26 23:32:14.677: INFO: simpletest.rc-9sc82 started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:14.677: INFO: simpletest.rc-q8q28 started at 2022-11-26 23:24:10 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:14.677: INFO: hostexec-bootstrap-e2e-minion-group-l8ht-6ffqj started at 2022-11-26 23:14:05 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container agnhost-container ready: true, restart count 5 Nov 26 23:32:14.677: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 23:30:33 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container csi-attacher ready: true, restart count 0 Nov 26 23:32:14.677: INFO: inline-volume-tester-nqd44 started at 2022-11-26 23:18:28 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container csi-volume-tester ready: false, restart count 0 Nov 26 23:32:14.677: INFO: simpletest.rc-2mfcn started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container nginx ready: true, restart count 3 Nov 26 23:32:14.677: INFO: simpletest.rc-88vj9 started at 2022-11-26 23:24:11 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:14.677: INFO: simpletest.rc-zrvv5 started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:14.677: INFO: simpletest.rc-j6nhq started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:14.677: INFO: coredns-6d97d5ddb-j25mc started at 2022-11-26 23:11:12 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container coredns ready: false, restart count 7 Nov 26 23:32:14.677: INFO: simpletest.rc-hfg2l started at 2022-11-26 23:24:10 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:14.677: INFO: simpletest.rc-t5r8v started at 2022-11-26 23:24:11 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container nginx ready: false, restart count 3 Nov 26 23:32:14.677: INFO: hostexec-bootstrap-e2e-minion-group-l8ht-xvf2z started at 2022-11-26 23:30:33 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container agnhost-container ready: true, restart count 0 Nov 26 23:32:14.677: INFO: netserver-1 started at 2022-11-26 23:18:54 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container webserver ready: false, restart count 3 Nov 26 23:32:14.677: INFO: simpletest.rc-fdktq started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.677: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:15.224: INFO: Latency metrics for node bootstrap-e2e-minion-group-l8ht Nov 26 23:32:15.224: INFO: Logging node info for node bootstrap-e2e-minion-group-n9b1 Nov 26 23:32:15.269: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-n9b1 796907e0-52c8-4c84-815a-6442939836c4 9381 0 2022-11-26 23:10:52 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-n9b1 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-n9b1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-5727":"bootstrap-e2e-minion-group-n9b1","csi-hostpath-ephemeral-9647":"bootstrap-e2e-minion-group-n9b1","csi-hostpath-provisioning-254":"bootstrap-e2e-minion-group-n9b1","csi-mock-csi-mock-volumes-7584":"bootstrap-e2e-minion-group-n9b1","csi-mock-csi-mock-volumes-7940":"bootstrap-e2e-minion-group-n9b1"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 23:10:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 23:10:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {node-problem-detector Update v1 2022-11-26 23:29:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-11-26 23:30:05 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2022-11-26 23:30:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-6-1-5-ctl-skew/us-west1-b/bootstrap-e2e-minion-group-n9b1,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 23:29:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 23:29:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 23:29:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 23:29:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 23:29:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 23:29:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 23:29:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 23:11:08 +0000 UTC,LastTransitionTime:2022-11-26 23:11:08 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 23:29:38 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 23:29:38 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 23:29:38 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 23:29:38 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.145.73.48,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-n9b1.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-n9b1.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:47bcd2b143b08ae3cf2e280a7c6e673a,SystemUUID:47bcd2b1-43b0-8ae3-cf2e-280a7c6e673a,BootID:c567f407-918f-4298-a12f-a33a4e211fcf,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 registry.k8s.io/sig-storage/snapshot-controller:v6.1.0],SizeBytes:22620891,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-5727^70b85a3d-6de1-11ed-852d-36e7a9ac0592 kubernetes.io/csi/csi-hostpath-provisioning-169^c8e3d50b-6de0-11ed-aed4-6a12d5ab5936],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-169^c8e3d50b-6de0-11ed-aed4-6a12d5ab5936,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-5727^70b85a3d-6de1-11ed-852d-36e7a9ac0592,DevicePath:,},},Config:nil,},} Nov 26 23:32:15.270: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-n9b1 Nov 26 23:32:15.314: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-n9b1 Nov 26 23:32:15.402: INFO: l7-default-backend-8549d69d99-zgjzh started at 2022-11-26 23:11:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container default-http-backend ready: true, restart count 0 Nov 26 23:32:15.402: INFO: server-envvars-6222e6ac-d567-472d-bd00-c996ebe3395c started at 2022-11-26 23:13:40 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container srv ready: false, restart count 6 Nov 26 23:32:15.402: INFO: simpletest.rc-7n2vx started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:15.402: INFO: simpletest.rc-mpjvz started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:15.402: INFO: e2e-2gjr9-l5xsj started at 2022-11-26 23:13:41 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container c ready: false, restart count 0 Nov 26 23:32:15.402: INFO: pod-0b414c7b-dcc9-4e00-9536-9db8ccc1a7b7 started at 2022-11-26 23:19:47 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container test-container ready: false, restart count 0 Nov 26 23:32:15.402: INFO: sample-webhook-deployment-865554f4d9-4zmb9 started at 2022-11-26 23:23:42 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container sample-webhook ready: true, restart count 3 Nov 26 23:32:15.402: INFO: pod-projected-configmaps-334f9945-2444-46e4-b837-44369e43dccb started at 2022-11-26 23:19:59 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container agnhost-container ready: false, restart count 0 Nov 26 23:32:15.402: INFO: test-rs-ljz55 started at 2022-11-26 23:19:54 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container httpd ready: true, restart count 5 Nov 26 23:32:15.402: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 23:23:43 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container csi-attacher ready: true, restart count 1 Nov 26 23:32:15.402: INFO: csi-mockplugin-0 started at 2022-11-26 23:13:42 +0000 UTC (0+3 container statuses recorded) Nov 26 23:32:15.402: INFO: Container csi-provisioner ready: true, restart count 0 Nov 26 23:32:15.402: INFO: Container driver-registrar ready: true, restart count 0 Nov 26 23:32:15.402: INFO: Container mock ready: true, restart count 0 Nov 26 23:32:15.402: INFO: simpletest.rc-xdwbr started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:15.402: INFO: pod-update-activedeadlineseconds-77a2de44-d7f7-44e5-b11e-b055e23fbdce started at 2022-11-26 23:30:33 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container pause ready: false, restart count 0 Nov 26 23:32:15.402: INFO: netserver-2 started at 2022-11-26 23:30:55 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container webserver ready: true, restart count 0 Nov 26 23:32:15.402: INFO: hostexec-bootstrap-e2e-minion-group-n9b1-xzltr started at 2022-11-26 23:13:55 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container agnhost-container ready: false, restart count 6 Nov 26 23:32:15.402: INFO: simpletest.rc-bmbvf started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:15.402: INFO: simpletest.rc-4n9fc started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:15.402: INFO: simpletest.rc-mmvjs started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:15.402: INFO: simpletest.rc-kcjjc started at 2022-11-26 23:24:10 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:15.402: INFO: inline-volume-tester-h725k started at 2022-11-26 23:25:11 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container csi-volume-tester ready: false, restart count 0 Nov 26 23:32:15.402: INFO: pfpod started at 2022-11-26 23:30:33 +0000 UTC (0+2 container statuses recorded) Nov 26 23:32:15.402: INFO: Container portforwardtester ready: false, restart count 0 Nov 26 23:32:15.402: INFO: Container readiness ready: false, restart count 0 Nov 26 23:32:15.402: INFO: csi-hostpathplugin-0 started at 2022-11-26 23:19:27 +0000 UTC (0+7 container statuses recorded) Nov 26 23:32:15.402: INFO: Container csi-attacher ready: false, restart count 6 Nov 26 23:32:15.402: INFO: Container csi-provisioner ready: false, restart count 6 Nov 26 23:32:15.402: INFO: Container csi-resizer ready: false, restart count 6 Nov 26 23:32:15.402: INFO: Container csi-snapshotter ready: false, restart count 6 Nov 26 23:32:15.402: INFO: Container hostpath ready: false, restart count 6 Nov 26 23:32:15.402: INFO: Container liveness-probe ready: false, restart count 6 Nov 26 23:32:15.402: INFO: Container node-driver-registrar ready: false, restart count 7 Nov 26 23:32:15.402: INFO: test-container-pod started at 2022-11-26 23:19:29 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container webserver ready: true, restart count 5 Nov 26 23:32:15.402: INFO: csi-mockplugin-0 started at 2022-11-26 23:23:43 +0000 UTC (0+3 container statuses recorded) Nov 26 23:32:15.402: INFO: Container csi-provisioner ready: true, restart count 0 Nov 26 23:32:15.402: INFO: Container driver-registrar ready: true, restart count 0 Nov 26 23:32:15.402: INFO: Container mock ready: true, restart count 0 Nov 26 23:32:15.402: INFO: hostexec-bootstrap-e2e-minion-group-n9b1-tk699 started at 2022-11-26 23:30:33 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container agnhost-container ready: true, restart count 2 Nov 26 23:32:15.402: INFO: agnhost started at 2022-11-26 23:13:56 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container agnhost ready: false, restart count 0 Nov 26 23:32:15.402: INFO: simpletest.rc-z68xn started at 2022-11-26 23:24:10 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:15.402: INFO: konnectivity-agent-bw7hk started at 2022-11-26 23:11:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container konnectivity-agent ready: true, restart count 7 Nov 26 23:32:15.402: INFO: csi-hostpathplugin-0 started at 2022-11-26 23:13:58 +0000 UTC (0+7 container statuses recorded) Nov 26 23:32:15.402: INFO: Container csi-attacher ready: true, restart count 3 Nov 26 23:32:15.402: INFO: Container csi-provisioner ready: true, restart count 3 Nov 26 23:32:15.402: INFO: Container csi-resizer ready: true, restart count 3 Nov 26 23:32:15.402: INFO: Container csi-snapshotter ready: true, restart count 3 Nov 26 23:32:15.402: INFO: Container hostpath ready: true, restart count 3 Nov 26 23:32:15.402: INFO: Container liveness-probe ready: true, restart count 3 Nov 26 23:32:15.402: INFO: Container node-driver-registrar ready: true, restart count 3 Nov 26 23:32:15.402: INFO: concurrent-27825083-ldnwm started at 2022-11-26 23:23:41 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container c ready: false, restart count 0 Nov 26 23:32:15.402: INFO: ss2-0 started at 2022-11-26 23:23:43 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container webserver ready: true, restart count 2 Nov 26 23:32:15.402: INFO: simpletest.rc-ppgv4 started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:15.402: INFO: simpletest.rc-65qg4 started at 2022-11-26 23:24:11 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:15.402: INFO: nfs-injector started at 2022-11-26 23:18:28 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container nfs-injector ready: false, restart count 0 Nov 26 23:32:15.402: INFO: dns-test-c2505ebd-e6a3-455c-9a9f-58dbe21ea53c started at 2022-11-26 23:23:42 +0000 UTC (0+3 container statuses recorded) Nov 26 23:32:15.402: INFO: Container jessie-querier ready: true, restart count 0 Nov 26 23:32:15.402: INFO: Container querier ready: true, restart count 0 Nov 26 23:32:15.402: INFO: Container webserver ready: true, restart count 0 Nov 26 23:32:15.402: INFO: nfs-server started at 2022-11-26 23:18:21 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container nfs-server ready: true, restart count 2 Nov 26 23:32:15.402: INFO: hostexec-bootstrap-e2e-minion-group-n9b1-h77pq started at 2022-11-26 23:19:47 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container agnhost-container ready: true, restart count 2 Nov 26 23:32:15.402: INFO: dns-test-37d137df-f1fb-46b2-81e9-153cb7845ef4 started at 2022-11-26 23:24:14 +0000 UTC (0+3 container statuses recorded) Nov 26 23:32:15.402: INFO: Container jessie-querier ready: true, restart count 2 Nov 26 23:32:15.402: INFO: Container querier ready: true, restart count 2 Nov 26 23:32:15.402: INFO: Container webserver ready: true, restart count 2 Nov 26 23:32:15.402: INFO: pod-ephm-test-projected-ckh4 started at 2022-11-26 23:30:33 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container test-container-subpath-projected-ckh4 ready: false, restart count 0 Nov 26 23:32:15.402: INFO: simpletest.rc-pkd4b started at 2022-11-26 23:24:10 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container nginx ready: true, restart count 4 Nov 26 23:32:15.402: INFO: netserver-2 started at 2022-11-26 23:18:54 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container webserver ready: true, restart count 1 Nov 26 23:32:15.402: INFO: simpletest.rc-2hh6h started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container nginx ready: true, restart count 3 Nov 26 23:32:15.402: INFO: simpletest.rc-qwqsv started at 2022-11-26 23:24:10 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:15.402: INFO: kube-proxy-bootstrap-e2e-minion-group-n9b1 started at 2022-11-26 23:10:52 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container kube-proxy ready: false, restart count 7 Nov 26 23:32:15.402: INFO: metadata-proxy-v0.1-h4wpl started at 2022-11-26 23:10:53 +0000 UTC (0+2 container statuses recorded) Nov 26 23:32:15.402: INFO: Container metadata-proxy ready: true, restart count 0 Nov 26 23:32:15.402: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Nov 26 23:32:15.402: INFO: csi-mockplugin-0 started at 2022-11-26 23:18:51 +0000 UTC (0+3 container statuses recorded) Nov 26 23:32:15.402: INFO: Container csi-provisioner ready: false, restart count 5 Nov 26 23:32:15.402: INFO: Container driver-registrar ready: false, restart count 5 Nov 26 23:32:15.402: INFO: Container mock ready: false, restart count 5 Nov 26 23:32:15.402: INFO: hostexec-bootstrap-e2e-minion-group-n9b1-zsjf9 started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container agnhost-container ready: false, restart count 1 Nov 26 23:32:15.402: INFO: hostexec-bootstrap-e2e-minion-group-n9b1-ltrjk started at 2022-11-26 23:30:57 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container agnhost-container ready: true, restart count 1 Nov 26 23:32:15.402: INFO: pod-secrets-a152d9c1-cdeb-488b-9c0c-b830477f5f6c started at 2022-11-26 23:19:54 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container secret-test ready: true, restart count 3 Nov 26 23:32:15.402: INFO: execpods9dgn started at 2022-11-26 23:18:45 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container agnhost-container ready: false, restart count 3 Nov 26 23:32:15.402: INFO: simpletest.rc-sf5jw started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:15.402: INFO: simpletest.rc-xt677 started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container nginx ready: true, restart count 3 Nov 26 23:32:15.402: INFO: simpletest.rc-vpt65 started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:15.402: INFO: simpletest.rc-hmgxt started at 2022-11-26 23:24:11 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:15.402: INFO: hostexec-bootstrap-e2e-minion-group-n9b1-kj7bs started at 2022-11-26 23:30:33 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container agnhost-container ready: true, restart count 0 Nov 26 23:32:15.402: INFO: pvc-volume-tester-h6ptm started at 2022-11-26 23:24:03 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container volume-tester ready: false, restart count 0 Nov 26 23:32:15.402: INFO: simpletest.rc-ff8cc started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container nginx ready: true, restart count 5 Nov 26 23:32:15.402: INFO: pod-server-2 started at 2022-11-26 23:30:57 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container agnhost-container ready: true, restart count 0 Nov 26 23:32:15.402: INFO: csi-mockplugin-0 started at 2022-11-26 23:13:42 +0000 UTC (0+3 container statuses recorded) Nov 26 23:32:15.402: INFO: Container csi-provisioner ready: false, restart count 6 Nov 26 23:32:15.402: INFO: Container driver-registrar ready: false, restart count 6 Nov 26 23:32:15.402: INFO: Container mock ready: false, restart count 6 Nov 26 23:32:15.402: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 23:13:43 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container csi-attacher ready: true, restart count 3 Nov 26 23:32:15.402: INFO: host-test-container-pod started at 2022-11-26 23:19:29 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container agnhost-container ready: true, restart count 2 Nov 26 23:32:15.402: INFO: simpletest.rc-k95tx started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:15.402: INFO: externalip-test-wfc9z started at 2022-11-26 23:18:39 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container externalip-test ready: true, restart count 1 Nov 26 23:32:15.402: INFO: simpletest.rc-kdbtf started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:15.402: INFO: simpletest.rc-vmg49 started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:15.402: INFO: simpletest.rc-cq84x started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:15.402: INFO: simpletest.rc-vzc27 started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:15.402: INFO: simpletest.rc-pjws9 started at 2022-11-26 23:24:11 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container nginx ready: true, restart count 4 Nov 26 23:32:15.402: INFO: execpoddl5wp started at 2022-11-26 23:18:24 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container agnhost-container ready: true, restart count 3 Nov 26 23:32:15.402: INFO: simpletest.rc-mr42d started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:15.402: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 23:18:51 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container csi-attacher ready: false, restart count 4 Nov 26 23:32:15.402: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 23:13:43 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container csi-attacher ready: true, restart count 5 Nov 26 23:32:15.402: INFO: simpletest.rc-zwjbb started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:15.402: INFO: csi-hostpathplugin-0 started at 2022-11-26 23:24:03 +0000 UTC (0+7 container statuses recorded) Nov 26 23:32:15.402: INFO: Container csi-attacher ready: true, restart count 3 Nov 26 23:32:15.402: INFO: Container csi-provisioner ready: true, restart count 3 Nov 26 23:32:15.402: INFO: Container csi-resizer ready: true, restart count 3 Nov 26 23:32:15.402: INFO: Container csi-snapshotter ready: true, restart count 3 Nov 26 23:32:15.402: INFO: Container hostpath ready: true, restart count 3 Nov 26 23:32:15.402: INFO: Container liveness-probe ready: true, restart count 3 Nov 26 23:32:15.402: INFO: Container node-driver-registrar ready: true, restart count 3 Nov 26 23:32:15.402: INFO: pod-exec-websocket-cb04b6b5-cb7c-4c75-84ae-5d6e56d0b6a4 started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container main ready: true, restart count 0 Nov 26 23:32:15.402: INFO: simpletest.rc-7xb2l started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:15.402: INFO: nfs-server started at 2022-11-26 23:13:40 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container nfs-server ready: true, restart count 6 Nov 26 23:32:15.402: INFO: netserver-2 started at 2022-11-26 23:13:41 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container webserver ready: true, restart count 5 Nov 26 23:32:15.402: INFO: hostpath-symlink-prep-provisioning-2139 started at 2022-11-26 23:13:54 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container init-volume-provisioning-2139 ready: false, restart count 0 Nov 26 23:32:15.402: INFO: inline-volume-tester-kccb4 started at 2022-11-26 23:19:31 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container csi-volume-tester ready: false, restart count 0 Nov 26 23:32:15.402: INFO: hostpath-injector started at 2022-11-26 23:19:35 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container hostpath-injector ready: false, restart count 0 Nov 26 23:32:15.402: INFO: metrics-server-v0.5.2-867b8754b9-6gwjw started at 2022-11-26 23:11:21 +0000 UTC (0+2 container statuses recorded) Nov 26 23:32:15.402: INFO: Container metrics-server ready: false, restart count 7 Nov 26 23:32:15.402: INFO: Container metrics-server-nanny ready: false, restart count 7 Nov 26 23:32:15.402: INFO: netserver-2 started at 2022-11-26 23:19:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container webserver ready: false, restart count 6 Nov 26 23:32:15.402: INFO: csi-hostpathplugin-0 started at 2022-11-26 23:19:31 +0000 UTC (0+7 container statuses recorded) Nov 26 23:32:15.402: INFO: Container csi-attacher ready: true, restart count 7 Nov 26 23:32:15.402: INFO: Container csi-provisioner ready: true, restart count 7 Nov 26 23:32:15.402: INFO: Container csi-resizer ready: true, restart count 7 Nov 26 23:32:15.402: INFO: Container csi-snapshotter ready: true, restart count 7 Nov 26 23:32:15.402: INFO: Container hostpath ready: true, restart count 7 Nov 26 23:32:15.402: INFO: Container liveness-probe ready: true, restart count 7 Nov 26 23:32:15.402: INFO: Container node-driver-registrar ready: true, restart count 7 Nov 26 23:32:15.402: INFO: simpletest.rc-q84md started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container nginx ready: true, restart count 3 Nov 26 23:32:15.402: INFO: simpletest.rc-c4vdk started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:15.402: INFO: simpletest.rc-q96cd started at 2022-11-26 23:24:10 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:15.402: INFO: volume-snapshot-controller-0 started at 2022-11-26 23:11:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container volume-snapshot-controller ready: true, restart count 5 Nov 26 23:32:15.402: INFO: simpletest.rc-2l65q started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:15.402: INFO: simpletest.rc-hzvfz started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:15.402: INFO: simpletest.rc-5cj45 started at 2022-11-26 23:24:10 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:15.402: INFO: concurrent-27825090-rjsjv started at 2022-11-26 23:30:33 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container c ready: false, restart count 0 Nov 26 23:32:15.402: INFO: simpletest.rc-dvg8l started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:15.402: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:16.067: INFO: Latency metrics for node bootstrap-e2e-minion-group-n9b1 STEP: Collecting events from namespace "webhook-9710-markers". 11/26/22 23:32:16.067 STEP: Found 0 events. 11/26/22 23:32:16.108 Nov 26 23:32:16.148: INFO: POD NODE PHASE GRACE CONDITIONS Nov 26 23:32:16.148: INFO: Nov 26 23:32:16.191: INFO: Logging node info for node bootstrap-e2e-master Nov 26 23:32:16.232: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master c85fbb04-d865-42ae-b40a-365f0873d077 8475 0 2022-11-26 23:10:47 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 23:10:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-11-26 23:11:08 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-11-26 23:11:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-11-26 23:29:38 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-6-1-5-ctl-skew/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3858374656 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3596230656 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 23:11:08 +0000 UTC,LastTransitionTime:2022-11-26 23:11:08 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 23:29:38 +0000 UTC,LastTransitionTime:2022-11-26 23:10:47 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 23:29:38 +0000 UTC,LastTransitionTime:2022-11-26 23:10:47 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 23:29:38 +0000 UTC,LastTransitionTime:2022-11-26 23:10:47 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 23:29:38 +0000 UTC,LastTransitionTime:2022-11-26 23:11:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:34.83.128.61,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:51f618a4ea82aa4d3795e4cfa76e3a28,SystemUUID:51f618a4-ea82-aa4d-3795-e4cfa76e3a28,BootID:eb1eb4fb-e105-4d49-9289-0d31902f8c4d,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:135160272,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:124990265,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:57660216,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:2c111f004bec24888d8cfa2a812a38fb8341350abac67dcd0ac64e709dfe389c registry.k8s.io/kas-network-proxy/proxy-server:v0.0.33],SizeBytes:22020129,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 26 23:32:16.233: INFO: Logging kubelet events for node bootstrap-e2e-master Nov 26 23:32:16.276: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-master Nov 26 23:32:16.323: INFO: kube-controller-manager-bootstrap-e2e-master started at 2022-11-26 23:10:04 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.323: INFO: Container kube-controller-manager ready: false, restart count 7 Nov 26 23:32:16.323: INFO: kube-addon-manager-bootstrap-e2e-master started at 2022-11-26 23:10:21 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.323: INFO: Container kube-addon-manager ready: true, restart count 2 Nov 26 23:32:16.323: INFO: l7-lb-controller-bootstrap-e2e-master started at 2022-11-26 23:10:21 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.323: INFO: Container l7-lb-controller ready: false, restart count 7 Nov 26 23:32:16.323: INFO: metadata-proxy-v0.1-cs4d8 started at 2022-11-26 23:11:29 +0000 UTC (0+2 container statuses recorded) Nov 26 23:32:16.323: INFO: Container metadata-proxy ready: true, restart count 0 Nov 26 23:32:16.323: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Nov 26 23:32:16.323: INFO: etcd-server-events-bootstrap-e2e-master started at 2022-11-26 23:10:04 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.323: INFO: Container etcd-container ready: true, restart count 3 Nov 26 23:32:16.323: INFO: etcd-server-bootstrap-e2e-master started at 2022-11-26 23:10:04 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.323: INFO: Container etcd-container ready: true, restart count 4 Nov 26 23:32:16.323: INFO: konnectivity-server-bootstrap-e2e-master started at 2022-11-26 23:10:04 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.323: INFO: Container konnectivity-server-container ready: true, restart count 1 Nov 26 23:32:16.323: INFO: kube-apiserver-bootstrap-e2e-master started at 2022-11-26 23:10:04 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.323: INFO: Container kube-apiserver ready: false, restart count 4 Nov 26 23:32:16.323: INFO: kube-scheduler-bootstrap-e2e-master started at 2022-11-26 23:10:04 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.323: INFO: Container kube-scheduler ready: false, restart count 5 Nov 26 23:32:16.521: INFO: Latency metrics for node bootstrap-e2e-master Nov 26 23:32:16.521: INFO: Logging node info for node bootstrap-e2e-minion-group-dr7t Nov 26 23:32:16.579: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-dr7t b4041686-ad54-48f5-95c3-e848d9a8f0a7 9571 0 2022-11-26 23:10:49 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-dr7t kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-dr7t topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-5883":"bootstrap-e2e-minion-group-dr7t","csi-hostpath-ephemeral-8027":"bootstrap-e2e-minion-group-dr7t","csi-hostpath-volume-expand-3788":"bootstrap-e2e-minion-group-dr7t","csi-mock-csi-mock-volumes-28":"bootstrap-e2e-minion-group-dr7t","csi-mock-csi-mock-volumes-7211":"bootstrap-e2e-minion-group-dr7t"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 23:10:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 23:10:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {node-problem-detector Update v1 2022-11-26 23:29:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-11-26 23:30:04 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-11-26 23:30:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-6-1-5-ctl-skew/us-west1-b/bootstrap-e2e-minion-group-dr7t,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 23:29:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 23:29:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 23:29:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 23:29:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 23:29:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 23:29:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 23:29:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 23:11:08 +0000 UTC,LastTransitionTime:2022-11-26 23:11:08 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 23:30:56 +0000 UTC,LastTransitionTime:2022-11-26 23:10:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 23:30:56 +0000 UTC,LastTransitionTime:2022-11-26 23:10:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 23:30:56 +0000 UTC,LastTransitionTime:2022-11-26 23:10:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 23:30:56 +0000 UTC,LastTransitionTime:2022-11-26 23:10:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:35.185.223.63,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-dr7t.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-dr7t.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:29f409e413f0ebfffc6ee0c012a074c7,SystemUUID:29f409e4-13f0-ebff-fc6e-e0c012a074c7,BootID:a3bfef7b-2d61-4ac5-a15e-34631edb66c9,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 26 23:32:16.580: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-dr7t Nov 26 23:32:16.637: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-dr7t Nov 26 23:32:16.772: INFO: simpletest.rc-ns9qh started at 2022-11-26 23:24:10 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.772: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:16.772: INFO: backofflimit-k6h5t started at 2022-11-26 23:31:02 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.772: INFO: Container c ready: false, restart count 0 Nov 26 23:32:16.772: INFO: coredns-6d97d5ddb-tfljm started at 2022-11-26 23:11:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.772: INFO: Container coredns ready: false, restart count 7 Nov 26 23:32:16.772: INFO: konnectivity-agent-bdgkf started at 2022-11-26 23:11:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.772: INFO: Container konnectivity-agent ready: false, restart count 6 Nov 26 23:32:16.772: INFO: inline-volume-tester-mndlt started at 2022-11-26 23:14:00 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.772: INFO: Container csi-volume-tester ready: false, restart count 0 Nov 26 23:32:16.772: INFO: csi-hostpathplugin-0 started at 2022-11-26 23:20:01 +0000 UTC (0+7 container statuses recorded) Nov 26 23:32:16.772: INFO: Container csi-attacher ready: false, restart count 5 Nov 26 23:32:16.772: INFO: Container csi-provisioner ready: false, restart count 5 Nov 26 23:32:16.772: INFO: Container csi-resizer ready: false, restart count 5 Nov 26 23:32:16.772: INFO: Container csi-snapshotter ready: false, restart count 5 Nov 26 23:32:16.772: INFO: Container hostpath ready: false, restart count 5 Nov 26 23:32:16.772: INFO: Container liveness-probe ready: false, restart count 5 Nov 26 23:32:16.772: INFO: Container node-driver-registrar ready: false, restart count 5 Nov 26 23:32:16.772: INFO: simpletest.rc-r48g7 started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.772: INFO: Container nginx ready: true, restart count 4 Nov 26 23:32:16.772: INFO: externalip-test-glqb4 started at 2022-11-26 23:18:39 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.772: INFO: Container externalip-test ready: true, restart count 4 Nov 26 23:32:16.772: INFO: simpletest.rc-74l76 started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.772: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:16.772: INFO: ss2-0 started at 2022-11-26 23:30:57 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.772: INFO: Container webserver ready: true, restart count 0 Nov 26 23:32:16.772: INFO: simpletest.rc-t7xqp started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.772: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:16.772: INFO: simpletest.rc-k6n62 started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.772: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:16.772: INFO: simpletest.rc-pwcsr started at 2022-11-26 23:24:10 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.772: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:16.772: INFO: kube-proxy-bootstrap-e2e-minion-group-dr7t started at 2022-11-26 23:10:49 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.772: INFO: Container kube-proxy ready: false, restart count 7 Nov 26 23:32:16.772: INFO: simpletest.rc-gqz24 started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.772: INFO: Container nginx ready: false, restart count 2 Nov 26 23:32:16.772: INFO: csi-hostpathplugin-0 started at 2022-11-26 23:15:49 +0000 UTC (0+7 container statuses recorded) Nov 26 23:32:16.772: INFO: Container csi-attacher ready: true, restart count 4 Nov 26 23:32:16.772: INFO: Container csi-provisioner ready: true, restart count 4 Nov 26 23:32:16.772: INFO: Container csi-resizer ready: true, restart count 4 Nov 26 23:32:16.772: INFO: Container csi-snapshotter ready: true, restart count 4 Nov 26 23:32:16.772: INFO: Container hostpath ready: true, restart count 4 Nov 26 23:32:16.772: INFO: Container liveness-probe ready: true, restart count 4 Nov 26 23:32:16.772: INFO: Container node-driver-registrar ready: true, restart count 4 Nov 26 23:32:16.772: INFO: simpletest.rc-k5zrz started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.772: INFO: Container nginx ready: false, restart count 4 Nov 26 23:32:16.772: INFO: simpletest.rc-c5h8h started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.772: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:16.772: INFO: e2e-2gjr9-9fzdt started at 2022-11-26 23:13:41 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.772: INFO: Container c ready: false, restart count 0 Nov 26 23:32:16.772: INFO: client-envvars-94091b6a-29ad-4b9a-9ad7-528612eb4de4 started at 2022-11-26 23:13:52 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.772: INFO: Container env3cont ready: false, restart count 0 Nov 26 23:32:16.772: INFO: simpletest.rc-v9jc5 started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.772: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:16.772: INFO: externalname-service-kgwxz started at 2022-11-26 23:30:56 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.772: INFO: Container externalname-service ready: true, restart count 0 Nov 26 23:32:16.772: INFO: netserver-0 started at 2022-11-26 23:13:40 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.772: INFO: Container webserver ready: true, restart count 7 Nov 26 23:32:16.772: INFO: simpletest.rc-z4cfk started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.772: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:16.772: INFO: e2e-2gjr9-mw95z started at 2022-11-26 23:13:46 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.772: INFO: Container c ready: false, restart count 0 Nov 26 23:32:16.772: INFO: simpletest.rc-5lcbg started at 2022-11-26 23:24:11 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.772: INFO: Container nginx ready: true, restart count 5 Nov 26 23:32:16.772: INFO: test-rs-7t6dx started at 2022-11-26 23:30:55 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.772: INFO: Container httpd ready: false, restart count 1 Nov 26 23:32:16.772: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 23:23:56 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.772: INFO: Container csi-attacher ready: true, restart count 4 Nov 26 23:32:16.772: INFO: simpletest.rc-grs4f started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.772: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:16.772: INFO: simpletest.rc-d4qlz started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.772: INFO: Container nginx ready: true, restart count 3 Nov 26 23:32:16.772: INFO: kube-dns-autoscaler-5f6455f985-2twl5 started at 2022-11-26 23:11:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.772: INFO: Container autoscaler ready: false, restart count 7 Nov 26 23:32:16.772: INFO: hostexec-bootstrap-e2e-minion-group-dr7t-ssljm started at 2022-11-26 23:13:55 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.772: INFO: Container agnhost-container ready: true, restart count 4 Nov 26 23:32:16.772: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 23:13:58 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.772: INFO: Container csi-attacher ready: true, restart count 5 Nov 26 23:32:16.772: INFO: test-rs-zwkkr started at 2022-11-26 23:19:54 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.772: INFO: Container httpd ready: true, restart count 5 Nov 26 23:32:16.772: INFO: csi-mockplugin-0 started at 2022-11-26 23:23:56 +0000 UTC (0+3 container statuses recorded) Nov 26 23:32:16.772: INFO: Container csi-provisioner ready: true, restart count 4 Nov 26 23:32:16.772: INFO: Container driver-registrar ready: true, restart count 5 Nov 26 23:32:16.772: INFO: Container mock ready: true, restart count 4 Nov 26 23:32:16.772: INFO: simpletest.rc-fvdxd started at 2022-11-26 23:24:10 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.772: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:16.772: INFO: simpletest.rc-hrx7l started at 2022-11-26 23:24:11 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.773: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:16.773: INFO: replace-27825091-d7l4n started at 2022-11-26 23:31:00 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.773: INFO: Container c ready: true, restart count 1 Nov 26 23:32:16.773: INFO: external-provisioner-wrpbw started at 2022-11-26 23:14:05 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.773: INFO: Container nfs-provisioner ready: true, restart count 4 Nov 26 23:32:16.773: INFO: pod1 started at 2022-11-26 23:18:15 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.773: INFO: Container agnhost-container ready: false, restart count 3 Nov 26 23:32:16.773: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 23:15:48 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.773: INFO: Container csi-attacher ready: false, restart count 5 Nov 26 23:32:16.773: INFO: inline-volume-tester-65qqv started at 2022-11-26 23:23:51 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.773: INFO: Container csi-volume-tester ready: false, restart count 0 Nov 26 23:32:16.773: INFO: simpletest.rc-cvkmj started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.773: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:16.773: INFO: csi-mockplugin-0 started at 2022-11-26 23:16:14 +0000 UTC (0+4 container statuses recorded) Nov 26 23:32:16.773: INFO: Container busybox ready: false, restart count 6 Nov 26 23:32:16.773: INFO: Container csi-provisioner ready: false, restart count 6 Nov 26 23:32:16.773: INFO: Container driver-registrar ready: true, restart count 6 Nov 26 23:32:16.773: INFO: Container mock ready: true, restart count 6 Nov 26 23:32:16.773: INFO: successful-jobs-history-limit-27825091-mr7tr started at 2022-11-26 23:31:00 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.773: INFO: Container c ready: false, restart count 0 Nov 26 23:32:16.773: INFO: simpletest.rc-vj7jd started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.773: INFO: Container nginx ready: false, restart count 4 Nov 26 23:32:16.773: INFO: simpletest.rc-7c2t4 started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.773: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:16.773: INFO: simpletest.rc-mvsml started at 2022-11-26 23:24:10 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.773: INFO: Container nginx ready: false, restart count 1 Nov 26 23:32:16.773: INFO: external-provisioner-9dc9l started at 2022-11-26 23:13:43 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.773: INFO: Container nfs-provisioner ready: true, restart count 4 Nov 26 23:32:16.773: INFO: simpletest.rc-fwmr7 started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.773: INFO: Container nginx ready: true, restart count 3 Nov 26 23:32:16.773: INFO: hostexec-bootstrap-e2e-minion-group-dr7t-4qhfn started at 2022-11-26 23:24:03 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.773: INFO: Container agnhost-container ready: true, restart count 2 Nov 26 23:32:16.773: INFO: ss2-2 started at 2022-11-26 23:30:33 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.773: INFO: Container webserver ready: true, restart count 2 Nov 26 23:32:16.773: INFO: simpletest.rc-m6r9w started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.773: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:16.773: INFO: netserver-0 started at 2022-11-26 23:30:55 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.773: INFO: Container webserver ready: true, restart count 2 Nov 26 23:32:16.773: INFO: client-containers-a07ad6d5-f09c-4873-aa1a-59d19e7db754 started at 2022-11-26 23:30:56 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.773: INFO: Container agnhost-container ready: true, restart count 0 Nov 26 23:32:16.773: INFO: external-provisioner-fwvdj started at 2022-11-26 23:13:53 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.773: INFO: Container nfs-provisioner ready: true, restart count 5 Nov 26 23:32:16.773: INFO: csi-mockplugin-0 started at 2022-11-26 23:15:48 +0000 UTC (0+3 container statuses recorded) Nov 26 23:32:16.773: INFO: Container csi-provisioner ready: false, restart count 5 Nov 26 23:32:16.773: INFO: Container driver-registrar ready: true, restart count 6 Nov 26 23:32:16.773: INFO: Container mock ready: false, restart count 5 Nov 26 23:32:16.773: INFO: simpletest.rc-bbtzn started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.773: INFO: Container nginx ready: false, restart count 2 Nov 26 23:32:16.773: INFO: simpletest.rc-kkv97 started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.773: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:16.773: INFO: hostexec-bootstrap-e2e-minion-group-dr7t-8hn6w started at 2022-11-26 23:30:33 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.773: INFO: Container agnhost-container ready: true, restart count 0 Nov 26 23:32:16.773: INFO: hostpath-symlink-prep-provisioning-2423 started at 2022-11-26 23:14:01 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.773: INFO: Container init-volume-provisioning-2423 ready: false, restart count 0 Nov 26 23:32:16.773: INFO: netserver-0 started at 2022-11-26 23:18:54 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.773: INFO: Container webserver ready: true, restart count 6 Nov 26 23:32:16.773: INFO: netserver-0 started at 2022-11-26 23:19:06 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.773: INFO: Container webserver ready: false, restart count 6 Nov 26 23:32:16.773: INFO: simpletest.rc-v5cwl started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.773: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:16.773: INFO: simpletest.rc-5xfcl started at 2022-11-26 23:24:10 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.773: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:16.773: INFO: csi-hostpathplugin-0 started at 2022-11-26 23:13:45 +0000 UTC (0+7 container statuses recorded) Nov 26 23:32:16.773: INFO: Container csi-attacher ready: false, restart count 6 Nov 26 23:32:16.773: INFO: Container csi-provisioner ready: false, restart count 6 Nov 26 23:32:16.773: INFO: Container csi-resizer ready: false, restart count 6 Nov 26 23:32:16.773: INFO: Container csi-snapshotter ready: false, restart count 6 Nov 26 23:32:16.773: INFO: Container hostpath ready: false, restart count 6 Nov 26 23:32:16.773: INFO: Container liveness-probe ready: false, restart count 6 Nov 26 23:32:16.773: INFO: Container node-driver-registrar ready: false, restart count 6 Nov 26 23:32:16.773: INFO: csi-hostpathplugin-0 started at 2022-11-26 23:15:48 +0000 UTC (0+7 container statuses recorded) Nov 26 23:32:16.773: INFO: Container csi-attacher ready: true, restart count 2 Nov 26 23:32:16.773: INFO: Container csi-provisioner ready: true, restart count 2 Nov 26 23:32:16.773: INFO: Container csi-resizer ready: true, restart count 2 Nov 26 23:32:16.773: INFO: Container csi-snapshotter ready: true, restart count 2 Nov 26 23:32:16.773: INFO: Container hostpath ready: true, restart count 2 Nov 26 23:32:16.773: INFO: Container liveness-probe ready: true, restart count 2 Nov 26 23:32:16.773: INFO: Container node-driver-registrar ready: true, restart count 2 Nov 26 23:32:16.773: INFO: simpletest.rc-lmsws started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.773: INFO: Container nginx ready: true, restart count 3 Nov 26 23:32:16.773: INFO: concurrent-27825091-kqhhk started at 2022-11-26 23:31:00 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.773: INFO: Container c ready: false, restart count 0 Nov 26 23:32:16.773: INFO: csi-mockplugin-0 started at 2022-11-26 23:13:58 +0000 UTC (0+3 container statuses recorded) Nov 26 23:32:16.773: INFO: Container csi-provisioner ready: true, restart count 5 Nov 26 23:32:16.773: INFO: Container driver-registrar ready: true, restart count 5 Nov 26 23:32:16.773: INFO: Container mock ready: true, restart count 5 Nov 26 23:32:16.773: INFO: simpletest.rc-vmjnr started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.773: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:16.773: INFO: simpletest.rc-jz7rl started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.773: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:16.773: INFO: simpletest.rc-fgdjw started at 2022-11-26 23:24:11 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.773: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:16.773: INFO: metadata-proxy-v0.1-5cxbq started at 2022-11-26 23:10:50 +0000 UTC (0+2 container statuses recorded) Nov 26 23:32:16.773: INFO: Container metadata-proxy ready: true, restart count 0 Nov 26 23:32:16.773: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Nov 26 23:32:16.773: INFO: pod-hostip-ca4d6a7e-d19f-41f7-a0c0-3ba1daa0f976 started at 2022-11-26 23:23:56 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.773: INFO: Container test ready: true, restart count 2 Nov 26 23:32:16.773: INFO: simpletest.rc-vqn8l started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.773: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:16.773: INFO: external-provisioner-fslzm started at 2022-11-26 23:30:55 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.773: INFO: Container nfs-provisioner ready: true, restart count 2 Nov 26 23:32:16.773: INFO: simpletest.rc-4xnc8 started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.773: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:16.773: INFO: csi-mockplugin-resizer-0 started at 2022-11-26 23:13:58 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.773: INFO: Container csi-resizer ready: true, restart count 5 Nov 26 23:32:16.773: INFO: simpletest.rc-c9cjf started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.773: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:16.773: INFO: sample-webhook-deployment-865554f4d9-l9hxx started at 2022-11-26 23:30:56 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:16.773: INFO: Container sample-webhook ready: true, restart count 0 Nov 26 23:32:17.290: INFO: Latency metrics for node bootstrap-e2e-minion-group-dr7t Nov 26 23:32:17.290: INFO: Logging node info for node bootstrap-e2e-minion-group-l8ht Nov 26 23:32:17.332: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-l8ht 3e5210d0-ba6b-4f56-896c-40aaae5093d0 9667 0 2022-11-26 23:10:52 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-l8ht kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-l8ht topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-2215":"bootstrap-e2e-minion-group-l8ht","csi-hostpath-ephemeral-3757":"bootstrap-e2e-minion-group-l8ht","csi-mock-csi-mock-volumes-1468":"bootstrap-e2e-minion-group-l8ht","csi-mock-csi-mock-volumes-355":"bootstrap-e2e-minion-group-l8ht","csi-mock-csi-mock-volumes-7659":"bootstrap-e2e-minion-group-l8ht"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 23:10:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 23:10:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {node-problem-detector Update v1 2022-11-26 23:29:41 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-11-26 23:30:56 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2022-11-26 23:30:59 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-6-1-5-ctl-skew/us-west1-b/bootstrap-e2e-minion-group-l8ht,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 23:29:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 23:29:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 23:29:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 23:29:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 23:29:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 23:29:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 23:29:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 23:11:08 +0000 UTC,LastTransitionTime:2022-11-26 23:11:08 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 23:30:56 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 23:30:56 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 23:30:56 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 23:30:56 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:34.168.47.71,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-l8ht.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-l8ht.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:89b0fd3f78d194fccba6eb2ce27680f6,SystemUUID:89b0fd3f-78d1-94fc-cba6-eb2ce27680f6,BootID:ec1fa0a7-81b7-48ec-8da0-cc1b45a14fc8,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-2215^54ec9437-6de2-11ed-a59d-c2129b99100c kubernetes.io/csi/csi-hostpath-ephemeral-2215^5e526a82-6de2-11ed-a59d-c2129b99100c kubernetes.io/csi/csi-hostpath-provisioning-55^28d8d761-6de0-11ed-8c44-7ec558aa6670],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-2215^5e526a82-6de2-11ed-a59d-c2129b99100c,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-55^28d8d761-6de0-11ed-8c44-7ec558aa6670,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-2215^54ec9437-6de2-11ed-a59d-c2129b99100c,DevicePath:,},},Config:nil,},} Nov 26 23:32:17.333: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-l8ht Nov 26 23:32:17.382: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-l8ht Nov 26 23:32:17.513: INFO: kube-proxy-bootstrap-e2e-minion-group-l8ht started at 2022-11-26 23:10:52 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.513: INFO: Container kube-proxy ready: false, restart count 7 Nov 26 23:32:17.513: INFO: netserver-1 started at 2022-11-26 23:19:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.513: INFO: Container webserver ready: true, restart count 2 Nov 26 23:32:17.513: INFO: simpletest.rc-8kjlk started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.513: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:17.513: INFO: simpletest.rc-wzrjg started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.513: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:17.513: INFO: csi-mockplugin-0 started at 2022-11-26 23:30:33 +0000 UTC (0+3 container statuses recorded) Nov 26 23:32:17.513: INFO: Container csi-provisioner ready: true, restart count 0 Nov 26 23:32:17.513: INFO: Container driver-registrar ready: true, restart count 0 Nov 26 23:32:17.513: INFO: Container mock ready: true, restart count 0 Nov 26 23:32:17.513: INFO: forbid-27825091-7wspw started at 2022-11-26 23:31:00 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.513: INFO: Container c ready: false, restart count 0 Nov 26 23:32:17.513: INFO: metadata-proxy-v0.1-n8dk7 started at 2022-11-26 23:10:53 +0000 UTC (0+2 container statuses recorded) Nov 26 23:32:17.513: INFO: Container metadata-proxy ready: true, restart count 0 Nov 26 23:32:17.513: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Nov 26 23:32:17.513: INFO: simpletest.rc-zr9cg started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.513: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:17.513: INFO: simpletest.rc-2j7wd started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.513: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:17.513: INFO: e2e-2gjr9-n7ngv started at 2022-11-26 23:13:53 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.513: INFO: Container c ready: false, restart count 0 Nov 26 23:32:17.513: INFO: csi-mockplugin-0 started at 2022-11-26 23:15:47 +0000 UTC (0+3 container statuses recorded) Nov 26 23:32:17.513: INFO: Container csi-provisioner ready: false, restart count 6 Nov 26 23:32:17.513: INFO: Container driver-registrar ready: false, restart count 6 Nov 26 23:32:17.513: INFO: Container mock ready: false, restart count 6 Nov 26 23:32:17.513: INFO: csi-hostpathplugin-0 started at 2022-11-26 23:19:22 +0000 UTC (0+7 container statuses recorded) Nov 26 23:32:17.513: INFO: Container csi-attacher ready: false, restart count 6 Nov 26 23:32:17.513: INFO: Container csi-provisioner ready: false, restart count 6 Nov 26 23:32:17.513: INFO: Container csi-resizer ready: false, restart count 6 Nov 26 23:32:17.513: INFO: Container csi-snapshotter ready: false, restart count 6 Nov 26 23:32:17.513: INFO: Container hostpath ready: false, restart count 6 Nov 26 23:32:17.513: INFO: Container liveness-probe ready: false, restart count 6 Nov 26 23:32:17.513: INFO: Container node-driver-registrar ready: false, restart count 6 Nov 26 23:32:17.513: INFO: simpletest.rc-vfphz started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.513: INFO: Container nginx ready: false, restart count 3 Nov 26 23:32:17.513: INFO: simpletest.rc-dhxfz started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.513: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:17.513: INFO: simpletest.rc-s4mxg started at 2022-11-26 23:24:10 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.513: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:17.513: INFO: csi-mockplugin-0 started at 2022-11-26 23:24:10 +0000 UTC (0+3 container statuses recorded) Nov 26 23:32:17.513: INFO: Container csi-provisioner ready: true, restart count 3 Nov 26 23:32:17.513: INFO: Container driver-registrar ready: true, restart count 3 Nov 26 23:32:17.513: INFO: Container mock ready: true, restart count 3 Nov 26 23:32:17.513: INFO: csi-mockplugin-0 started at 2022-11-26 23:13:55 +0000 UTC (0+4 container statuses recorded) Nov 26 23:32:17.513: INFO: Container busybox ready: false, restart count 7 Nov 26 23:32:17.513: INFO: Container csi-provisioner ready: false, restart count 7 Nov 26 23:32:17.513: INFO: Container driver-registrar ready: false, restart count 7 Nov 26 23:32:17.513: INFO: Container mock ready: false, restart count 7 Nov 26 23:32:17.513: INFO: concurrent-27825084-6s8hd started at 2022-11-26 23:24:00 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.513: INFO: Container c ready: false, restart count 0 Nov 26 23:32:17.513: INFO: pod2 started at 2022-11-26 23:18:17 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.513: INFO: Container agnhost-container ready: true, restart count 4 Nov 26 23:32:17.513: INFO: csi-hostpathplugin-0 started at 2022-11-26 23:18:19 +0000 UTC (0+7 container statuses recorded) Nov 26 23:32:17.513: INFO: Container csi-attacher ready: false, restart count 3 Nov 26 23:32:17.513: INFO: Container csi-provisioner ready: false, restart count 3 Nov 26 23:32:17.513: INFO: Container csi-resizer ready: false, restart count 3 Nov 26 23:32:17.513: INFO: Container csi-snapshotter ready: false, restart count 3 Nov 26 23:32:17.513: INFO: Container hostpath ready: false, restart count 3 Nov 26 23:32:17.513: INFO: Container liveness-probe ready: false, restart count 3 Nov 26 23:32:17.513: INFO: Container node-driver-registrar ready: false, restart count 3 Nov 26 23:32:17.513: INFO: simpletest.rc-wrg78 started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.513: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:17.513: INFO: simpletest.rc-9zsmr started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.513: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:17.513: INFO: sample-webhook-deployment-865554f4d9-k8x2c started at 2022-11-26 23:30:56 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.513: INFO: Container sample-webhook ready: true, restart count 3 Nov 26 23:32:17.513: INFO: csi-hostpathplugin-0 started at 2022-11-26 23:13:43 +0000 UTC (0+7 container statuses recorded) Nov 26 23:32:17.513: INFO: Container csi-attacher ready: false, restart count 4 Nov 26 23:32:17.513: INFO: Container csi-provisioner ready: false, restart count 4 Nov 26 23:32:17.513: INFO: Container csi-resizer ready: false, restart count 4 Nov 26 23:32:17.513: INFO: Container csi-snapshotter ready: false, restart count 4 Nov 26 23:32:17.513: INFO: Container hostpath ready: false, restart count 4 Nov 26 23:32:17.513: INFO: Container liveness-probe ready: false, restart count 4 Nov 26 23:32:17.513: INFO: Container node-driver-registrar ready: false, restart count 5 Nov 26 23:32:17.513: INFO: external-provisioner-l4hjd started at 2022-11-26 23:18:15 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.513: INFO: Container nfs-provisioner ready: true, restart count 4 Nov 26 23:32:17.513: INFO: simpletest.rc-47jfp started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.513: INFO: Container nginx ready: true, restart count 3 Nov 26 23:32:17.513: INFO: simpletest.rc-768cr started at 2022-11-26 23:24:11 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.513: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:17.513: INFO: netserver-1 started at 2022-11-26 23:30:55 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.513: INFO: Container webserver ready: true, restart count 2 Nov 26 23:32:17.513: INFO: konnectivity-agent-rhvvx started at 2022-11-26 23:11:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.513: INFO: Container konnectivity-agent ready: false, restart count 7 Nov 26 23:32:17.513: INFO: ss2-1 started at 2022-11-26 23:30:42 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.513: INFO: Container webserver ready: true, restart count 2 Nov 26 23:32:17.513: INFO: test-rs-4vhzr started at 2022-11-26 23:31:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.513: INFO: Container httpd ready: true, restart count 0 Nov 26 23:32:17.513: INFO: simpletest.rc-7n2qg started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.513: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:17.513: INFO: simpletest.rc-lslmb started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.513: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:17.513: INFO: test-cleanup-controller-w66lq started at 2022-11-26 23:14:02 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.513: INFO: Container httpd ready: true, restart count 3 Nov 26 23:32:17.513: INFO: simpletest.rc-vzb6t started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.513: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:17.513: INFO: simpletest.rc-7ppxt started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.513: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:17.513: INFO: simpletest.rc-rczdt started at 2022-11-26 23:24:10 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.513: INFO: Container nginx ready: true, restart count 3 Nov 26 23:32:17.513: INFO: inline-volume-tester-rx8k7 started at 2022-11-26 23:30:38 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.513: INFO: Container csi-volume-tester ready: false, restart count 0 Nov 26 23:32:17.513: INFO: netserver-1 started at 2022-11-26 23:13:40 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.513: INFO: Container webserver ready: false, restart count 8 Nov 26 23:32:17.513: INFO: test-rs-rlcd5 started at 2022-11-26 23:19:54 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.513: INFO: Container httpd ready: true, restart count 1 Nov 26 23:32:17.513: INFO: simpletest.rc-9sc82 started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.513: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:17.513: INFO: simpletest.rc-q8q28 started at 2022-11-26 23:24:10 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.513: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:17.513: INFO: hostexec-bootstrap-e2e-minion-group-l8ht-6ffqj started at 2022-11-26 23:14:05 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.513: INFO: Container agnhost-container ready: true, restart count 5 Nov 26 23:32:17.513: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 23:30:33 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.513: INFO: Container csi-attacher ready: true, restart count 0 Nov 26 23:32:17.513: INFO: inline-volume-tester-nqd44 started at 2022-11-26 23:18:28 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.513: INFO: Container csi-volume-tester ready: false, restart count 0 Nov 26 23:32:17.513: INFO: simpletest.rc-2mfcn started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.513: INFO: Container nginx ready: true, restart count 3 Nov 26 23:32:17.513: INFO: simpletest.rc-88vj9 started at 2022-11-26 23:24:11 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.513: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:17.513: INFO: simpletest.rc-zrvv5 started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.513: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:17.513: INFO: simpletest.rc-j6nhq started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.513: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:17.513: INFO: coredns-6d97d5ddb-j25mc started at 2022-11-26 23:11:12 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.513: INFO: Container coredns ready: false, restart count 7 Nov 26 23:32:17.513: INFO: simpletest.rc-hfg2l started at 2022-11-26 23:24:10 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.513: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:17.513: INFO: simpletest.rc-t5r8v started at 2022-11-26 23:24:11 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.513: INFO: Container nginx ready: false, restart count 3 Nov 26 23:32:17.514: INFO: hostexec-bootstrap-e2e-minion-group-l8ht-xvf2z started at 2022-11-26 23:30:33 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.514: INFO: Container agnhost-container ready: true, restart count 0 Nov 26 23:32:17.514: INFO: netserver-1 started at 2022-11-26 23:18:54 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.514: INFO: Container webserver ready: false, restart count 3 Nov 26 23:32:17.514: INFO: simpletest.rc-fdktq started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.514: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:17.514: INFO: pod-2c9ca969-f71c-470c-a591-eddc5680ebb6 started at 2022-11-26 23:15:47 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.514: INFO: Container write-pod ready: false, restart count 0 Nov 26 23:32:17.514: INFO: simpletest.rc-hvsd4 started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.514: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:17.514: INFO: simpletest.rc-95pbd started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.514: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:17.514: INFO: simpletest.rc-czsr7 started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.514: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:17.514: INFO: simpletest.rc-mvdr4 started at 2022-11-26 23:24:10 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.514: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:17.514: INFO: inline-volume-tester2-4fbtj started at 2022-11-26 23:30:54 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.514: INFO: Container csi-volume-tester ready: true, restart count 0 Nov 26 23:32:17.514: INFO: externalname-service-6jhjf started at 2022-11-26 23:30:56 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.514: INFO: Container externalname-service ready: true, restart count 0 Nov 26 23:32:17.514: INFO: csi-hostpathplugin-0 started at 2022-11-26 23:14:04 +0000 UTC (0+7 container statuses recorded) Nov 26 23:32:17.514: INFO: Container csi-attacher ready: false, restart count 7 Nov 26 23:32:17.514: INFO: Container csi-provisioner ready: false, restart count 7 Nov 26 23:32:17.514: INFO: Container csi-resizer ready: false, restart count 7 Nov 26 23:32:17.514: INFO: Container csi-snapshotter ready: false, restart count 7 Nov 26 23:32:17.514: INFO: Container hostpath ready: false, restart count 7 Nov 26 23:32:17.514: INFO: Container liveness-probe ready: false, restart count 7 Nov 26 23:32:17.514: INFO: Container node-driver-registrar ready: false, restart count 6 Nov 26 23:32:17.514: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 23:15:47 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.514: INFO: Container csi-attacher ready: true, restart count 4 Nov 26 23:32:17.514: INFO: liveness-d534e81f-ba57-43f0-a7ed-ae77c4a39ae7 started at 2022-11-26 23:23:58 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.514: INFO: Container agnhost-container ready: true, restart count 1 Nov 26 23:32:17.514: INFO: simpletest.rc-d8tnq started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.514: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:17.514: INFO: simpletest.rc-tmr7r started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.514: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:17.514: INFO: concurrent-27825091-4rnxd started at 2022-11-26 23:31:00 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.514: INFO: Container c ready: false, restart count 0 Nov 26 23:32:17.514: INFO: csi-hostpathplugin-0 started at 2022-11-26 23:30:33 +0000 UTC (0+7 container statuses recorded) Nov 26 23:32:17.514: INFO: Container csi-attacher ready: true, restart count 0 Nov 26 23:32:17.514: INFO: Container csi-provisioner ready: true, restart count 0 Nov 26 23:32:17.514: INFO: Container csi-resizer ready: true, restart count 0 Nov 26 23:32:17.514: INFO: Container csi-snapshotter ready: true, restart count 0 Nov 26 23:32:17.514: INFO: Container hostpath ready: true, restart count 0 Nov 26 23:32:17.514: INFO: Container liveness-probe ready: true, restart count 0 Nov 26 23:32:17.514: INFO: Container node-driver-registrar ready: true, restart count 0 Nov 26 23:32:17.514: INFO: simpletest.rc-t7wx8 started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.514: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:17.514: INFO: simpletest.rc-p9bpg started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.514: INFO: Container nginx ready: true, restart count 3 Nov 26 23:32:17.514: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 23:24:11 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:17.514: INFO: Container csi-attacher ready: true, restart count 2 Nov 26 23:32:19.206: INFO: Latency metrics for node bootstrap-e2e-minion-group-l8ht Nov 26 23:32:19.206: INFO: Logging node info for node bootstrap-e2e-minion-group-n9b1 Nov 26 23:32:19.246: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-n9b1 796907e0-52c8-4c84-815a-6442939836c4 9381 0 2022-11-26 23:10:52 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-n9b1 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-n9b1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-5727":"bootstrap-e2e-minion-group-n9b1","csi-hostpath-ephemeral-9647":"bootstrap-e2e-minion-group-n9b1","csi-hostpath-provisioning-254":"bootstrap-e2e-minion-group-n9b1","csi-mock-csi-mock-volumes-7584":"bootstrap-e2e-minion-group-n9b1","csi-mock-csi-mock-volumes-7940":"bootstrap-e2e-minion-group-n9b1"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 23:10:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 23:10:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {node-problem-detector Update v1 2022-11-26 23:29:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-11-26 23:30:05 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2022-11-26 23:30:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-6-1-5-ctl-skew/us-west1-b/bootstrap-e2e-minion-group-n9b1,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 23:29:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 23:29:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 23:29:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 23:29:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 23:29:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 23:29:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 23:29:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 23:11:08 +0000 UTC,LastTransitionTime:2022-11-26 23:11:08 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 23:29:38 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 23:29:38 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 23:29:38 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 23:29:38 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.145.73.48,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-n9b1.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-n9b1.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:47bcd2b143b08ae3cf2e280a7c6e673a,SystemUUID:47bcd2b1-43b0-8ae3-cf2e-280a7c6e673a,BootID:c567f407-918f-4298-a12f-a33a4e211fcf,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 registry.k8s.io/sig-storage/snapshot-controller:v6.1.0],SizeBytes:22620891,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-5727^70b85a3d-6de1-11ed-852d-36e7a9ac0592 kubernetes.io/csi/csi-hostpath-provisioning-169^c8e3d50b-6de0-11ed-aed4-6a12d5ab5936],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-169^c8e3d50b-6de0-11ed-aed4-6a12d5ab5936,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-5727^70b85a3d-6de1-11ed-852d-36e7a9ac0592,DevicePath:,},},Config:nil,},} Nov 26 23:32:19.247: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-n9b1 Nov 26 23:32:19.290: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-n9b1 Nov 26 23:32:19.732: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 23:13:43 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container csi-attacher ready: true, restart count 5 Nov 26 23:32:19.732: INFO: simpletest.rc-zwjbb started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:19.732: INFO: csi-hostpathplugin-0 started at 2022-11-26 23:24:03 +0000 UTC (0+7 container statuses recorded) Nov 26 23:32:19.732: INFO: Container csi-attacher ready: true, restart count 3 Nov 26 23:32:19.732: INFO: Container csi-provisioner ready: true, restart count 3 Nov 26 23:32:19.732: INFO: Container csi-resizer ready: true, restart count 3 Nov 26 23:32:19.732: INFO: Container csi-snapshotter ready: true, restart count 3 Nov 26 23:32:19.732: INFO: Container hostpath ready: true, restart count 3 Nov 26 23:32:19.732: INFO: Container liveness-probe ready: true, restart count 3 Nov 26 23:32:19.732: INFO: Container node-driver-registrar ready: true, restart count 3 Nov 26 23:32:19.732: INFO: pod-exec-websocket-cb04b6b5-cb7c-4c75-84ae-5d6e56d0b6a4 started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container main ready: true, restart count 0 Nov 26 23:32:19.732: INFO: simpletest.rc-7xb2l started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:19.732: INFO: nfs-server started at 2022-11-26 23:13:40 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container nfs-server ready: true, restart count 6 Nov 26 23:32:19.732: INFO: netserver-2 started at 2022-11-26 23:13:41 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container webserver ready: true, restart count 5 Nov 26 23:32:19.732: INFO: hostpath-symlink-prep-provisioning-2139 started at 2022-11-26 23:13:54 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container init-volume-provisioning-2139 ready: false, restart count 0 Nov 26 23:32:19.732: INFO: inline-volume-tester-kccb4 started at 2022-11-26 23:19:31 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container csi-volume-tester ready: false, restart count 0 Nov 26 23:32:19.732: INFO: hostpath-injector started at 2022-11-26 23:19:35 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container hostpath-injector ready: false, restart count 0 Nov 26 23:32:19.732: INFO: metrics-server-v0.5.2-867b8754b9-6gwjw started at 2022-11-26 23:11:21 +0000 UTC (0+2 container statuses recorded) Nov 26 23:32:19.732: INFO: Container metrics-server ready: false, restart count 7 Nov 26 23:32:19.732: INFO: Container metrics-server-nanny ready: false, restart count 7 Nov 26 23:32:19.732: INFO: simpletest.rc-q96cd started at 2022-11-26 23:24:10 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:19.732: INFO: netserver-2 started at 2022-11-26 23:19:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container webserver ready: false, restart count 6 Nov 26 23:32:19.732: INFO: csi-hostpathplugin-0 started at 2022-11-26 23:19:31 +0000 UTC (0+7 container statuses recorded) Nov 26 23:32:19.732: INFO: Container csi-attacher ready: true, restart count 7 Nov 26 23:32:19.732: INFO: Container csi-provisioner ready: true, restart count 7 Nov 26 23:32:19.732: INFO: Container csi-resizer ready: true, restart count 7 Nov 26 23:32:19.732: INFO: Container csi-snapshotter ready: true, restart count 7 Nov 26 23:32:19.732: INFO: Container hostpath ready: true, restart count 7 Nov 26 23:32:19.732: INFO: Container liveness-probe ready: true, restart count 7 Nov 26 23:32:19.732: INFO: Container node-driver-registrar ready: true, restart count 7 Nov 26 23:32:19.732: INFO: simpletest.rc-q84md started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container nginx ready: true, restart count 3 Nov 26 23:32:19.732: INFO: simpletest.rc-c4vdk started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:19.732: INFO: volume-snapshot-controller-0 started at 2022-11-26 23:11:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container volume-snapshot-controller ready: true, restart count 5 Nov 26 23:32:19.732: INFO: simpletest.rc-2l65q started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:19.732: INFO: simpletest.rc-hzvfz started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:19.732: INFO: simpletest.rc-5cj45 started at 2022-11-26 23:24:10 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:19.732: INFO: concurrent-27825090-rjsjv started at 2022-11-26 23:30:33 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container c ready: false, restart count 0 Nov 26 23:32:19.732: INFO: simpletest.rc-dvg8l started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:19.732: INFO: l7-default-backend-8549d69d99-zgjzh started at 2022-11-26 23:11:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container default-http-backend ready: true, restart count 0 Nov 26 23:32:19.732: INFO: server-envvars-6222e6ac-d567-472d-bd00-c996ebe3395c started at 2022-11-26 23:13:40 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container srv ready: false, restart count 6 Nov 26 23:32:19.732: INFO: simpletest.rc-7n2vx started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:19.732: INFO: simpletest.rc-mpjvz started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:19.732: INFO: e2e-2gjr9-l5xsj started at 2022-11-26 23:13:41 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container c ready: false, restart count 0 Nov 26 23:32:19.732: INFO: pod-0b414c7b-dcc9-4e00-9536-9db8ccc1a7b7 started at 2022-11-26 23:19:47 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container test-container ready: false, restart count 0 Nov 26 23:32:19.732: INFO: sample-webhook-deployment-865554f4d9-4zmb9 started at 2022-11-26 23:23:42 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container sample-webhook ready: true, restart count 3 Nov 26 23:32:19.732: INFO: pod-projected-configmaps-334f9945-2444-46e4-b837-44369e43dccb started at 2022-11-26 23:19:59 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container agnhost-container ready: false, restart count 0 Nov 26 23:32:19.732: INFO: test-rs-ljz55 started at 2022-11-26 23:19:54 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container httpd ready: true, restart count 5 Nov 26 23:32:19.732: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 23:23:43 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container csi-attacher ready: true, restart count 1 Nov 26 23:32:19.732: INFO: csi-mockplugin-0 started at 2022-11-26 23:13:42 +0000 UTC (0+3 container statuses recorded) Nov 26 23:32:19.732: INFO: Container csi-provisioner ready: true, restart count 0 Nov 26 23:32:19.732: INFO: Container driver-registrar ready: true, restart count 0 Nov 26 23:32:19.732: INFO: Container mock ready: true, restart count 0 Nov 26 23:32:19.732: INFO: simpletest.rc-xdwbr started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:19.732: INFO: pod-update-activedeadlineseconds-77a2de44-d7f7-44e5-b11e-b055e23fbdce started at 2022-11-26 23:30:33 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container pause ready: false, restart count 0 Nov 26 23:32:19.732: INFO: inline-volume-tester-h725k started at 2022-11-26 23:25:11 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container csi-volume-tester ready: false, restart count 0 Nov 26 23:32:19.732: INFO: pfpod started at 2022-11-26 23:30:33 +0000 UTC (0+2 container statuses recorded) Nov 26 23:32:19.732: INFO: Container portforwardtester ready: false, restart count 0 Nov 26 23:32:19.732: INFO: Container readiness ready: false, restart count 0 Nov 26 23:32:19.732: INFO: netserver-2 started at 2022-11-26 23:30:55 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container webserver ready: true, restart count 0 Nov 26 23:32:19.732: INFO: hostexec-bootstrap-e2e-minion-group-n9b1-xzltr started at 2022-11-26 23:13:55 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container agnhost-container ready: false, restart count 6 Nov 26 23:32:19.732: INFO: simpletest.rc-bmbvf started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:19.732: INFO: simpletest.rc-4n9fc started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:19.732: INFO: simpletest.rc-mmvjs started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:19.732: INFO: simpletest.rc-kcjjc started at 2022-11-26 23:24:10 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:19.732: INFO: csi-hostpathplugin-0 started at 2022-11-26 23:19:27 +0000 UTC (0+7 container statuses recorded) Nov 26 23:32:19.732: INFO: Container csi-attacher ready: false, restart count 6 Nov 26 23:32:19.732: INFO: Container csi-provisioner ready: false, restart count 6 Nov 26 23:32:19.732: INFO: Container csi-resizer ready: false, restart count 6 Nov 26 23:32:19.732: INFO: Container csi-snapshotter ready: false, restart count 6 Nov 26 23:32:19.732: INFO: Container hostpath ready: false, restart count 6 Nov 26 23:32:19.732: INFO: Container liveness-probe ready: false, restart count 6 Nov 26 23:32:19.732: INFO: Container node-driver-registrar ready: false, restart count 7 Nov 26 23:32:19.732: INFO: test-container-pod started at 2022-11-26 23:19:29 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container webserver ready: true, restart count 5 Nov 26 23:32:19.732: INFO: csi-mockplugin-0 started at 2022-11-26 23:23:43 +0000 UTC (0+3 container statuses recorded) Nov 26 23:32:19.732: INFO: Container csi-provisioner ready: true, restart count 0 Nov 26 23:32:19.732: INFO: Container driver-registrar ready: true, restart count 0 Nov 26 23:32:19.732: INFO: Container mock ready: true, restart count 0 Nov 26 23:32:19.732: INFO: hostexec-bootstrap-e2e-minion-group-n9b1-tk699 started at 2022-11-26 23:30:33 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container agnhost-container ready: true, restart count 2 Nov 26 23:32:19.732: INFO: agnhost started at 2022-11-26 23:13:56 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container agnhost ready: false, restart count 0 Nov 26 23:32:19.732: INFO: simpletest.rc-z68xn started at 2022-11-26 23:24:10 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:19.732: INFO: simpletest.rc-65qg4 started at 2022-11-26 23:24:11 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:19.732: INFO: konnectivity-agent-bw7hk started at 2022-11-26 23:11:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container konnectivity-agent ready: true, restart count 7 Nov 26 23:32:19.732: INFO: csi-hostpathplugin-0 started at 2022-11-26 23:13:58 +0000 UTC (0+7 container statuses recorded) Nov 26 23:32:19.732: INFO: Container csi-attacher ready: true, restart count 3 Nov 26 23:32:19.732: INFO: Container csi-provisioner ready: true, restart count 3 Nov 26 23:32:19.732: INFO: Container csi-resizer ready: true, restart count 3 Nov 26 23:32:19.732: INFO: Container csi-snapshotter ready: true, restart count 3 Nov 26 23:32:19.732: INFO: Container hostpath ready: true, restart count 3 Nov 26 23:32:19.732: INFO: Container liveness-probe ready: true, restart count 3 Nov 26 23:32:19.732: INFO: Container node-driver-registrar ready: true, restart count 3 Nov 26 23:32:19.732: INFO: concurrent-27825083-ldnwm started at 2022-11-26 23:23:41 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container c ready: false, restart count 0 Nov 26 23:32:19.732: INFO: ss2-0 started at 2022-11-26 23:23:43 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container webserver ready: true, restart count 2 Nov 26 23:32:19.732: INFO: simpletest.rc-ppgv4 started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:19.732: INFO: pod-ephm-test-projected-ckh4 started at 2022-11-26 23:30:33 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container test-container-subpath-projected-ckh4 ready: false, restart count 0 Nov 26 23:32:19.732: INFO: nfs-injector started at 2022-11-26 23:18:28 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container nfs-injector ready: false, restart count 0 Nov 26 23:32:19.732: INFO: dns-test-c2505ebd-e6a3-455c-9a9f-58dbe21ea53c started at 2022-11-26 23:23:42 +0000 UTC (0+3 container statuses recorded) Nov 26 23:32:19.732: INFO: Container jessie-querier ready: true, restart count 0 Nov 26 23:32:19.732: INFO: Container querier ready: true, restart count 0 Nov 26 23:32:19.732: INFO: Container webserver ready: true, restart count 0 Nov 26 23:32:19.732: INFO: nfs-server started at 2022-11-26 23:18:21 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container nfs-server ready: true, restart count 2 Nov 26 23:32:19.732: INFO: hostexec-bootstrap-e2e-minion-group-n9b1-h77pq started at 2022-11-26 23:19:47 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container agnhost-container ready: true, restart count 2 Nov 26 23:32:19.732: INFO: dns-test-37d137df-f1fb-46b2-81e9-153cb7845ef4 started at 2022-11-26 23:24:14 +0000 UTC (0+3 container statuses recorded) Nov 26 23:32:19.732: INFO: Container jessie-querier ready: true, restart count 2 Nov 26 23:32:19.732: INFO: Container querier ready: true, restart count 2 Nov 26 23:32:19.732: INFO: Container webserver ready: true, restart count 2 Nov 26 23:32:19.732: INFO: simpletest.rc-pkd4b started at 2022-11-26 23:24:10 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container nginx ready: true, restart count 4 Nov 26 23:32:19.732: INFO: netserver-2 started at 2022-11-26 23:18:54 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container webserver ready: true, restart count 1 Nov 26 23:32:19.732: INFO: simpletest.rc-2hh6h started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container nginx ready: true, restart count 3 Nov 26 23:32:19.732: INFO: simpletest.rc-qwqsv started at 2022-11-26 23:24:10 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:19.732: INFO: kube-proxy-bootstrap-e2e-minion-group-n9b1 started at 2022-11-26 23:10:52 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.732: INFO: Container kube-proxy ready: false, restart count 7 Nov 26 23:32:19.732: INFO: metadata-proxy-v0.1-h4wpl started at 2022-11-26 23:10:53 +0000 UTC (0+2 container statuses recorded) Nov 26 23:32:19.732: INFO: Container metadata-proxy ready: true, restart count 0 Nov 26 23:32:19.732: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Nov 26 23:32:19.732: INFO: csi-mockplugin-0 started at 2022-11-26 23:18:51 +0000 UTC (0+3 container statuses recorded) Nov 26 23:32:19.732: INFO: Container csi-provisioner ready: false, restart count 5 Nov 26 23:32:19.732: INFO: Container driver-registrar ready: false, restart count 5 Nov 26 23:32:19.732: INFO: Container mock ready: false, restart count 5 Nov 26 23:32:19.732: INFO: hostexec-bootstrap-e2e-minion-group-n9b1-zsjf9 started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.733: INFO: Container agnhost-container ready: false, restart count 1 Nov 26 23:32:19.733: INFO: hostexec-bootstrap-e2e-minion-group-n9b1-ltrjk started at 2022-11-26 23:30:57 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.733: INFO: Container agnhost-container ready: true, restart count 1 Nov 26 23:32:19.733: INFO: pod-secrets-a152d9c1-cdeb-488b-9c0c-b830477f5f6c started at 2022-11-26 23:19:54 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.733: INFO: Container secret-test ready: true, restart count 3 Nov 26 23:32:19.733: INFO: execpods9dgn started at 2022-11-26 23:18:45 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.733: INFO: Container agnhost-container ready: false, restart count 3 Nov 26 23:32:19.733: INFO: simpletest.rc-sf5jw started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.733: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:19.733: INFO: simpletest.rc-xt677 started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.733: INFO: Container nginx ready: true, restart count 3 Nov 26 23:32:19.733: INFO: simpletest.rc-vpt65 started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.733: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:19.733: INFO: simpletest.rc-hmgxt started at 2022-11-26 23:24:11 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.733: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:19.733: INFO: hostexec-bootstrap-e2e-minion-group-n9b1-kj7bs started at 2022-11-26 23:30:33 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.733: INFO: Container agnhost-container ready: true, restart count 0 Nov 26 23:32:19.733: INFO: pvc-volume-tester-h6ptm started at 2022-11-26 23:24:03 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.733: INFO: Container volume-tester ready: false, restart count 0 Nov 26 23:32:19.733: INFO: simpletest.rc-ff8cc started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.733: INFO: Container nginx ready: true, restart count 5 Nov 26 23:32:19.733: INFO: pod-server-2 started at 2022-11-26 23:30:57 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.733: INFO: Container agnhost-container ready: true, restart count 0 Nov 26 23:32:19.733: INFO: csi-mockplugin-0 started at 2022-11-26 23:13:42 +0000 UTC (0+3 container statuses recorded) Nov 26 23:32:19.733: INFO: Container csi-provisioner ready: false, restart count 6 Nov 26 23:32:19.733: INFO: Container driver-registrar ready: false, restart count 6 Nov 26 23:32:19.733: INFO: Container mock ready: false, restart count 6 Nov 26 23:32:19.733: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 23:13:43 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.733: INFO: Container csi-attacher ready: true, restart count 3 Nov 26 23:32:19.733: INFO: host-test-container-pod started at 2022-11-26 23:19:29 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.733: INFO: Container agnhost-container ready: true, restart count 2 Nov 26 23:32:19.733: INFO: simpletest.rc-k95tx started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.733: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:19.733: INFO: externalip-test-wfc9z started at 2022-11-26 23:18:39 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.733: INFO: Container externalip-test ready: true, restart count 1 Nov 26 23:32:19.733: INFO: simpletest.rc-kdbtf started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.733: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:19.733: INFO: simpletest.rc-vmg49 started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.733: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:19.733: INFO: simpletest.rc-cq84x started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.733: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:19.733: INFO: simpletest.rc-vzc27 started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.733: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:19.733: INFO: simpletest.rc-pjws9 started at 2022-11-26 23:24:11 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.733: INFO: Container nginx ready: true, restart count 4 Nov 26 23:32:19.733: INFO: execpoddl5wp started at 2022-11-26 23:18:24 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.733: INFO: Container agnhost-container ready: true, restart count 3 Nov 26 23:32:19.733: INFO: simpletest.rc-mr42d started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.733: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:19.733: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 23:18:51 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:19.733: INFO: Container csi-attacher ready: true, restart count 5 Nov 26 23:32:21.429: INFO: Latency metrics for node bootstrap-e2e-minion-group-n9b1 [DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] tear down framework | framework.go:193 STEP: Destroying namespace "webhook-9710" for this suite. 11/26/22 23:32:21.429 STEP: Destroying namespace "webhook-9710-markers" for this suite. 11/26/22 23:32:21.471
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\sshould\sbe\sable\sto\sdeny\spod\sand\sconfigmap\screation\s\[Conformance\]$'
test/e2e/framework/framework.go:241 k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc000c71e00) test/e2e/framework/framework.go:241 +0x96f There were additional failures detected after the initial failure: [PANICKED] Test Panicked In [AfterEach] at: /usr/local/go/src/runtime/panic.go:260 runtime error: invalid memory address or nil pointer dereference Full Stack Trace k8s.io/kubernetes/test/e2e/apimachinery.cleanWebhookTest({0x0, 0x0}, {0x0, 0x0}) test/e2e/apimachinery/webhook.go:1680 +0x46 k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.2() test/e2e/apimachinery/webhook.go:106 +0x2ffrom junit_01.xml
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] set up framework | framework.go:178 STEP: Creating a kubernetes client 11/26/22 23:20:08.993 Nov 26 23:20:08.993: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Building a namespace api object, basename webhook 11/26/22 23:20:08.995 Nov 26 23:20:09.035: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:20:11.075: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:20:13.075: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:20:15.074: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:20:17.075: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:20:19.075: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:20:21.075: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:20:23.075: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:20:25.075: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:20:27.075: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:20:29.075: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:20:31.075: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:20:33.075: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:20:35.075: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:20:37.075: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:20:39.075: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:20:39.114: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:20:39.114: INFO: Unexpected error: <*errors.errorString | 0xc00017fa10>: { s: "timed out waiting for the condition", } Nov 26 23:20:39.114: FAIL: timed out waiting for the condition Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc000c71e00) test/e2e/framework/framework.go:241 +0x96f [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/framework/node/init/init.go:32 Nov 26 23:20:39.115: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/apimachinery/webhook.go:105 [DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] dump namespaces | framework.go:196 STEP: dump namespace information after failure 11/26/22 23:20:39.154 [DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] tear down framework | framework.go:193
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\sshould\sdeny\scrd\screation\s\[Conformance\]$'
test/e2e/framework/framework.go:241 k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc001244e10) test/e2e/framework/framework.go:241 +0x96f There were additional failures detected after the initial failure: [PANICKED] Test Panicked In [AfterEach] at: /usr/local/go/src/runtime/panic.go:260 runtime error: invalid memory address or nil pointer dereference Full Stack Trace k8s.io/kubernetes/test/e2e/apimachinery.cleanWebhookTest({0x0, 0x0}, {0x0, 0x0}) test/e2e/apimachinery/webhook.go:1680 +0x46 k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.2() test/e2e/apimachinery/webhook.go:106 +0x2ffrom junit_01.xml
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] set up framework | framework.go:178 STEP: Creating a kubernetes client 11/26/22 23:27:38.901 Nov 26 23:27:38.901: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Building a namespace api object, basename webhook 11/26/22 23:27:38.903 Nov 26 23:27:38.942: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:27:40.983: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:27:42.982: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:27:44.983: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:27:46.982: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:27:48.982: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:27:50.983: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:27:52.983: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:27:54.983: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:27:56.982: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:27:58.983: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:28:00.982: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:28:02.982: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:28:04.982: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:28:06.983: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:28:08.982: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:28:09.021: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:28:09.021: INFO: Unexpected error: <*errors.errorString | 0xc000115d80>: { s: "timed out waiting for the condition", } Nov 26 23:28:09.022: FAIL: timed out waiting for the condition Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc001244e10) test/e2e/framework/framework.go:241 +0x96f [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/framework/node/init/init.go:32 Nov 26 23:28:09.022: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/apimachinery/webhook.go:105 [DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] dump namespaces | framework.go:196 STEP: dump namespace information after failure 11/26/22 23:28:09.061 [DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] tear down framework | framework.go:193
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\sshould\shonor\stimeout\s\[Conformance\]$'
test/e2e/apimachinery/webhook.go:826 k8s.io/kubernetes/test/e2e/apimachinery.deployWebhookAndService(0xc001275b30, {0xc0020176e0, 0x2c}, 0xc003a03900, 0x20fb, 0x20fc) test/e2e/apimachinery/webhook.go:826 +0xed2 k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.1() test/e2e/apimachinery/webhook.go:102 +0x226from junit_01.xml
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] set up framework | framework.go:178 STEP: Creating a kubernetes client 11/26/22 23:36:57.402 Nov 26 23:36:57.403: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Building a namespace api object, basename webhook 11/26/22 23:36:57.404 STEP: Waiting for a default service account to be provisioned in namespace 11/26/22 23:36:57.681 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 11/26/22 23:36:57.774 [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/apimachinery/webhook.go:90 STEP: Setting up server cert 11/26/22 23:37:01.013 STEP: Create role binding to let webhook read extension-apiserver-authentication 11/26/22 23:37:01.643 Nov 26 23:37:02.022: INFO: role binding webhook-auth-reader already exists STEP: Deploying the webhook pod 11/26/22 23:37:02.022 STEP: Wait for the deployment to be ready 11/26/22 23:37:02.262 Nov 26 23:37:02.456: INFO: deployment "sample-webhook-deployment" doesn't have the required revision set Nov 26 23:37:04.841: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 37, 2, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 37, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 37, 2, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 37, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:37:06.919: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 37, 2, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 37, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 37, 2, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 37, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:38:08.882: INFO: Unexpected error: waiting for the deployment status valid%!(EXTRA string=registry.k8s.io/e2e-test-images/agnhost:2.43, string=sample-webhook-deployment, string=webhook-6858): <*errors.errorString | 0xc0014ad4c0>: { s: "error waiting for deployment \"sample-webhook-deployment\" status to match expectation: the server was unable to return a response in the time allotted, but may still be processing the request (get deployments.apps sample-webhook-deployment)", } Nov 26 23:38:08.882: FAIL: waiting for the deployment status valid%!(EXTRA string=registry.k8s.io/e2e-test-images/agnhost:2.43, string=sample-webhook-deployment, string=webhook-6858): error waiting for deployment "sample-webhook-deployment" status to match expectation: the server was unable to return a response in the time allotted, but may still be processing the request (get deployments.apps sample-webhook-deployment) Full Stack Trace k8s.io/kubernetes/test/e2e/apimachinery.deployWebhookAndService(0xc001275b30, {0xc0020176e0, 0x2c}, 0xc003a03900, 0x20fb, 0x20fc) test/e2e/apimachinery/webhook.go:826 +0xed2 k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.1() test/e2e/apimachinery/webhook.go:102 +0x226 [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/framework/node/init/init.go:32 Nov 26 23:38:08.882: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/apimachinery/webhook.go:105 [DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] dump namespaces | framework.go:196 STEP: dump namespace information after failure 11/26/22 23:39:08.328 STEP: Collecting events from namespace "webhook-6858". 11/26/22 23:39:08.328 STEP: Found 13 events. 11/26/22 23:39:19.97 Nov 26 23:39:19.970: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for sample-webhook-deployment-865554f4d9-kvkln: { } Scheduled: Successfully assigned webhook-6858/sample-webhook-deployment-865554f4d9-kvkln to bootstrap-e2e-minion-group-n9b1 Nov 26 23:39:19.970: INFO: At 2022-11-26 23:37:02 +0000 UTC - event for sample-webhook-deployment: {deployment-controller } ScalingReplicaSet: Scaled up replica set sample-webhook-deployment-865554f4d9 to 1 Nov 26 23:39:19.970: INFO: At 2022-11-26 23:37:02 +0000 UTC - event for sample-webhook-deployment-865554f4d9: {replicaset-controller } SuccessfulCreate: Created pod: sample-webhook-deployment-865554f4d9-kvkln Nov 26 23:39:19.970: INFO: At 2022-11-26 23:37:09 +0000 UTC - event for sample-webhook-deployment-865554f4d9-kvkln: {kubelet bootstrap-e2e-minion-group-n9b1} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Nov 26 23:39:19.970: INFO: At 2022-11-26 23:37:09 +0000 UTC - event for sample-webhook-deployment-865554f4d9-kvkln: {kubelet bootstrap-e2e-minion-group-n9b1} Created: Created container sample-webhook Nov 26 23:39:19.970: INFO: At 2022-11-26 23:37:09 +0000 UTC - event for sample-webhook-deployment-865554f4d9-kvkln: {kubelet bootstrap-e2e-minion-group-n9b1} Started: Started container sample-webhook Nov 26 23:39:19.970: INFO: At 2022-11-26 23:37:09 +0000 UTC - event for sample-webhook-deployment-865554f4d9-kvkln: {kubelet bootstrap-e2e-minion-group-n9b1} Unhealthy: Readiness probe failed: Get "https://10.64.3.207:8444/readyz": dial tcp 10.64.3.207:8444: connect: connection refused Nov 26 23:39:19.970: INFO: At 2022-11-26 23:37:11 +0000 UTC - event for sample-webhook-deployment-865554f4d9-kvkln: {kubelet bootstrap-e2e-minion-group-n9b1} Killing: Stopping container sample-webhook Nov 26 23:39:19.970: INFO: At 2022-11-26 23:37:12 +0000 UTC - event for sample-webhook-deployment-865554f4d9-kvkln: {kubelet bootstrap-e2e-minion-group-n9b1} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Nov 26 23:39:19.970: INFO: At 2022-11-26 23:37:13 +0000 UTC - event for sample-webhook-deployment-865554f4d9-kvkln: {kubelet bootstrap-e2e-minion-group-n9b1} Unhealthy: Readiness probe failed: Get "https://10.64.3.207:8444/readyz": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) Nov 26 23:39:19.970: INFO: At 2022-11-26 23:37:17 +0000 UTC - event for sample-webhook-deployment-865554f4d9-kvkln: {kubelet bootstrap-e2e-minion-group-n9b1} BackOff: Back-off restarting failed container sample-webhook in pod sample-webhook-deployment-865554f4d9-kvkln_webhook-6858(58a66dd4-8a77-4c0d-831a-5820b0b3a8a1) Nov 26 23:39:19.970: INFO: At 2022-11-26 23:37:17 +0000 UTC - event for sample-webhook-deployment-865554f4d9-kvkln: {kubelet bootstrap-e2e-minion-group-n9b1} Unhealthy: Readiness probe failed: Get "https://10.64.3.217:8444/readyz": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) Nov 26 23:39:19.970: INFO: At 2022-11-26 23:37:32 +0000 UTC - event for sample-webhook-deployment-865554f4d9-kvkln: {kubelet bootstrap-e2e-minion-group-n9b1} Unhealthy: Readiness probe failed: Get "https://10.64.3.223:8444/readyz": dial tcp 10.64.3.223:8444: connect: connection refused Nov 26 23:39:20.022: INFO: POD NODE PHASE GRACE CONDITIONS Nov 26 23:39:20.023: INFO: sample-webhook-deployment-865554f4d9-kvkln bootstrap-e2e-minion-group-n9b1 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-11-26 23:37:02 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-11-26 23:37:02 +0000 UTC ContainersNotReady containers with unready status: [sample-webhook]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2022-11-26 23:37:02 +0000 UTC ContainersNotReady containers with unready status: [sample-webhook]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-11-26 23:37:02 +0000 UTC }] Nov 26 23:39:20.023: INFO: Nov 26 23:39:20.153: INFO: Unable to fetch webhook-6858/sample-webhook-deployment-865554f4d9-kvkln/sample-webhook logs: an error on the server ("unknown") has prevented the request from succeeding (get pods sample-webhook-deployment-865554f4d9-kvkln) Nov 26 23:39:20.207: INFO: Logging node info for node bootstrap-e2e-master Nov 26 23:39:20.249: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master c85fbb04-d865-42ae-b40a-365f0873d077 10686 0 2022-11-26 23:10:47 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 23:10:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-11-26 23:11:08 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-11-26 23:11:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-11-26 23:34:45 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-6-1-5-ctl-skew/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3858374656 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3596230656 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 23:11:08 +0000 UTC,LastTransitionTime:2022-11-26 23:11:08 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 23:34:45 +0000 UTC,LastTransitionTime:2022-11-26 23:10:47 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 23:34:45 +0000 UTC,LastTransitionTime:2022-11-26 23:10:47 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 23:34:45 +0000 UTC,LastTransitionTime:2022-11-26 23:10:47 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 23:34:45 +0000 UTC,LastTransitionTime:2022-11-26 23:11:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:34.83.128.61,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:51f618a4ea82aa4d3795e4cfa76e3a28,SystemUUID:51f618a4-ea82-aa4d-3795-e4cfa76e3a28,BootID:eb1eb4fb-e105-4d49-9289-0d31902f8c4d,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:135160272,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:124990265,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:57660216,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:2c111f004bec24888d8cfa2a812a38fb8341350abac67dcd0ac64e709dfe389c registry.k8s.io/kas-network-proxy/proxy-server:v0.0.33],SizeBytes:22020129,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 26 23:39:20.249: INFO: Logging kubelet events for node bootstrap-e2e-master Nov 26 23:39:20.319: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-master Nov 26 23:39:20.371: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-master: error trying to reach service: No agent available Nov 26 23:39:20.371: INFO: Logging node info for node bootstrap-e2e-minion-group-dr7t Nov 26 23:39:20.417: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-dr7t b4041686-ad54-48f5-95c3-e848d9a8f0a7 11536 0 2022-11-26 23:10:49 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-dr7t kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-dr7t topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-5218":"bootstrap-e2e-minion-group-dr7t","csi-hostpath-ephemeral-5883":"bootstrap-e2e-minion-group-dr7t","csi-hostpath-ephemeral-8027":"bootstrap-e2e-minion-group-dr7t","csi-hostpath-volume-expand-3788":"bootstrap-e2e-minion-group-dr7t","csi-mock-csi-mock-volumes-7211":"bootstrap-e2e-minion-group-dr7t"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 23:10:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 23:10:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-11-26 23:30:04 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2022-11-26 23:34:41 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-26 23:37:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-6-1-5-ctl-skew/us-west1-b/bootstrap-e2e-minion-group-dr7t,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 23:11:08 +0000 UTC,LastTransitionTime:2022-11-26 23:11:08 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 23:36:03 +0000 UTC,LastTransitionTime:2022-11-26 23:10:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 23:36:03 +0000 UTC,LastTransitionTime:2022-11-26 23:10:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 23:36:03 +0000 UTC,LastTransitionTime:2022-11-26 23:10:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 23:36:03 +0000 UTC,LastTransitionTime:2022-11-26 23:10:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:35.185.223.63,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-dr7t.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-dr7t.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:29f409e413f0ebfffc6ee0c012a074c7,SystemUUID:29f409e4-13f0-ebff-fc6e-e0c012a074c7,BootID:a3bfef7b-2d61-4ac5-a15e-34631edb66c9,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 26 23:39:20.417: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-dr7t Nov 26 23:39:20.469: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-dr7t Nov 26 23:39:20.543: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-dr7t: error trying to reach service: No agent available Nov 26 23:39:20.543: INFO: Logging node info for node bootstrap-e2e-minion-group-l8ht Nov 26 23:39:20.588: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-l8ht 3e5210d0-ba6b-4f56-896c-40aaae5093d0 11854 0 2022-11-26 23:10:52 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-l8ht kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-l8ht topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-2215":"bootstrap-e2e-minion-group-l8ht","csi-hostpath-volume-expand-7512":"bootstrap-e2e-minion-group-l8ht","csi-mock-csi-mock-volumes-2107":"bootstrap-e2e-minion-group-l8ht","csi-mock-csi-mock-volumes-355":"bootstrap-e2e-minion-group-l8ht"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 23:10:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 23:10:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {node-problem-detector Update v1 2022-11-26 23:34:41 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-11-26 23:36:53 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2022-11-26 23:39:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-6-1-5-ctl-skew/us-west1-b/bootstrap-e2e-minion-group-l8ht,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 23:11:08 +0000 UTC,LastTransitionTime:2022-11-26 23:11:08 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 23:38:54 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 23:38:54 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 23:38:54 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 23:38:54 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:34.168.47.71,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-l8ht.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-l8ht.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:89b0fd3f78d194fccba6eb2ce27680f6,SystemUUID:89b0fd3f-78d1-94fc-cba6-eb2ce27680f6,BootID:ec1fa0a7-81b7-48ec-8da0-cc1b45a14fc8,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-55^28d8d761-6de0-11ed-8c44-7ec558aa6670],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-55^28d8d761-6de0-11ed-8c44-7ec558aa6670,DevicePath:,},},Config:nil,},} Nov 26 23:39:20.589: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-l8ht Nov 26 23:39:20.742: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-l8ht Nov 26 23:39:20.914: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-l8ht: error trying to reach service: No agent available Nov 26 23:39:20.914: INFO: Logging node info for node bootstrap-e2e-minion-group-n9b1 Nov 26 23:39:20.987: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-n9b1 796907e0-52c8-4c84-815a-6442939836c4 11882 0 2022-11-26 23:10:52 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-n9b1 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-n9b1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-5727":"bootstrap-e2e-minion-group-n9b1","csi-hostpath-provisioning-254":"bootstrap-e2e-minion-group-n9b1","csi-hostpath-provisioning-6336":"bootstrap-e2e-minion-group-n9b1","csi-mock-csi-mock-volumes-7180":"bootstrap-e2e-minion-group-n9b1","csi-mock-csi-mock-volumes-7256":"bootstrap-e2e-minion-group-n9b1","csi-mock-csi-mock-volumes-7584":"bootstrap-e2e-minion-group-n9b1","csi-mock-csi-mock-volumes-7940":"bootstrap-e2e-minion-group-n9b1"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 23:10:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 23:10:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {node-problem-detector Update v1 2022-11-26 23:34:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-11-26 23:36:53 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2022-11-26 23:39:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-6-1-5-ctl-skew/us-west1-b/bootstrap-e2e-minion-group-n9b1,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 23:34:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 23:34:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 23:34:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 23:34:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 23:34:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 23:34:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 23:34:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 23:11:08 +0000 UTC,LastTransitionTime:2022-11-26 23:11:08 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 23:38:59 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 23:38:59 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 23:38:59 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 23:38:59 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.145.73.48,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-n9b1.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-n9b1.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:47bcd2b143b08ae3cf2e280a7c6e673a,SystemUUID:47bcd2b1-43b0-8ae3-cf2e-280a7c6e673a,BootID:c567f407-918f-4298-a12f-a33a4e211fcf,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 registry.k8s.io/sig-storage/snapshot-controller:v6.1.0],SizeBytes:22620891,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-5727^70b85a3d-6de1-11ed-852d-36e7a9ac0592 kubernetes.io/csi/csi-hostpath-provisioning-169^c8e3d50b-6de0-11ed-aed4-6a12d5ab5936],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-5727^70b85a3d-6de1-11ed-852d-36e7a9ac0592,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-169^c8e3d50b-6de0-11ed-aed4-6a12d5ab5936,DevicePath:,},},Config:nil,},} Nov 26 23:39:20.987: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-n9b1 Nov 26 23:39:21.054: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-n9b1 Nov 26 23:39:21.125: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-n9b1: error trying to reach service: No agent available STEP: Collecting events from namespace "webhook-6858-markers". 11/26/22 23:39:21.125 STEP: Found 0 events. 11/26/22 23:39:21.17 Nov 26 23:39:21.213: INFO: POD NODE PHASE GRACE CONDITIONS Nov 26 23:39:21.213: INFO: Nov 26 23:39:21.260: INFO: Logging node info for node bootstrap-e2e-master Nov 26 23:39:21.303: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master c85fbb04-d865-42ae-b40a-365f0873d077 10686 0 2022-11-26 23:10:47 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 23:10:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-11-26 23:11:08 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-11-26 23:11:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-11-26 23:34:45 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-6-1-5-ctl-skew/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3858374656 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3596230656 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 23:11:08 +0000 UTC,LastTransitionTime:2022-11-26 23:11:08 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 23:34:45 +0000 UTC,LastTransitionTime:2022-11-26 23:10:47 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 23:34:45 +0000 UTC,LastTransitionTime:2022-11-26 23:10:47 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 23:34:45 +0000 UTC,LastTransitionTime:2022-11-26 23:10:47 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 23:34:45 +0000 UTC,LastTransitionTime:2022-11-26 23:11:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:34.83.128.61,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:51f618a4ea82aa4d3795e4cfa76e3a28,SystemUUID:51f618a4-ea82-aa4d-3795-e4cfa76e3a28,BootID:eb1eb4fb-e105-4d49-9289-0d31902f8c4d,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:135160272,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:124990265,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:57660216,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:2c111f004bec24888d8cfa2a812a38fb8341350abac67dcd0ac64e709dfe389c registry.k8s.io/kas-network-proxy/proxy-server:v0.0.33],SizeBytes:22020129,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 26 23:39:21.303: INFO: Logging kubelet events for node bootstrap-e2e-master Nov 26 23:39:21.347: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-master Nov 26 23:39:21.390: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-master: error trying to reach service: No agent available Nov 26 23:39:21.390: INFO: Logging node info for node bootstrap-e2e-minion-group-dr7t Nov 26 23:39:21.436: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-dr7t b4041686-ad54-48f5-95c3-e848d9a8f0a7 11536 0 2022-11-26 23:10:49 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-dr7t kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-dr7t topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-5218":"bootstrap-e2e-minion-group-dr7t","csi-hostpath-ephemeral-5883":"bootstrap-e2e-minion-group-dr7t","csi-hostpath-ephemeral-8027":"bootstrap-e2e-minion-group-dr7t","csi-hostpath-volume-expand-3788":"bootstrap-e2e-minion-group-dr7t","csi-mock-csi-mock-volumes-7211":"bootstrap-e2e-minion-group-dr7t"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 23:10:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 23:10:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-11-26 23:30:04 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2022-11-26 23:34:41 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-26 23:37:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-6-1-5-ctl-skew/us-west1-b/bootstrap-e2e-minion-group-dr7t,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 23:11:08 +0000 UTC,LastTransitionTime:2022-11-26 23:11:08 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 23:36:03 +0000 UTC,LastTransitionTime:2022-11-26 23:10:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 23:36:03 +0000 UTC,LastTransitionTime:2022-11-26 23:10:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 23:36:03 +0000 UTC,LastTransitionTime:2022-11-26 23:10:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 23:36:03 +0000 UTC,LastTransitionTime:2022-11-26 23:10:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:35.185.223.63,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-dr7t.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-dr7t.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:29f409e413f0ebfffc6ee0c012a074c7,SystemUUID:29f409e4-13f0-ebff-fc6e-e0c012a074c7,BootID:a3bfef7b-2d61-4ac5-a15e-34631edb66c9,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 26 23:39:21.436: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-dr7t Nov 26 23:39:21.484: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-dr7t Nov 26 23:39:21.528: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-dr7t: error trying to reach service: No agent available Nov 26 23:39:21.528: INFO: Logging node info for node bootstrap-e2e-minion-group-l8ht Nov 26 23:39:21.572: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-l8ht 3e5210d0-ba6b-4f56-896c-40aaae5093d0 11854 0 2022-11-26 23:10:52 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-l8ht kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-l8ht topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-2215":"bootstrap-e2e-minion-group-l8ht","csi-hostpath-volume-expand-7512":"bootstrap-e2e-minion-group-l8ht","csi-mock-csi-mock-volumes-2107":"bootstrap-e2e-minion-group-l8ht","csi-mock-csi-mock-volumes-355":"bootstrap-e2e-minion-group-l8ht"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 23:10:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 23:10:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {node-problem-detector Update v1 2022-11-26 23:34:41 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-11-26 23:36:53 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2022-11-26 23:39:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-6-1-5-ctl-skew/us-west1-b/bootstrap-e2e-minion-group-l8ht,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 23:34:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 23:11:08 +0000 UTC,LastTransitionTime:2022-11-26 23:11:08 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 23:38:54 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 23:38:54 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 23:38:54 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 23:38:54 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:34.168.47.71,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-l8ht.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-l8ht.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:89b0fd3f78d194fccba6eb2ce27680f6,SystemUUID:89b0fd3f-78d1-94fc-cba6-eb2ce27680f6,BootID:ec1fa0a7-81b7-48ec-8da0-cc1b45a14fc8,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-55^28d8d761-6de0-11ed-8c44-7ec558aa6670],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-55^28d8d761-6de0-11ed-8c44-7ec558aa6670,DevicePath:,},},Config:nil,},} Nov 26 23:39:21.573: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-l8ht Nov 26 23:39:21.616: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-l8ht Nov 26 23:39:21.659: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-l8ht: error trying to reach service: No agent available Nov 26 23:39:21.659: INFO: Logging node info for node bootstrap-e2e-minion-group-n9b1 Nov 26 23:39:21.700: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-n9b1 796907e0-52c8-4c84-815a-6442939836c4 11882 0 2022-11-26 23:10:52 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-n9b1 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-n9b1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-5727":"bootstrap-e2e-minion-group-n9b1","csi-hostpath-provisioning-254":"bootstrap-e2e-minion-group-n9b1","csi-hostpath-provisioning-6336":"bootstrap-e2e-minion-group-n9b1","csi-mock-csi-mock-volumes-7180":"bootstrap-e2e-minion-group-n9b1","csi-mock-csi-mock-volumes-7256":"bootstrap-e2e-minion-group-n9b1","csi-mock-csi-mock-volumes-7584":"bootstrap-e2e-minion-group-n9b1","csi-mock-csi-mock-volumes-7940":"bootstrap-e2e-minion-group-n9b1"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 23:10:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 23:10:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {node-problem-detector Update v1 2022-11-26 23:34:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-11-26 23:36:53 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2022-11-26 23:39:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-6-1-5-ctl-skew/us-west1-b/bootstrap-e2e-minion-group-n9b1,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 23:34:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 23:34:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 23:34:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 23:34:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 23:34:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 23:34:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 23:34:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 23:11:08 +0000 UTC,LastTransitionTime:2022-11-26 23:11:08 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 23:38:59 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 23:38:59 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 23:38:59 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 23:38:59 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.145.73.48,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-n9b1.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-n9b1.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:47bcd2b143b08ae3cf2e280a7c6e673a,SystemUUID:47bcd2b1-43b0-8ae3-cf2e-280a7c6e673a,BootID:c567f407-918f-4298-a12f-a33a4e211fcf,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 registry.k8s.io/sig-storage/snapshot-controller:v6.1.0],SizeBytes:22620891,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-5727^70b85a3d-6de1-11ed-852d-36e7a9ac0592 kubernetes.io/csi/csi-hostpath-provisioning-169^c8e3d50b-6de0-11ed-aed4-6a12d5ab5936],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-5727^70b85a3d-6de1-11ed-852d-36e7a9ac0592,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-169^c8e3d50b-6de0-11ed-aed4-6a12d5ab5936,DevicePath:,},},Config:nil,},} Nov 26 23:39:21.701: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-n9b1 Nov 26 23:39:21.746: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-n9b1 Nov 26 23:39:21.790: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-n9b1: error trying to reach service: No agent available [DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] tear down framework | framework.go:193 STEP: Destroying namespace "webhook-6858" for this suite. 11/26/22 23:39:21.79 STEP: Destroying namespace "webhook-6858-markers" for this suite. 11/26/22 23:39:21.833
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\sshould\sinclude\swebhook\sresources\sin\sdiscovery\sdocuments\s\[Conformance\]$'
test/e2e/apimachinery/webhook.go:826 k8s.io/kubernetes/test/e2e/apimachinery.deployWebhookAndService(0xc001059e00, {0xc002321b60, 0x2c}, 0xc002961bd0, 0x20fb, 0x20fc) test/e2e/apimachinery/webhook.go:826 +0xed2 k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.1() test/e2e/apimachinery/webhook.go:102 +0x226 There were additional failures detected after the initial failure: [FAILED] Nov 26 23:43:10.556: failed to list events in namespace "webhook-1524": Get "https://34.83.128.61/api/v1/namespaces/webhook-1524/events": dial tcp 34.83.128.61:443: connect: connection refused In [DeferCleanup (Each)] at: test/e2e/framework/debug/dump.go:44 ---------- [FAILED] Nov 26 23:43:10.636: Couldn't delete ns: "webhook-1524-markers": Delete "https://34.83.128.61/api/v1/namespaces/webhook-1524-markers": dial tcp 34.83.128.61:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://34.83.128.61/api/v1/namespaces/webhook-1524-markers", Err:(*net.OpError)(0xc003d559a0)}),Couldn't delete ns: "webhook-1524": Delete "https://34.83.128.61/api/v1/namespaces/webhook-1524": dial tcp 34.83.128.61:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://34.83.128.61/api/v1/namespaces/webhook-1524", Err:(*net.OpError)(0xc001a74e10)}) In [DeferCleanup (Each)] at: test/e2e/framework/framework.go:370from junit_01.xml
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] set up framework | framework.go:178 STEP: Creating a kubernetes client 11/26/22 23:41:59.666 Nov 26 23:41:59.666: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Building a namespace api object, basename webhook 11/26/22 23:41:59.668 STEP: Waiting for a default service account to be provisioned in namespace 11/26/22 23:42:52.924 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 11/26/22 23:42:53.004 [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/apimachinery/webhook.go:90 STEP: Setting up server cert 11/26/22 23:42:59.329 STEP: Create role binding to let webhook read extension-apiserver-authentication 11/26/22 23:42:59.631 STEP: Deploying the webhook pod 11/26/22 23:42:59.741 STEP: Wait for the deployment to be ready 11/26/22 23:42:59.973 Nov 26 23:43:00.279: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:0, UpdatedReplicas:0, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 43, 0, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 43, 0, 0, time.Local), Reason:"NewReplicaSetCreated", Message:"Created new replica set \"sample-webhook-deployment-865554f4d9\""}, v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 43, 0, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 43, 0, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}}, CollisionCount:(*int32)(nil)} Nov 26 23:43:02.346: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 43, 0, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 43, 0, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 43, 0, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 43, 0, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:43:04.337: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 43, 0, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 43, 0, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 43, 0, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 43, 0, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:43:06.346: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 43, 0, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 43, 0, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 43, 0, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 43, 0, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:43:08.348: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 43, 0, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 43, 0, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 43, 0, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 43, 0, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:43:10.319: INFO: Unexpected error: waiting for the deployment status valid%!(EXTRA string=registry.k8s.io/e2e-test-images/agnhost:2.43, string=sample-webhook-deployment, string=webhook-1524): <*errors.errorString | 0xc001557930>: { s: "error waiting for deployment \"sample-webhook-deployment\" status to match expectation: Get \"https://34.83.128.61/apis/apps/v1/namespaces/webhook-1524/deployments/sample-webhook-deployment\": dial tcp 34.83.128.61:443: connect: connection refused", } Nov 26 23:43:10.319: FAIL: waiting for the deployment status valid%!(EXTRA string=registry.k8s.io/e2e-test-images/agnhost:2.43, string=sample-webhook-deployment, string=webhook-1524): error waiting for deployment "sample-webhook-deployment" status to match expectation: Get "https://34.83.128.61/apis/apps/v1/namespaces/webhook-1524/deployments/sample-webhook-deployment": dial tcp 34.83.128.61:443: connect: connection refused Full Stack Trace k8s.io/kubernetes/test/e2e/apimachinery.deployWebhookAndService(0xc001059e00, {0xc002321b60, 0x2c}, 0xc002961bd0, 0x20fb, 0x20fc) test/e2e/apimachinery/webhook.go:826 +0xed2 k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.1() test/e2e/apimachinery/webhook.go:102 +0x226 [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/framework/node/init/init.go:32 Nov 26 23:43:10.320: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/apimachinery/webhook.go:105 [DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] dump namespaces | framework.go:196 STEP: dump namespace information after failure 11/26/22 23:43:10.516 STEP: Collecting events from namespace "webhook-1524". 11/26/22 23:43:10.516 Nov 26 23:43:10.556: INFO: Unexpected error: failed to list events in namespace "webhook-1524": <*url.Error | 0xc003dd7860>: { Op: "Get", URL: "https://34.83.128.61/api/v1/namespaces/webhook-1524/events", Err: <*net.OpError | 0xc003d550e0>{ Op: "dial", Net: "tcp", Source: nil, Addr: <*net.TCPAddr | 0xc003d58840>{ IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 34, 83, 128, 61], Port: 443, Zone: "", }, Err: <*os.SyscallError | 0xc000ea4e20>{ Syscall: "connect", Err: <syscall.Errno>0x6f, }, }, } Nov 26 23:43:10.556: FAIL: failed to list events in namespace "webhook-1524": Get "https://34.83.128.61/api/v1/namespaces/webhook-1524/events": dial tcp 34.83.128.61:443: connect: connection refused Full Stack Trace k8s.io/kubernetes/test/e2e/framework/debug.dumpEventsInNamespace(0xc00365e5c0, {0xc002de4450, 0xc}) test/e2e/framework/debug/dump.go:44 +0x191 k8s.io/kubernetes/test/e2e/framework/debug.DumpAllNamespaceInfo({0x801de88, 0xc002905a00}, {0xc002de4450, 0xc}) test/e2e/framework/debug/dump.go:62 +0x8d k8s.io/kubernetes/test/e2e/framework/debug/init.init.0.func1.1(0xc00365e650?, {0xc002de4450?, 0x7fa7740?}) test/e2e/framework/debug/init/init.go:34 +0x32 k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo.func1() test/e2e/framework/framework.go:274 +0x6d k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo(0xc001059e00) test/e2e/framework/framework.go:271 +0x179 reflect.Value.call({0x6627cc0?, 0xc001139e00?, 0xc00318efb0?}, {0x75b6e72, 0x4}, {0xae73300, 0x0, 0xc003d50568?}) /usr/local/go/src/reflect/value.go:584 +0x8c5 reflect.Value.Call({0x6627cc0?, 0xc001139e00?, 0x29449fc?}, {0xae73300?, 0xc00318ef80?, 0x2fdb5c0?}) /usr/local/go/src/reflect/value.go:368 +0xbc [DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] tear down framework | framework.go:193 STEP: Destroying namespace "webhook-1524" for this suite. 11/26/22 23:43:10.557 STEP: Destroying namespace "webhook-1524-markers" for this suite. 11/26/22 23:43:10.596 Nov 26 23:43:10.636: FAIL: Couldn't delete ns: "webhook-1524-markers": Delete "https://34.83.128.61/api/v1/namespaces/webhook-1524-markers": dial tcp 34.83.128.61:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://34.83.128.61/api/v1/namespaces/webhook-1524-markers", Err:(*net.OpError)(0xc003d559a0)}),Couldn't delete ns: "webhook-1524": Delete "https://34.83.128.61/api/v1/namespaces/webhook-1524": dial tcp 34.83.128.61:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://34.83.128.61/api/v1/namespaces/webhook-1524", Err:(*net.OpError)(0xc001a74e10)}) Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).AfterEach.func1() test/e2e/framework/framework.go:370 +0x4fe k8s.io/kubernetes/test/e2e/framework.(*Framework).AfterEach(0xc001059e00) test/e2e/framework/framework.go:383 +0x1ca reflect.Value.call({0x6627cc0?, 0xc001139d00?, 0xc00397efb0?}, {0x75b6e72, 0x4}, {0xae73300, 0x0, 0x0?}) /usr/local/go/src/reflect/value.go:584 +0x8c5 reflect.Value.Call({0x6627cc0?, 0xc001139d00?, 0x0?}, {0xae73300?, 0x5?, 0xc002be7850?}) /usr/local/go/src/reflect/value.go:368 +0xbc
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\sshould\smutate\scustom\sresource\s\[Conformance\]$'
test/e2e/apimachinery/webhook.go:1808 k8s.io/kubernetes/test/e2e/apimachinery.registerMutatingWebhookForCustomResource(0xc00103fe00, {0xc00121a0d0, 0xc}, 0xc002a631d0, 0xc00110c0e0, 0x2cd6a20?) test/e2e/apimachinery/webhook.go:1808 +0xd51 k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.11() test/e2e/apimachinery/webhook.go:297 +0xadfrom junit_01.xml
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] set up framework | framework.go:178 STEP: Creating a kubernetes client 11/26/22 23:21:39.544 Nov 26 23:21:39.544: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Building a namespace api object, basename webhook 11/26/22 23:21:39.546 Nov 26 23:21:39.585: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:21:41.626: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:21:43.626: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:21:45.626: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:21:47.626: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:21:49.625: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:21:51.625: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:21:53.626: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused STEP: Waiting for a default service account to be provisioned in namespace 11/26/22 23:23:41.864 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 11/26/22 23:23:41.951 [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/apimachinery/webhook.go:90 STEP: Setting up server cert 11/26/22 23:23:42.737 STEP: Create role binding to let webhook read extension-apiserver-authentication 11/26/22 23:23:42.95 Nov 26 23:23:43.001: INFO: role binding webhook-auth-reader already exists STEP: Deploying the webhook pod 11/26/22 23:23:43.001 STEP: Wait for the deployment to be ready 11/26/22 23:23:43.088 Nov 26 23:23:43.218: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 43, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 43, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 43, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 43, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:23:45.284: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 43, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 43, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 43, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 43, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:23:47.267: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 43, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 43, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 43, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 43, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:23:49.269: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 43, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 43, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 43, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 43, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:23:51.295: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 43, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 43, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 43, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 43, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:23:53.270: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 43, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 43, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 43, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 43, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:23:55.293: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 43, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 43, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 43, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 43, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:23:57.278: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 43, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 43, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 43, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 43, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:23:59.268: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 43, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 43, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 43, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 43, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:24:01.287: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 43, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 43, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 23, 43, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 23, 43, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} STEP: Deploying the webhook service 11/26/22 23:24:03.319 STEP: Verifying the service has paired with the endpoint 11/26/22 23:24:03.414 Nov 26 23:24:04.414: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1 [It] should mutate custom resource [Conformance] test/e2e/apimachinery/webhook.go:291 Nov 26 23:24:04.599: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Registering the mutating webhook for custom resource e2e-test-webhook-3352-crds.webhook.example.com via the AdmissionRegistration API 11/26/22 23:24:05.524 Nov 26 23:24:06.209: INFO: Waiting for webhook configuration to be ready... Nov 26 23:24:06.537: INFO: Waiting for webhook configuration to be ready... Nov 26 23:24:06.930: INFO: Waiting for webhook configuration to be ready... Nov 26 23:24:07.247: INFO: Waiting for webhook configuration to be ready... Nov 26 23:24:07.711: INFO: Waiting for webhook configuration to be ready... Nov 26 23:24:08.171: INFO: Waiting for webhook configuration to be ready... Nov 26 23:24:08.700: INFO: Waiting for webhook configuration to be ready... Nov 26 23:24:08.923: INFO: Waiting for webhook configuration to be ready... Nov 26 23:24:09.227: INFO: Waiting for webhook configuration to be ready... Nov 26 23:24:09.651: INFO: Waiting for webhook configuration to be ready... Nov 26 23:24:10.054: INFO: Waiting for webhook configuration to be ready... Nov 26 23:24:10.441: INFO: Waiting for webhook configuration to be ready... Nov 26 23:24:11.061: INFO: Waiting for webhook configuration to be ready... Nov 26 23:24:11.474: INFO: Waiting for webhook configuration to be ready... Nov 26 23:24:11.864: INFO: Waiting for webhook configuration to be ready... Nov 26 23:24:12.495: INFO: Waiting for webhook configuration to be ready... Nov 26 23:24:13.108: INFO: Waiting for webhook configuration to be ready... Nov 26 23:24:14.193: INFO: Waiting for webhook configuration to be ready... Nov 26 23:24:14.613: INFO: Waiting for webhook configuration to be ready... Nov 26 23:24:14.948: INFO: Waiting for webhook configuration to be ready... Nov 26 23:24:15.204: INFO: Waiting for webhook configuration to be ready... Nov 26 23:24:49.495: INFO: Waiting for webhook configuration to be ready... Nov 26 23:24:55.139: INFO: Waiting for webhook configuration to be ready... Nov 26 23:24:55.139: INFO: Unexpected error: waiting for webhook configuration to be ready: <*errors.errorString | 0xc0000d1db0>: { s: "timed out waiting for the condition", } Nov 26 23:24:55.139: FAIL: waiting for webhook configuration to be ready: timed out waiting for the condition Full Stack Trace k8s.io/kubernetes/test/e2e/apimachinery.registerMutatingWebhookForCustomResource(0xc00103fe00, {0xc00121a0d0, 0xc}, 0xc002a631d0, 0xc00110c0e0, 0x2cd6a20?) test/e2e/apimachinery/webhook.go:1808 +0xd51 k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.11() test/e2e/apimachinery/webhook.go:297 +0xad [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/framework/node/init/init.go:32 Nov 26 23:24:59.634: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/apimachinery/webhook.go:105 [DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] dump namespaces | framework.go:196 STEP: dump namespace information after failure 11/26/22 23:25:01.398 STEP: Collecting events from namespace "webhook-2396". 11/26/22 23:25:01.398 STEP: Found 13 events. 11/26/22 23:25:01.44 Nov 26 23:25:01.440: INFO: At 2022-11-26 23:23:43 +0000 UTC - event for sample-webhook-deployment: {deployment-controller } ScalingReplicaSet: Scaled up replica set sample-webhook-deployment-865554f4d9 to 1 Nov 26 23:25:01.440: INFO: At 2022-11-26 23:23:43 +0000 UTC - event for sample-webhook-deployment-865554f4d9: {replicaset-controller } SuccessfulCreate: Created pod: sample-webhook-deployment-865554f4d9-jfnjx Nov 26 23:25:01.440: INFO: At 2022-11-26 23:23:43 +0000 UTC - event for sample-webhook-deployment-865554f4d9-jfnjx: {default-scheduler } Scheduled: Successfully assigned webhook-2396/sample-webhook-deployment-865554f4d9-jfnjx to bootstrap-e2e-minion-group-n9b1 Nov 26 23:25:01.440: INFO: At 2022-11-26 23:23:44 +0000 UTC - event for sample-webhook-deployment-865554f4d9-jfnjx: {kubelet bootstrap-e2e-minion-group-n9b1} FailedMount: MountVolume.SetUp failed for volume "webhook-certs" : failed to sync secret cache: timed out waiting for the condition Nov 26 23:25:01.440: INFO: At 2022-11-26 23:23:51 +0000 UTC - event for sample-webhook-deployment-865554f4d9-jfnjx: {kubelet bootstrap-e2e-minion-group-n9b1} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Nov 26 23:25:01.440: INFO: At 2022-11-26 23:23:51 +0000 UTC - event for sample-webhook-deployment-865554f4d9-jfnjx: {kubelet bootstrap-e2e-minion-group-n9b1} Created: Created container sample-webhook Nov 26 23:25:01.440: INFO: At 2022-11-26 23:23:51 +0000 UTC - event for sample-webhook-deployment-865554f4d9-jfnjx: {kubelet bootstrap-e2e-minion-group-n9b1} Started: Started container sample-webhook Nov 26 23:25:01.440: INFO: At 2022-11-26 23:23:53 +0000 UTC - event for sample-webhook-deployment-865554f4d9-jfnjx: {kubelet bootstrap-e2e-minion-group-n9b1} Killing: Stopping container sample-webhook Nov 26 23:25:01.440: INFO: At 2022-11-26 23:23:54 +0000 UTC - event for sample-webhook-deployment-865554f4d9-jfnjx: {kubelet bootstrap-e2e-minion-group-n9b1} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Nov 26 23:25:01.440: INFO: At 2022-11-26 23:23:54 +0000 UTC - event for sample-webhook-deployment-865554f4d9-jfnjx: {kubelet bootstrap-e2e-minion-group-n9b1} Unhealthy: Readiness probe failed: Get "https://10.64.3.202:8444/readyz": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) Nov 26 23:25:01.440: INFO: At 2022-11-26 23:23:59 +0000 UTC - event for sample-webhook-deployment-865554f4d9-jfnjx: {kubelet bootstrap-e2e-minion-group-n9b1} Unhealthy: Readiness probe failed: Get "https://10.64.3.210:8444/readyz": dial tcp 10.64.3.210:8444: connect: connection refused Nov 26 23:25:01.440: INFO: At 2022-11-26 23:24:01 +0000 UTC - event for sample-webhook-deployment-865554f4d9-jfnjx: {kubelet bootstrap-e2e-minion-group-n9b1} BackOff: Back-off restarting failed container sample-webhook in pod sample-webhook-deployment-865554f4d9-jfnjx_webhook-2396(712349d7-7e27-4069-bd1b-853c99ad5136) Nov 26 23:25:01.440: INFO: At 2022-11-26 23:24:19 +0000 UTC - event for sample-webhook-deployment-865554f4d9-jfnjx: {kubelet bootstrap-e2e-minion-group-n9b1} Unhealthy: Readiness probe failed: Get "https://10.64.3.218:8444/readyz": dial tcp 10.64.3.218:8444: connect: connection refused Nov 26 23:25:01.484: INFO: POD NODE PHASE GRACE CONDITIONS Nov 26 23:25:01.484: INFO: sample-webhook-deployment-865554f4d9-jfnjx bootstrap-e2e-minion-group-n9b1 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-11-26 23:23:43 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-11-26 23:24:00 +0000 UTC ContainersNotReady containers with unready status: [sample-webhook]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2022-11-26 23:24:00 +0000 UTC ContainersNotReady containers with unready status: [sample-webhook]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-11-26 23:23:43 +0000 UTC }] Nov 26 23:25:01.484: INFO: Nov 26 23:25:01.533: INFO: Unable to fetch webhook-2396/sample-webhook-deployment-865554f4d9-jfnjx/sample-webhook logs: an error on the server ("unknown") has prevented the request from succeeding (get pods sample-webhook-deployment-865554f4d9-jfnjx) Nov 26 23:25:01.587: INFO: Logging node info for node bootstrap-e2e-master Nov 26 23:25:01.628: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master c85fbb04-d865-42ae-b40a-365f0873d077 6443 0 2022-11-26 23:10:47 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 23:10:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-11-26 23:11:08 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-11-26 23:11:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-11-26 23:22:59 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-6-1-5-ctl-skew/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3858374656 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3596230656 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 23:11:08 +0000 UTC,LastTransitionTime:2022-11-26 23:11:08 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 23:22:59 +0000 UTC,LastTransitionTime:2022-11-26 23:10:47 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 23:22:59 +0000 UTC,LastTransitionTime:2022-11-26 23:10:47 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 23:22:59 +0000 UTC,LastTransitionTime:2022-11-26 23:10:47 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 23:22:59 +0000 UTC,LastTransitionTime:2022-11-26 23:11:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:34.83.128.61,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:51f618a4ea82aa4d3795e4cfa76e3a28,SystemUUID:51f618a4-ea82-aa4d-3795-e4cfa76e3a28,BootID:eb1eb4fb-e105-4d49-9289-0d31902f8c4d,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:135160272,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:124990265,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:57660216,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:2c111f004bec24888d8cfa2a812a38fb8341350abac67dcd0ac64e709dfe389c registry.k8s.io/kas-network-proxy/proxy-server:v0.0.33],SizeBytes:22020129,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 26 23:25:01.629: INFO: Logging kubelet events for node bootstrap-e2e-master Nov 26 23:25:01.693: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-master Nov 26 23:25:01.737: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-master: error trying to reach service: No agent available Nov 26 23:25:01.737: INFO: Logging node info for node bootstrap-e2e-minion-group-dr7t Nov 26 23:25:01.779: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-dr7t b4041686-ad54-48f5-95c3-e848d9a8f0a7 7936 0 2022-11-26 23:10:49 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-dr7t kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-dr7t topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-5218":"bootstrap-e2e-minion-group-dr7t","csi-hostpath-ephemeral-5883":"bootstrap-e2e-minion-group-dr7t","csi-hostpath-ephemeral-8027":"bootstrap-e2e-minion-group-dr7t","csi-hostpath-volume-expand-3788":"bootstrap-e2e-minion-group-dr7t","csi-mock-csi-mock-volumes-28":"bootstrap-e2e-minion-group-dr7t","csi-mock-csi-mock-volumes-5660":"bootstrap-e2e-minion-group-dr7t","csi-mock-csi-mock-volumes-7211":"bootstrap-e2e-minion-group-dr7t"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 23:10:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 23:10:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {node-problem-detector Update v1 2022-11-26 23:21:59 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-11-26 23:24:09 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2022-11-26 23:24:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-6-1-5-ctl-skew/us-west1-b/bootstrap-e2e-minion-group-dr7t,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 23:21:59 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 23:21:59 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 23:21:59 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 23:21:59 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 23:21:59 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 23:21:59 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 23:21:59 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 23:11:08 +0000 UTC,LastTransitionTime:2022-11-26 23:11:08 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 23:24:58 +0000 UTC,LastTransitionTime:2022-11-26 23:10:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 23:24:58 +0000 UTC,LastTransitionTime:2022-11-26 23:10:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 23:24:58 +0000 UTC,LastTransitionTime:2022-11-26 23:10:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 23:24:58 +0000 UTC,LastTransitionTime:2022-11-26 23:10:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:35.185.223.63,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-dr7t.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-dr7t.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:29f409e413f0ebfffc6ee0c012a074c7,SystemUUID:29f409e4-13f0-ebff-fc6e-e0c012a074c7,BootID:a3bfef7b-2d61-4ac5-a15e-34631edb66c9,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-5218^509c30c1-6de1-11ed-8ef9-66b4d7ccc072 kubernetes.io/csi/csi-mock-csi-mock-volumes-28^6c31aba3-6de1-11ed-85a6-da330f40b0b4],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-28^6c31aba3-6de1-11ed-85a6-da330f40b0b4,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-5218^509c30c1-6de1-11ed-8ef9-66b4d7ccc072,DevicePath:,},},Config:nil,},} Nov 26 23:25:01.779: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-dr7t Nov 26 23:25:01.823: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-dr7t Nov 26 23:25:01.866: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-dr7t: error trying to reach service: No agent available Nov 26 23:25:01.866: INFO: Logging node info for node bootstrap-e2e-minion-group-l8ht Nov 26 23:25:01.908: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-l8ht 3e5210d0-ba6b-4f56-896c-40aaae5093d0 7942 0 2022-11-26 23:10:52 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-l8ht kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-l8ht topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-3757":"bootstrap-e2e-minion-group-l8ht","csi-hostpath-provisioning-3513":"bootstrap-e2e-minion-group-l8ht","csi-hostpath-volume-expand-7512":"bootstrap-e2e-minion-group-l8ht","csi-mock-csi-mock-volumes-1468":"bootstrap-e2e-minion-group-l8ht","csi-mock-csi-mock-volumes-355":"bootstrap-e2e-minion-group-l8ht"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 23:10:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 23:10:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {node-problem-detector Update v1 2022-11-26 23:22:01 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-11-26 23:23:41 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2022-11-26 23:24:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-6-1-5-ctl-skew/us-west1-b/bootstrap-e2e-minion-group-l8ht,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 23:22:01 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 23:22:01 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 23:22:01 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 23:22:01 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 23:22:01 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 23:22:01 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 23:22:01 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 23:11:08 +0000 UTC,LastTransitionTime:2022-11-26 23:11:08 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 23:24:58 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 23:24:58 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 23:24:58 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 23:24:58 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:34.168.47.71,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-l8ht.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-l8ht.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:89b0fd3f78d194fccba6eb2ce27680f6,SystemUUID:89b0fd3f-78d1-94fc-cba6-eb2ce27680f6,BootID:ec1fa0a7-81b7-48ec-8da0-cc1b45a14fc8,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-55^28d8d761-6de0-11ed-8c44-7ec558aa6670],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-55^28d8d761-6de0-11ed-8c44-7ec558aa6670,DevicePath:,},},Config:nil,},} Nov 26 23:25:01.908: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-l8ht Nov 26 23:25:01.951: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-l8ht Nov 26 23:25:01.994: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-l8ht: error trying to reach service: No agent available Nov 26 23:25:01.994: INFO: Logging node info for node bootstrap-e2e-minion-group-n9b1 Nov 26 23:25:02.036: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-n9b1 796907e0-52c8-4c84-815a-6442939836c4 7731 0 2022-11-26 23:10:52 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-n9b1 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-n9b1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-5727":"bootstrap-e2e-minion-group-n9b1","csi-hostpath-provisioning-254":"bootstrap-e2e-minion-group-n9b1","csi-mock-csi-mock-volumes-7584":"bootstrap-e2e-minion-group-n9b1","csi-mock-csi-mock-volumes-7940":"bootstrap-e2e-minion-group-n9b1"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 23:10:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 23:10:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {node-problem-detector Update v1 2022-11-26 23:22:02 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-11-26 23:24:03 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2022-11-26 23:24:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-6-1-5-ctl-skew/us-west1-b/bootstrap-e2e-minion-group-n9b1,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 23:22:02 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 23:22:02 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 23:22:02 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 23:22:02 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 23:22:02 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 23:22:02 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 23:22:02 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 23:11:08 +0000 UTC,LastTransitionTime:2022-11-26 23:11:08 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 23:24:11 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 23:24:11 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 23:24:11 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 23:24:11 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.145.73.48,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-n9b1.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-n9b1.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:47bcd2b143b08ae3cf2e280a7c6e673a,SystemUUID:47bcd2b1-43b0-8ae3-cf2e-280a7c6e673a,BootID:c567f407-918f-4298-a12f-a33a4e211fcf,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 registry.k8s.io/sig-storage/snapshot-controller:v6.1.0],SizeBytes:22620891,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-169^c8e3d50b-6de0-11ed-aed4-6a12d5ab5936 kubernetes.io/csi/csi-mock-csi-mock-volumes-7584^688f4ec1-6de1-11ed-8b45-9afa498cd345],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-169^c8e3d50b-6de0-11ed-aed4-6a12d5ab5936,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-7584^688f4ec1-6de1-11ed-8b45-9afa498cd345,DevicePath:,},},Config:nil,},} Nov 26 23:25:02.036: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-n9b1 Nov 26 23:25:02.080: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-n9b1 Nov 26 23:25:03.586: INFO: csi-mockplugin-0 started at 2022-11-26 23:13:42 +0000 UTC (0+3 container statuses recorded) Nov 26 23:25:03.586: INFO: Container csi-provisioner ready: true, restart count 0 Nov 26 23:25:03.586: INFO: Container driver-registrar ready: true, restart count 0 Nov 26 23:25:03.586: INFO: Container mock ready: true, restart count 0 Nov 26 23:25:03.586: INFO: emptydir-injector started at 2022-11-26 23:23:42 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:03.586: INFO: Container emptydir-injector ready: false, restart count 1 Nov 26 23:25:03.586: INFO: execpoddl5wp started at 2022-11-26 23:18:24 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:03.586: INFO: Container agnhost-container ready: true, restart count 2 Nov 26 23:25:03.586: INFO: simpletest.rc-mr42d started at <nil> (0+0 container statuses recorded) Nov 26 23:25:03.586: INFO: simpletest.rc-xdwbr started at <nil> (0+0 container statuses recorded) Nov 26 23:25:03.586: INFO: pfpod started at <nil> (0+0 container statuses recorded) Nov 26 23:25:03.586: INFO: hostexec-bootstrap-e2e-minion-group-n9b1-xzltr started at 2022-11-26 23:13:55 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:03.586: INFO: Container agnhost-container ready: true, restart count 5 Nov 26 23:25:03.586: INFO: simpletest.rc-bmbvf started at <nil> (0+0 container statuses recorded) Nov 26 23:25:03.586: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 23:18:51 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:03.586: INFO: Container csi-attacher ready: true, restart count 3 Nov 26 23:25:03.586: INFO: simpletest.rc-4n9fc started at <nil> (0+0 container statuses recorded) Nov 26 23:25:03.586: INFO: simpletest.rc-mmvjs started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:03.586: INFO: Container nginx ready: true, restart count 0 Nov 26 23:25:03.586: INFO: simpletest.rc-kcjjc started at <nil> (0+0 container statuses recorded) Nov 26 23:25:03.586: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 23:13:43 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:03.586: INFO: Container csi-attacher ready: true, restart count 3 Nov 26 23:25:03.586: INFO: csi-hostpathplugin-0 started at 2022-11-26 23:19:27 +0000 UTC (0+7 container statuses recorded) Nov 26 23:25:03.586: INFO: Container csi-attacher ready: false, restart count 5 Nov 26 23:25:03.586: INFO: Container csi-provisioner ready: false, restart count 5 Nov 26 23:25:03.586: INFO: Container csi-resizer ready: false, restart count 5 Nov 26 23:25:03.586: INFO: Container csi-snapshotter ready: false, restart count 5 Nov 26 23:25:03.586: INFO: Container hostpath ready: false, restart count 5 Nov 26 23:25:03.586: INFO: Container liveness-probe ready: false, restart count 5 Nov 26 23:25:03.586: INFO: Container node-driver-registrar ready: false, restart count 5 Nov 26 23:25:03.586: INFO: test-container-pod started at 2022-11-26 23:19:29 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:03.586: INFO: Container webserver ready: true, restart count 4 Nov 26 23:25:03.586: INFO: csi-mockplugin-0 started at 2022-11-26 23:23:43 +0000 UTC (0+3 container statuses recorded) Nov 26 23:25:03.586: INFO: Container csi-provisioner ready: true, restart count 0 Nov 26 23:25:03.586: INFO: Container driver-registrar ready: true, restart count 0 Nov 26 23:25:03.586: INFO: Container mock ready: true, restart count 0 Nov 26 23:25:03.586: INFO: simpletest.rc-zwjbb started at <nil> (0+0 container statuses recorded) Nov 26 23:25:03.586: INFO: agnhost started at 2022-11-26 23:13:56 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:03.586: INFO: Container agnhost ready: false, restart count 0 Nov 26 23:25:03.586: INFO: test-rs-znh42 started at 2022-11-26 23:23:43 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:03.586: INFO: Container httpd ready: true, restart count 1 Nov 26 23:25:03.586: INFO: simpletest.rc-z68xn started at 2022-11-26 23:24:10 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:03.586: INFO: Container nginx ready: false, restart count 0 Nov 26 23:25:03.586: INFO: pod-exec-websocket-cb04b6b5-cb7c-4c75-84ae-5d6e56d0b6a4 started at <nil> (0+0 container statuses recorded) Nov 26 23:25:03.586: INFO: konnectivity-agent-bw7hk started at 2022-11-26 23:11:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:03.586: INFO: Container konnectivity-agent ready: false, restart count 5 Nov 26 23:25:03.586: INFO: csi-hostpathplugin-0 started at 2022-11-26 23:13:58 +0000 UTC (0+7 container statuses recorded) Nov 26 23:25:03.586: INFO: Container csi-attacher ready: true, restart count 1 Nov 26 23:25:03.586: INFO: Container csi-provisioner ready: true, restart count 1 Nov 26 23:25:03.586: INFO: Container csi-resizer ready: true, restart count 1 Nov 26 23:25:03.586: INFO: Container csi-snapshotter ready: true, restart count 1 Nov 26 23:25:03.586: INFO: Container hostpath ready: true, restart count 1 Nov 26 23:25:03.586: INFO: Container liveness-probe ready: true, restart count 1 Nov 26 23:25:03.586: INFO: Container node-driver-registrar ready: true, restart count 1 Nov 26 23:25:03.586: INFO: concurrent-27825083-ldnwm started at 2022-11-26 23:23:41 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:03.586: INFO: Container c ready: false, restart count 0 Nov 26 23:25:03.586: INFO: ss2-0 started at 2022-11-26 23:23:43 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:03.586: INFO: Container webserver ready: true, restart count 1 Nov 26 23:25:03.586: INFO: sample-webhook-deployment-865554f4d9-jfnjx started at 2022-11-26 23:23:43 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:03.586: INFO: Container sample-webhook ready: false, restart count 1 Nov 26 23:25:03.586: INFO: csi-hostpathplugin-0 started at <nil> (0+0 container statuses recorded) Nov 26 23:25:03.586: INFO: simpletest.rc-ppgv4 started at <nil> (0+0 container statuses recorded) Nov 26 23:25:03.586: INFO: simpletest.rc-7xb2l started at <nil> (0+0 container statuses recorded) Nov 26 23:25:03.586: INFO: simpletest.rc-65qg4 started at <nil> (0+0 container statuses recorded) Nov 26 23:25:03.586: INFO: nfs-injector started at 2022-11-26 23:18:28 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:03.586: INFO: Container nfs-injector ready: false, restart count 0 Nov 26 23:25:03.586: INFO: dns-test-c2505ebd-e6a3-455c-9a9f-58dbe21ea53c started at 2022-11-26 23:23:42 +0000 UTC (0+3 container statuses recorded) Nov 26 23:25:03.586: INFO: Container jessie-querier ready: true, restart count 0 Nov 26 23:25:03.586: INFO: Container querier ready: true, restart count 0 Nov 26 23:25:03.586: INFO: Container webserver ready: true, restart count 0 Nov 26 23:25:03.586: INFO: nfs-server started at 2022-11-26 23:18:21 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:03.586: INFO: Container nfs-server ready: true, restart count 2 Nov 26 23:25:03.586: INFO: hostexec-bootstrap-e2e-minion-group-n9b1-h77pq started at 2022-11-26 23:19:47 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:03.586: INFO: Container agnhost-container ready: true, restart count 2 Nov 26 23:25:03.586: INFO: dns-test-37d137df-f1fb-46b2-81e9-153cb7845ef4 started at <nil> (0+0 container statuses recorded) Nov 26 23:25:03.586: INFO: nfs-server started at 2022-11-26 23:13:40 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:03.586: INFO: Container nfs-server ready: false, restart count 4 Nov 26 23:25:03.586: INFO: netserver-2 started at 2022-11-26 23:13:41 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:03.586: INFO: Container webserver ready: true, restart count 2 Nov 26 23:25:03.586: INFO: hostpath-symlink-prep-provisioning-2139 started at 2022-11-26 23:13:54 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:03.586: INFO: Container init-volume-provisioning-2139 ready: false, restart count 0 Nov 26 23:25:03.586: INFO: inline-volume-tester-kccb4 started at 2022-11-26 23:19:31 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:03.586: INFO: Container csi-volume-tester ready: false, restart count 0 Nov 26 23:25:03.586: INFO: hostpath-injector started at 2022-11-26 23:19:35 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:03.586: INFO: Container hostpath-injector ready: false, restart count 0 Nov 26 23:25:03.586: INFO: simpletest.rc-pkd4b started at <nil> (0+0 container statuses recorded) Nov 26 23:25:03.586: INFO: metrics-server-v0.5.2-867b8754b9-6gwjw started at 2022-11-26 23:11:21 +0000 UTC (0+2 container statuses recorded) Nov 26 23:25:03.586: INFO: Container metrics-server ready: false, restart count 6 Nov 26 23:25:03.586: INFO: Container metrics-server-nanny ready: false, restart count 6 Nov 26 23:25:03.586: INFO: netserver-2 started at 2022-11-26 23:18:54 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:03.586: INFO: Container webserver ready: true, restart count 1 Nov 26 23:25:03.586: INFO: simpletest.rc-2hh6h started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:03.586: INFO: Container nginx ready: true, restart count 0 Nov 26 23:25:03.586: INFO: alpine-nnp-nil-b4cd4bc5-9952-4e9b-8054-f9880757fdd1 started at <nil> (0+0 container statuses recorded) Nov 26 23:25:03.586: INFO: annotationupdate34c6042a-c78f-4b49-904c-032a9afaf544 started at 2022-11-26 23:23:42 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:03.586: INFO: Container client-container ready: true, restart count 0 Nov 26 23:25:03.586: INFO: netserver-2 started at 2022-11-26 23:19:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:03.586: INFO: Container webserver ready: true, restart count 5 Nov 26 23:25:03.586: INFO: csi-hostpathplugin-0 started at 2022-11-26 23:19:31 +0000 UTC (0+7 container statuses recorded) Nov 26 23:25:03.586: INFO: Container csi-attacher ready: false, restart count 5 Nov 26 23:25:03.586: INFO: Container csi-provisioner ready: false, restart count 5 Nov 26 23:25:03.586: INFO: Container csi-resizer ready: false, restart count 5 Nov 26 23:25:03.586: INFO: Container csi-snapshotter ready: false, restart count 5 Nov 26 23:25:03.586: INFO: Container hostpath ready: false, restart count 5 Nov 26 23:25:03.586: INFO: Container liveness-probe ready: false, restart count 5 Nov 26 23:25:03.586: INFO: Container node-driver-registrar ready: false, restart count 5 Nov 26 23:25:03.586: INFO: simpletest.rc-q84md started at <nil> (0+0 container statuses recorded) Nov 26 23:25:03.586: INFO: simpletest.rc-c4vdk started at <nil> (0+0 container statuses recorded) Nov 26 23:25:03.586: INFO: simpletest.rc-q96cd started at <nil> (0+0 container statuses recorded) Nov 26 23:25:03.586: INFO: simpletest.rc-qwqsv started at <nil> (0+0 container statuses recorded) Nov 26 23:25:03.586: INFO: simpletest.rc-5cj45 started at <nil> (0+0 container statuses recorded) Nov 26 23:25:03.586: INFO: kube-proxy-bootstrap-e2e-minion-group-n9b1 started at 2022-11-26 23:10:52 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:03.586: INFO: Container kube-proxy ready: false, restart count 6 Nov 26 23:25:03.586: INFO: metadata-proxy-v0.1-h4wpl started at 2022-11-26 23:10:53 +0000 UTC (0+2 container statuses recorded) Nov 26 23:25:03.586: INFO: Container metadata-proxy ready: true, restart count 0 Nov 26 23:25:03.586: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Nov 26 23:25:03.586: INFO: volume-snapshot-controller-0 started at 2022-11-26 23:11:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:03.586: INFO: Container volume-snapshot-controller ready: true, restart count 4 Nov 26 23:25:03.586: INFO: csi-mockplugin-0 started at 2022-11-26 23:18:51 +0000 UTC (0+3 container statuses recorded) Nov 26 23:25:03.586: INFO: Container csi-provisioner ready: false, restart count 4 Nov 26 23:25:03.586: INFO: Container driver-registrar ready: false, restart count 4 Nov 26 23:25:03.586: INFO: Container mock ready: false, restart count 4 Nov 26 23:25:03.586: INFO: hostexec-bootstrap-e2e-minion-group-n9b1-zsjf9 started at <nil> (0+0 container statuses recorded) Nov 26 23:25:03.586: INFO: simpletest.rc-2l65q started at <nil> (0+0 container statuses recorded) Nov 26 23:25:03.586: INFO: simpletest.rc-hzvfz started at <nil> (0+0 container statuses recorded) Nov 26 23:25:03.586: INFO: busybox-b8179d78-1934-400f-a7bf-f26dd814904c started at 2022-11-26 23:23:41 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:03.586: INFO: Container busybox ready: true, restart count 0 Nov 26 23:25:03.586: INFO: simpletest.rc-dvg8l started at <nil> (0+0 container statuses recorded) Nov 26 23:25:03.586: INFO: concurrent-27825080-kb7bb started at 2022-11-26 23:20:00 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:03.586: INFO: Container c ready: false, restart count 0 Nov 26 23:25:03.586: INFO: l7-default-backend-8549d69d99-zgjzh started at 2022-11-26 23:11:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:03.586: INFO: Container default-http-backend ready: true, restart count 0 Nov 26 23:25:03.586: INFO: server-envvars-6222e6ac-d567-472d-bd00-c996ebe3395c started at 2022-11-26 23:13:40 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:03.586: INFO: Container srv ready: false, restart count 4 Nov 26 23:25:03.586: INFO: pod-secrets-a152d9c1-cdeb-488b-9c0c-b830477f5f6c started at 2022-11-26 23:19:54 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:03.586: INFO: Container secret-test ready: false, restart count 1 Nov 26 23:25:03.586: INFO: execpods9dgn started at 2022-11-26 23:18:45 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:03.586: INFO: Container agnhost-container ready: true, restart count 2 Nov 26 23:25:03.586: INFO: simpletest.rc-7n2vx started at <nil> (0+0 container statuses recorded) Nov 26 23:25:03.586: INFO: simpletest.rc-mpjvz started at <nil> (0+0 container statuses recorded) Nov 26 23:25:03.586: INFO: e2e-2gjr9-l5xsj started at 2022-11-26 23:13:41 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:03.586: INFO: Container c ready: false, restart count 0 Nov 26 23:25:03.586: INFO: simpletest.rc-sf5jw started at <nil> (0+0 container statuses recorded) Nov 26 23:25:03.586: INFO: simpletest.rc-xt677 started at <nil> (0+0 container statuses recorded) Nov 26 23:25:03.586: INFO: simpletest.rc-vpt65 started at <nil> (0+0 container statuses recorded) Nov 26 23:25:03.586: INFO: simpletest.rc-hmgxt started at <nil> (0+0 container statuses recorded) Nov 26 23:25:03.586: INFO: pod-0b414c7b-dcc9-4e00-9536-9db8ccc1a7b7 started at 2022-11-26 23:19:47 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:03.586: INFO: Container test-container ready: false, restart count 0 Nov 26 23:25:03.586: INFO: sample-webhook-deployment-865554f4d9-4zmb9 started at 2022-11-26 23:23:42 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:03.586: INFO: Container sample-webhook ready: false, restart count 1 Nov 26 23:25:03.586: INFO: pod-projected-configmaps-334f9945-2444-46e4-b837-44369e43dccb started at 2022-11-26 23:19:59 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:03.586: INFO: Container agnhost-container ready: false, restart count 0 Nov 26 23:25:03.586: INFO: test-rs-ljz55 started at 2022-11-26 23:19:54 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:03.586: INFO: Container httpd ready: true, restart count 2 Nov 26 23:25:03.586: INFO: pvc-volume-tester-h6ptm started at <nil> (0+0 container statuses recorded) Nov 26 23:25:03.586: INFO: simpletest.rc-ff8cc started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:03.586: INFO: Container nginx ready: true, restart count 0 Nov 26 23:25:03.586: INFO: csi-mockplugin-0 started at 2022-11-26 23:13:42 +0000 UTC (0+3 container statuses recorded) Nov 26 23:25:03.586: INFO: Container csi-provisioner ready: false, restart count 5 Nov 26 23:25:03.586: INFO: Container driver-registrar ready: false, restart count 5 Nov 26 23:25:03.586: INFO: Container mock ready: false, restart count 5 Nov 26 23:25:03.586: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 23:13:43 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:03.586: INFO: Container csi-attacher ready: true, restart count 3 Nov 26 23:25:03.586: INFO: host-test-container-pod started at 2022-11-26 23:19:29 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:03.586: INFO: Container agnhost-container ready: true, restart count 0 Nov 26 23:25:03.586: INFO: simpletest.rc-k95tx started at <nil> (0+0 container statuses recorded) Nov 26 23:25:03.586: INFO: externalip-test-wfc9z started at 2022-11-26 23:18:39 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:03.586: INFO: Container externalip-test ready: true, restart count 0 Nov 26 23:25:03.586: INFO: pod-secrets-e205404c-d02a-48b5-b795-ba659d81ee5b started at <nil> (0+0 container statuses recorded) Nov 26 23:25:03.586: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 23:23:43 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:03.586: INFO: Container csi-attacher ready: true, restart count 0 Nov 26 23:25:03.586: INFO: simpletest.rc-kdbtf started at <nil> (0+0 container statuses recorded) Nov 26 23:25:03.586: INFO: simpletest.rc-vmg49 started at <nil> (0+0 container statuses recorded) Nov 26 23:25:03.586: INFO: simpletest.rc-cq84x started at <nil> (0+0 container statuses recorded) Nov 26 23:25:03.586: INFO: simpletest.rc-vzc27 started at <nil> (0+0 container statuses recorded) Nov 26 23:25:03.586: INFO: simpletest.rc-pjws9 started at <nil> (0+0 container statuses recorded) Nov 26 23:25:07.173: INFO: Latency metrics for node bootstrap-e2e-minion-group-n9b1 STEP: Collecting events from namespace "webhook-2396-markers". 11/26/22 23:25:07.173 STEP: Found 0 events. 11/26/22 23:25:07.214 Nov 26 23:25:07.255: INFO: POD NODE PHASE GRACE CONDITIONS Nov 26 23:25:07.255: INFO: Nov 26 23:25:07.299: INFO: Logging node info for node bootstrap-e2e-master Nov 26 23:25:07.340: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master c85fbb04-d865-42ae-b40a-365f0873d077 6443 0 2022-11-26 23:10:47 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 23:10:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-11-26 23:11:08 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-11-26 23:11:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-11-26 23:22:59 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-6-1-5-ctl-skew/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3858374656 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3596230656 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 23:11:08 +0000 UTC,LastTransitionTime:2022-11-26 23:11:08 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 23:22:59 +0000 UTC,LastTransitionTime:2022-11-26 23:10:47 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 23:22:59 +0000 UTC,LastTransitionTime:2022-11-26 23:10:47 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 23:22:59 +0000 UTC,LastTransitionTime:2022-11-26 23:10:47 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 23:22:59 +0000 UTC,LastTransitionTime:2022-11-26 23:11:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:34.83.128.61,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:51f618a4ea82aa4d3795e4cfa76e3a28,SystemUUID:51f618a4-ea82-aa4d-3795-e4cfa76e3a28,BootID:eb1eb4fb-e105-4d49-9289-0d31902f8c4d,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:135160272,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:124990265,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:57660216,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:2c111f004bec24888d8cfa2a812a38fb8341350abac67dcd0ac64e709dfe389c registry.k8s.io/kas-network-proxy/proxy-server:v0.0.33],SizeBytes:22020129,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 26 23:25:07.340: INFO: Logging kubelet events for node bootstrap-e2e-master Nov 26 23:25:07.385: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-master Nov 26 23:25:07.468: INFO: kube-scheduler-bootstrap-e2e-master started at 2022-11-26 23:10:04 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:07.468: INFO: Container kube-scheduler ready: true, restart count 4 Nov 26 23:25:07.468: INFO: etcd-server-bootstrap-e2e-master started at 2022-11-26 23:10:04 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:07.468: INFO: Container etcd-container ready: true, restart count 3 Nov 26 23:25:07.468: INFO: konnectivity-server-bootstrap-e2e-master started at 2022-11-26 23:10:04 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:07.468: INFO: Container konnectivity-server-container ready: true, restart count 1 Nov 26 23:25:07.468: INFO: kube-apiserver-bootstrap-e2e-master started at 2022-11-26 23:10:04 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:07.468: INFO: Container kube-apiserver ready: true, restart count 3 Nov 26 23:25:07.468: INFO: etcd-server-events-bootstrap-e2e-master started at 2022-11-26 23:10:04 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:07.468: INFO: Container etcd-container ready: true, restart count 1 Nov 26 23:25:07.468: INFO: kube-controller-manager-bootstrap-e2e-master started at 2022-11-26 23:10:04 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:07.468: INFO: Container kube-controller-manager ready: false, restart count 6 Nov 26 23:25:07.468: INFO: kube-addon-manager-bootstrap-e2e-master started at 2022-11-26 23:10:21 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:07.468: INFO: Container kube-addon-manager ready: true, restart count 2 Nov 26 23:25:07.468: INFO: l7-lb-controller-bootstrap-e2e-master started at 2022-11-26 23:10:21 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:07.468: INFO: Container l7-lb-controller ready: false, restart count 6 Nov 26 23:25:07.468: INFO: metadata-proxy-v0.1-cs4d8 started at 2022-11-26 23:11:29 +0000 UTC (0+2 container statuses recorded) Nov 26 23:25:07.468: INFO: Container metadata-proxy ready: true, restart count 0 Nov 26 23:25:07.468: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Nov 26 23:25:07.699: INFO: Latency metrics for node bootstrap-e2e-master Nov 26 23:25:07.699: INFO: Logging node info for node bootstrap-e2e-minion-group-dr7t Nov 26 23:25:07.740: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-dr7t b4041686-ad54-48f5-95c3-e848d9a8f0a7 7936 0 2022-11-26 23:10:49 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-dr7t kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-dr7t topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-5218":"bootstrap-e2e-minion-group-dr7t","csi-hostpath-ephemeral-5883":"bootstrap-e2e-minion-group-dr7t","csi-hostpath-ephemeral-8027":"bootstrap-e2e-minion-group-dr7t","csi-hostpath-volume-expand-3788":"bootstrap-e2e-minion-group-dr7t","csi-mock-csi-mock-volumes-28":"bootstrap-e2e-minion-group-dr7t","csi-mock-csi-mock-volumes-5660":"bootstrap-e2e-minion-group-dr7t","csi-mock-csi-mock-volumes-7211":"bootstrap-e2e-minion-group-dr7t"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 23:10:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 23:10:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {node-problem-detector Update v1 2022-11-26 23:21:59 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-11-26 23:24:09 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2022-11-26 23:24:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-6-1-5-ctl-skew/us-west1-b/bootstrap-e2e-minion-group-dr7t,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 23:21:59 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 23:21:59 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 23:21:59 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 23:21:59 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 23:21:59 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 23:21:59 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 23:21:59 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 23:11:08 +0000 UTC,LastTransitionTime:2022-11-26 23:11:08 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 23:24:58 +0000 UTC,LastTransitionTime:2022-11-26 23:10:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 23:24:58 +0000 UTC,LastTransitionTime:2022-11-26 23:10:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 23:24:58 +0000 UTC,LastTransitionTime:2022-11-26 23:10:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 23:24:58 +0000 UTC,LastTransitionTime:2022-11-26 23:10:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:35.185.223.63,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-dr7t.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-dr7t.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:29f409e413f0ebfffc6ee0c012a074c7,SystemUUID:29f409e4-13f0-ebff-fc6e-e0c012a074c7,BootID:a3bfef7b-2d61-4ac5-a15e-34631edb66c9,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-5218^509c30c1-6de1-11ed-8ef9-66b4d7ccc072 kubernetes.io/csi/csi-mock-csi-mock-volumes-28^6c31aba3-6de1-11ed-85a6-da330f40b0b4],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-28^6c31aba3-6de1-11ed-85a6-da330f40b0b4,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-5218^509c30c1-6de1-11ed-8ef9-66b4d7ccc072,DevicePath:,},},Config:nil,},} Nov 26 23:25:07.741: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-dr7t Nov 26 23:25:07.787: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-dr7t Nov 26 23:25:07.954: INFO: simpletest.rc-c9cjf started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:07.954: INFO: Container nginx ready: true, restart count 0 Nov 26 23:25:07.954: INFO: simpletest.rc-4xnc8 started at <nil> (0+0 container statuses recorded) Nov 26 23:25:07.954: INFO: csi-mockplugin-resizer-0 started at 2022-11-26 23:13:58 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:07.954: INFO: Container csi-resizer ready: true, restart count 5 Nov 26 23:25:07.954: INFO: inline-volume-tester-mndlt started at 2022-11-26 23:14:00 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:07.954: INFO: Container csi-volume-tester ready: false, restart count 0 Nov 26 23:25:07.954: INFO: csi-hostpathplugin-0 started at 2022-11-26 23:20:01 +0000 UTC (0+7 container statuses recorded) Nov 26 23:25:07.954: INFO: Container csi-attacher ready: true, restart count 5 Nov 26 23:25:07.954: INFO: Container csi-provisioner ready: true, restart count 5 Nov 26 23:25:07.954: INFO: Container csi-resizer ready: true, restart count 5 Nov 26 23:25:07.954: INFO: Container csi-snapshotter ready: true, restart count 5 Nov 26 23:25:07.954: INFO: Container hostpath ready: true, restart count 5 Nov 26 23:25:07.954: INFO: Container liveness-probe ready: true, restart count 5 Nov 26 23:25:07.954: INFO: Container node-driver-registrar ready: true, restart count 5 Nov 26 23:25:07.954: INFO: simpletest.rc-r48g7 started at <nil> (0+0 container statuses recorded) Nov 26 23:25:07.954: INFO: simpletest.rc-ns9qh started at 2022-11-26 23:24:10 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:07.954: INFO: Container nginx ready: true, restart count 0 Nov 26 23:25:07.954: INFO: coredns-6d97d5ddb-tfljm started at 2022-11-26 23:11:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:07.954: INFO: Container coredns ready: false, restart count 6 Nov 26 23:25:07.954: INFO: konnectivity-agent-bdgkf started at 2022-11-26 23:11:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:07.954: INFO: Container konnectivity-agent ready: false, restart count 5 Nov 26 23:25:07.954: INFO: pvc-volume-tester-kdxsc started at <nil> (0+0 container statuses recorded) Nov 26 23:25:07.954: INFO: externalip-test-glqb4 started at 2022-11-26 23:18:39 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:07.954: INFO: Container externalip-test ready: true, restart count 3 Nov 26 23:25:07.954: INFO: simpletest.rc-74l76 started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:07.954: INFO: Container nginx ready: true, restart count 1 Nov 26 23:25:07.954: INFO: csi-hostpathplugin-0 started at 2022-11-26 23:15:49 +0000 UTC (0+7 container statuses recorded) Nov 26 23:25:07.954: INFO: Container csi-attacher ready: true, restart count 4 Nov 26 23:25:07.954: INFO: Container csi-provisioner ready: true, restart count 4 Nov 26 23:25:07.954: INFO: Container csi-resizer ready: true, restart count 4 Nov 26 23:25:07.954: INFO: Container csi-snapshotter ready: true, restart count 4 Nov 26 23:25:07.954: INFO: Container hostpath ready: true, restart count 4 Nov 26 23:25:07.954: INFO: Container liveness-probe ready: true, restart count 4 Nov 26 23:25:07.954: INFO: Container node-driver-registrar ready: true, restart count 4 Nov 26 23:25:07.954: INFO: simpletest.rc-k5zrz started at <nil> (0+0 container statuses recorded) Nov 26 23:25:07.954: INFO: simpletest.rc-c5h8h started at <nil> (0+0 container statuses recorded) Nov 26 23:25:07.954: INFO: simpletest.rc-t7xqp started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:07.954: INFO: Container nginx ready: true, restart count 0 Nov 26 23:25:07.954: INFO: simpletest.rc-k6n62 started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:07.954: INFO: Container nginx ready: true, restart count 1 Nov 26 23:25:07.954: INFO: simpletest.rc-pwcsr started at 2022-11-26 23:24:10 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:07.954: INFO: Container nginx ready: false, restart count 0 Nov 26 23:25:07.954: INFO: kube-proxy-bootstrap-e2e-minion-group-dr7t started at 2022-11-26 23:10:49 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:07.954: INFO: Container kube-proxy ready: false, restart count 6 Nov 26 23:25:07.954: INFO: simpletest.rc-gqz24 started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:07.954: INFO: Container nginx ready: true, restart count 1 Nov 26 23:25:07.954: INFO: simpletest.rc-v9jc5 started at <nil> (0+0 container statuses recorded) Nov 26 23:25:07.954: INFO: e2e-2gjr9-9fzdt started at 2022-11-26 23:13:41 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:07.954: INFO: Container c ready: false, restart count 0 Nov 26 23:25:07.954: INFO: client-envvars-94091b6a-29ad-4b9a-9ad7-528612eb4de4 started at 2022-11-26 23:13:52 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:07.954: INFO: Container env3cont ready: false, restart count 0 Nov 26 23:25:07.954: INFO: e2e-2gjr9-mw95z started at 2022-11-26 23:13:46 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:07.954: INFO: Container c ready: false, restart count 0 Nov 26 23:25:07.954: INFO: simpletest.rc-5lcbg started at <nil> (0+0 container statuses recorded) Nov 26 23:25:07.954: INFO: netserver-0 started at 2022-11-26 23:13:40 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:07.954: INFO: Container webserver ready: false, restart count 6 Nov 26 23:25:07.954: INFO: simpletest.rc-z4cfk started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:07.954: INFO: Container nginx ready: true, restart count 1 Nov 26 23:25:07.954: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 23:13:58 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:07.954: INFO: Container csi-attacher ready: false, restart count 4 Nov 26 23:25:07.954: INFO: test-rs-zwkkr started at 2022-11-26 23:19:54 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:07.954: INFO: Container httpd ready: false, restart count 4 Nov 26 23:25:07.954: INFO: csi-mockplugin-0 started at 2022-11-26 23:23:56 +0000 UTC (0+3 container statuses recorded) Nov 26 23:25:07.954: INFO: Container csi-provisioner ready: true, restart count 0 Nov 26 23:25:07.954: INFO: Container driver-registrar ready: true, restart count 0 Nov 26 23:25:07.954: INFO: Container mock ready: true, restart count 0 Nov 26 23:25:07.954: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 23:23:56 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:07.954: INFO: Container csi-attacher ready: true, restart count 0 Nov 26 23:25:07.954: INFO: simpletest.rc-grs4f started at <nil> (0+0 container statuses recorded) Nov 26 23:25:07.954: INFO: simpletest.rc-d4qlz started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:07.954: INFO: Container nginx ready: true, restart count 0 Nov 26 23:25:07.954: INFO: kube-dns-autoscaler-5f6455f985-2twl5 started at 2022-11-26 23:11:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:07.954: INFO: Container autoscaler ready: false, restart count 6 Nov 26 23:25:07.954: INFO: hostexec-bootstrap-e2e-minion-group-dr7t-ssljm started at 2022-11-26 23:13:55 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:07.954: INFO: Container agnhost-container ready: true, restart count 3 Nov 26 23:25:07.954: INFO: simpletest.rc-fvdxd started at <nil> (0+0 container statuses recorded) Nov 26 23:25:07.954: INFO: simpletest.rc-hrx7l started at 2022-11-26 23:24:11 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:07.954: INFO: Container nginx ready: true, restart count 1 Nov 26 23:25:07.954: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 23:15:48 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:07.954: INFO: Container csi-attacher ready: true, restart count 3 Nov 26 23:25:07.954: INFO: inline-volume-tester-65qqv started at 2022-11-26 23:23:51 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:07.954: INFO: Container csi-volume-tester ready: true, restart count 0 Nov 26 23:25:07.954: INFO: test-rs-64cc8 started at 2022-11-26 23:24:02 +0000 UTC (0+2 container statuses recorded) Nov 26 23:25:07.954: INFO: Container httpd ready: true, restart count 0 Nov 26 23:25:07.954: INFO: Container test-rs ready: true, restart count 0 Nov 26 23:25:07.954: INFO: external-provisioner-wrpbw started at 2022-11-26 23:14:05 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:07.954: INFO: Container nfs-provisioner ready: true, restart count 2 Nov 26 23:25:07.954: INFO: pod1 started at 2022-11-26 23:18:15 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:07.954: INFO: Container agnhost-container ready: true, restart count 0 Nov 26 23:25:07.954: INFO: simpletest.rc-cvkmj started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:07.954: INFO: Container nginx ready: true, restart count 0 Nov 26 23:25:07.954: INFO: csi-mockplugin-0 started at 2022-11-26 23:16:14 +0000 UTC (0+4 container statuses recorded) Nov 26 23:25:07.954: INFO: Container busybox ready: false, restart count 4 Nov 26 23:25:07.954: INFO: Container csi-provisioner ready: false, restart count 5 Nov 26 23:25:07.954: INFO: Container driver-registrar ready: false, restart count 4 Nov 26 23:25:07.954: INFO: Container mock ready: false, restart count 4 Nov 26 23:25:07.954: INFO: hostexec-bootstrap-e2e-minion-group-dr7t-4qhfn started at 2022-11-26 23:24:03 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:07.954: INFO: Container agnhost-container ready: false, restart count 0 Nov 26 23:25:07.954: INFO: ss2-2 started at 2022-11-26 23:24:05 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:07.954: INFO: Container webserver ready: true, restart count 0 Nov 26 23:25:07.954: INFO: simpletest.rc-m6r9w started at <nil> (0+0 container statuses recorded) Nov 26 23:25:07.954: INFO: simpletest.rc-vj7jd started at <nil> (0+0 container statuses recorded) Nov 26 23:25:07.954: INFO: simpletest.rc-7c2t4 started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:07.954: INFO: Container nginx ready: true, restart count 0 Nov 26 23:25:07.954: INFO: simpletest.rc-mvsml started at 2022-11-26 23:24:10 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:07.954: INFO: Container nginx ready: true, restart count 1 Nov 26 23:25:07.954: INFO: external-provisioner-9dc9l started at 2022-11-26 23:13:43 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:07.954: INFO: Container nfs-provisioner ready: true, restart count 3 Nov 26 23:25:07.954: INFO: simpletest.rc-fwmr7 started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:07.954: INFO: Container nginx ready: true, restart count 0 Nov 26 23:25:07.954: INFO: simpletest.rc-bbtzn started at <nil> (0+0 container statuses recorded) Nov 26 23:25:07.954: INFO: simpletest.rc-kkv97 started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:07.954: INFO: Container nginx ready: true, restart count 0 Nov 26 23:25:07.954: INFO: external-provisioner-fwvdj started at 2022-11-26 23:13:53 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:07.954: INFO: Container nfs-provisioner ready: true, restart count 5 Nov 26 23:25:07.954: INFO: csi-mockplugin-0 started at 2022-11-26 23:15:48 +0000 UTC (0+3 container statuses recorded) Nov 26 23:25:07.954: INFO: Container csi-provisioner ready: true, restart count 1 Nov 26 23:25:07.954: INFO: Container driver-registrar ready: true, restart count 1 Nov 26 23:25:07.954: INFO: Container mock ready: true, restart count 1 Nov 26 23:25:07.954: INFO: netserver-0 started at 2022-11-26 23:19:06 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:07.954: INFO: Container webserver ready: false, restart count 5 Nov 26 23:25:07.954: INFO: simpletest.rc-v5cwl started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:07.954: INFO: Container nginx ready: true, restart count 1 Nov 26 23:25:07.954: INFO: simpletest.rc-5xfcl started at <nil> (0+0 container statuses recorded) Nov 26 23:25:07.954: INFO: hostpath-symlink-prep-provisioning-2423 started at 2022-11-26 23:14:01 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:07.954: INFO: Container init-volume-provisioning-2423 ready: false, restart count 0 Nov 26 23:25:07.954: INFO: netserver-0 started at 2022-11-26 23:18:54 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:07.954: INFO: Container webserver ready: true, restart count 1 Nov 26 23:25:07.954: INFO: simpletest.rc-lmsws started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:07.954: INFO: Container nginx ready: false, restart count 0 Nov 26 23:25:07.954: INFO: csi-hostpathplugin-0 started at 2022-11-26 23:13:45 +0000 UTC (0+7 container statuses recorded) Nov 26 23:25:07.954: INFO: Container csi-attacher ready: true, restart count 5 Nov 26 23:25:07.954: INFO: Container csi-provisioner ready: true, restart count 5 Nov 26 23:25:07.954: INFO: Container csi-resizer ready: true, restart count 5 Nov 26 23:25:07.954: INFO: Container csi-snapshotter ready: true, restart count 5 Nov 26 23:25:07.954: INFO: Container hostpath ready: true, restart count 5 Nov 26 23:25:07.954: INFO: Container liveness-probe ready: true, restart count 5 Nov 26 23:25:07.954: INFO: Container node-driver-registrar ready: true, restart count 5 Nov 26 23:25:07.954: INFO: csi-hostpathplugin-0 started at 2022-11-26 23:15:48 +0000 UTC (0+7 container statuses recorded) Nov 26 23:25:07.954: INFO: Container csi-attacher ready: true, restart count 2 Nov 26 23:25:07.954: INFO: Container csi-provisioner ready: true, restart count 2 Nov 26 23:25:07.954: INFO: Container csi-resizer ready: true, restart count 2 Nov 26 23:25:07.954: INFO: Container csi-snapshotter ready: true, restart count 2 Nov 26 23:25:07.954: INFO: Container hostpath ready: true, restart count 2 Nov 26 23:25:07.954: INFO: Container liveness-probe ready: true, restart count 2 Nov 26 23:25:07.954: INFO: Container node-driver-registrar ready: true, restart count 2 Nov 26 23:25:07.954: INFO: csi-mockplugin-0 started at 2022-11-26 23:13:58 +0000 UTC (0+3 container statuses recorded) Nov 26 23:25:07.954: INFO: Container csi-provisioner ready: true, restart count 5 Nov 26 23:25:07.954: INFO: Container driver-registrar ready: true, restart count 5 Nov 26 23:25:07.954: INFO: Container mock ready: true, restart count 5 Nov 26 23:25:07.954: INFO: simpletest.rc-vmjnr started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:07.954: INFO: Container nginx ready: false, restart count 0 Nov 26 23:25:07.954: INFO: simpletest.rc-jz7rl started at <nil> (0+0 container statuses recorded) Nov 26 23:25:07.954: INFO: simpletest.rc-fgdjw started at 2022-11-26 23:24:11 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:07.954: INFO: Container nginx ready: true, restart count 1 Nov 26 23:25:07.954: INFO: simpletest.rc-vqn8l started at <nil> (0+0 container statuses recorded) Nov 26 23:25:07.954: INFO: metadata-proxy-v0.1-5cxbq started at 2022-11-26 23:10:50 +0000 UTC (0+2 container statuses recorded) Nov 26 23:25:07.954: INFO: Container metadata-proxy ready: true, restart count 0 Nov 26 23:25:07.954: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Nov 26 23:25:07.954: INFO: pod-hostip-ca4d6a7e-d19f-41f7-a0c0-3ba1daa0f976 started at 2022-11-26 23:23:56 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:07.954: INFO: Container test ready: true, restart count 0 Nov 26 23:25:08.651: INFO: Latency metrics for node bootstrap-e2e-minion-group-dr7t Nov 26 23:25:08.651: INFO: Logging node info for node bootstrap-e2e-minion-group-l8ht Nov 26 23:25:08.693: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-l8ht 3e5210d0-ba6b-4f56-896c-40aaae5093d0 8068 0 2022-11-26 23:10:52 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-l8ht kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-l8ht topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-3757":"bootstrap-e2e-minion-group-l8ht","csi-hostpath-provisioning-3513":"bootstrap-e2e-minion-group-l8ht","csi-mock-csi-mock-volumes-1468":"bootstrap-e2e-minion-group-l8ht","csi-mock-csi-mock-volumes-355":"bootstrap-e2e-minion-group-l8ht"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 23:10:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 23:10:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {node-problem-detector Update v1 2022-11-26 23:22:01 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-11-26 23:23:41 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2022-11-26 23:25:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-6-1-5-ctl-skew/us-west1-b/bootstrap-e2e-minion-group-l8ht,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 23:22:01 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 23:22:01 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 23:22:01 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 23:22:01 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 23:22:01 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 23:22:01 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 23:22:01 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 23:11:08 +0000 UTC,LastTransitionTime:2022-11-26 23:11:08 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 23:24:58 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 23:24:58 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 23:24:58 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 23:24:58 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:34.168.47.71,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-l8ht.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-l8ht.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:89b0fd3f78d194fccba6eb2ce27680f6,SystemUUID:89b0fd3f-78d1-94fc-cba6-eb2ce27680f6,BootID:ec1fa0a7-81b7-48ec-8da0-cc1b45a14fc8,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-55^28d8d761-6de0-11ed-8c44-7ec558aa6670],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-55^28d8d761-6de0-11ed-8c44-7ec558aa6670,DevicePath:,},},Config:nil,},} Nov 26 23:25:08.693: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-l8ht Nov 26 23:25:08.750: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-l8ht Nov 26 23:25:08.842: INFO: csi-hostpathplugin-0 started at 2022-11-26 23:14:04 +0000 UTC (0+7 container statuses recorded) Nov 26 23:25:08.842: INFO: Container csi-attacher ready: false, restart count 6 Nov 26 23:25:08.842: INFO: Container csi-provisioner ready: false, restart count 6 Nov 26 23:25:08.842: INFO: Container csi-resizer ready: false, restart count 6 Nov 26 23:25:08.842: INFO: Container csi-snapshotter ready: false, restart count 6 Nov 26 23:25:08.842: INFO: Container hostpath ready: false, restart count 6 Nov 26 23:25:08.842: INFO: Container liveness-probe ready: false, restart count 6 Nov 26 23:25:08.842: INFO: Container node-driver-registrar ready: false, restart count 5 Nov 26 23:25:08.842: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 23:15:47 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:08.842: INFO: Container csi-attacher ready: true, restart count 4 Nov 26 23:25:08.842: INFO: liveness-d534e81f-ba57-43f0-a7ed-ae77c4a39ae7 started at 2022-11-26 23:23:58 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:08.842: INFO: Container agnhost-container ready: true, restart count 0 Nov 26 23:25:08.842: INFO: simpletest.rc-d8tnq started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:08.842: INFO: Container nginx ready: true, restart count 0 Nov 26 23:25:08.842: INFO: simpletest.rc-tmr7r started at <nil> (0+0 container statuses recorded) Nov 26 23:25:08.842: INFO: pod-failure-ignore-wjkqd started at 2022-11-26 23:23:42 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:08.842: INFO: Container c ready: false, restart count 0 Nov 26 23:25:08.842: INFO: simpletest.rc-t7wx8 started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:08.842: INFO: Container nginx ready: true, restart count 0 Nov 26 23:25:08.842: INFO: simpletest.rc-p9bpg started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:08.842: INFO: Container nginx ready: false, restart count 0 Nov 26 23:25:08.842: INFO: csi-mockplugin-attacher-0 started at <nil> (0+0 container statuses recorded) Nov 26 23:25:08.842: INFO: kube-proxy-bootstrap-e2e-minion-group-l8ht started at 2022-11-26 23:10:52 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:08.842: INFO: Container kube-proxy ready: false, restart count 6 Nov 26 23:25:08.842: INFO: netserver-1 started at 2022-11-26 23:19:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:08.842: INFO: Container webserver ready: true, restart count 2 Nov 26 23:25:08.842: INFO: simpletest.rc-8kjlk started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:08.842: INFO: Container nginx ready: false, restart count 0 Nov 26 23:25:08.842: INFO: simpletest.rc-wzrjg started at <nil> (0+0 container statuses recorded) Nov 26 23:25:08.842: INFO: metadata-proxy-v0.1-n8dk7 started at 2022-11-26 23:10:53 +0000 UTC (0+2 container statuses recorded) Nov 26 23:25:08.842: INFO: Container metadata-proxy ready: true, restart count 0 Nov 26 23:25:08.842: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Nov 26 23:25:08.842: INFO: simpletest.rc-zr9cg started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:08.842: INFO: Container nginx ready: true, restart count 0 Nov 26 23:25:08.842: INFO: simpletest.rc-2j7wd started at <nil> (0+0 container statuses recorded) Nov 26 23:25:08.842: INFO: simpletest.rc-s4mxg started at <nil> (0+0 container statuses recorded) Nov 26 23:25:08.842: INFO: csi-mockplugin-0 started at <nil> (0+0 container statuses recorded) Nov 26 23:25:08.842: INFO: e2e-2gjr9-n7ngv started at 2022-11-26 23:13:53 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:08.842: INFO: Container c ready: false, restart count 0 Nov 26 23:25:08.842: INFO: csi-mockplugin-0 started at 2022-11-26 23:15:47 +0000 UTC (0+3 container statuses recorded) Nov 26 23:25:08.842: INFO: Container csi-provisioner ready: false, restart count 4 Nov 26 23:25:08.842: INFO: Container driver-registrar ready: true, restart count 5 Nov 26 23:25:08.842: INFO: Container mock ready: false, restart count 4 Nov 26 23:25:08.842: INFO: csi-hostpathplugin-0 started at 2022-11-26 23:19:22 +0000 UTC (0+7 container statuses recorded) Nov 26 23:25:08.842: INFO: Container csi-attacher ready: true, restart count 1 Nov 26 23:25:08.842: INFO: Container csi-provisioner ready: true, restart count 1 Nov 26 23:25:08.842: INFO: Container csi-resizer ready: true, restart count 1 Nov 26 23:25:08.842: INFO: Container csi-snapshotter ready: true, restart count 1 Nov 26 23:25:08.842: INFO: Container hostpath ready: true, restart count 1 Nov 26 23:25:08.842: INFO: Container liveness-probe ready: true, restart count 1 Nov 26 23:25:08.842: INFO: Container node-driver-registrar ready: true, restart count 1 Nov 26 23:25:08.842: INFO: simpletest.rc-vfphz started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:08.842: INFO: Container nginx ready: false, restart count 1 Nov 26 23:25:08.842: INFO: simpletest.rc-dhxfz started at <nil> (0+0 container statuses recorded) Nov 26 23:25:08.842: INFO: simpletest.rc-9zsmr started at <nil> (0+0 container statuses recorded) Nov 26 23:25:08.842: INFO: csi-mockplugin-0 started at 2022-11-26 23:13:55 +0000 UTC (0+4 container statuses recorded) Nov 26 23:25:08.842: INFO: Container busybox ready: false, restart count 6 Nov 26 23:25:08.842: INFO: Container csi-provisioner ready: false, restart count 6 Nov 26 23:25:08.842: INFO: Container driver-registrar ready: false, restart count 6 Nov 26 23:25:08.842: INFO: Container mock ready: false, restart count 6 Nov 26 23:25:08.842: INFO: concurrent-27825084-6s8hd started at 2022-11-26 23:24:00 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:08.842: INFO: Container c ready: false, restart count 0 Nov 26 23:25:08.842: INFO: pod2 started at 2022-11-26 23:18:17 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:08.842: INFO: Container agnhost-container ready: true, restart count 3 Nov 26 23:25:08.842: INFO: csi-hostpathplugin-0 started at 2022-11-26 23:18:19 +0000 UTC (0+7 container statuses recorded) Nov 26 23:25:08.842: INFO: Container csi-attacher ready: true, restart count 3 Nov 26 23:25:08.842: INFO: Container csi-provisioner ready: true, restart count 3 Nov 26 23:25:08.842: INFO: Container csi-resizer ready: true, restart count 3 Nov 26 23:25:08.842: INFO: Container csi-snapshotter ready: true, restart count 3 Nov 26 23:25:08.842: INFO: Container hostpath ready: true, restart count 3 Nov 26 23:25:08.842: INFO: Container liveness-probe ready: true, restart count 3 Nov 26 23:25:08.842: INFO: Container node-driver-registrar ready: true, restart count 3 Nov 26 23:25:08.842: INFO: simpletest.rc-wrg78 started at <nil> (0+0 container statuses recorded) Nov 26 23:25:08.842: INFO: csi-hostpathplugin-0 started at 2022-11-26 23:13:43 +0000 UTC (0+7 container statuses recorded) Nov 26 23:25:08.842: INFO: Container csi-attacher ready: true, restart count 1 Nov 26 23:25:08.842: INFO: Container csi-provisioner ready: true, restart count 1 Nov 26 23:25:08.842: INFO: Container csi-resizer ready: true, restart count 1 Nov 26 23:25:08.842: INFO: Container csi-snapshotter ready: true, restart count 1 Nov 26 23:25:08.842: INFO: Container hostpath ready: true, restart count 1 Nov 26 23:25:08.842: INFO: Container liveness-probe ready: true, restart count 1 Nov 26 23:25:08.842: INFO: Container node-driver-registrar ready: true, restart count 1 Nov 26 23:25:08.842: INFO: external-provisioner-l4hjd started at 2022-11-26 23:18:15 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:08.842: INFO: Container nfs-provisioner ready: true, restart count 4 Nov 26 23:25:08.842: INFO: simpletest.rc-47jfp started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:08.842: INFO: Container nginx ready: true, restart count 1 Nov 26 23:25:08.842: INFO: simpletest.rc-768cr started at 2022-11-26 23:24:11 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:08.842: INFO: Container nginx ready: true, restart count 0 Nov 26 23:25:08.842: INFO: simpletest.rc-7n2qg started at <nil> (0+0 container statuses recorded) Nov 26 23:25:08.842: INFO: konnectivity-agent-rhvvx started at 2022-11-26 23:11:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:08.842: INFO: Container konnectivity-agent ready: false, restart count 5 Nov 26 23:25:08.842: INFO: pod-failure-ignore-fmb5h started at 2022-11-26 23:23:42 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:08.842: INFO: Container c ready: false, restart count 0 Nov 26 23:25:08.842: INFO: funny-ip-5ddhq started at 2022-11-26 23:23:45 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:08.842: INFO: Container funny-ip ready: true, restart count 0 Nov 26 23:25:08.842: INFO: pod-failure-ignore-gdn7f started at 2022-11-26 23:23:45 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:08.842: INFO: Container c ready: false, restart count 0 Nov 26 23:25:08.842: INFO: simpletest.rc-lslmb started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:08.842: INFO: Container nginx ready: true, restart count 0 Nov 26 23:25:08.842: INFO: test-cleanup-controller-w66lq started at 2022-11-26 23:14:02 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:08.842: INFO: Container httpd ready: true, restart count 3 Nov 26 23:25:08.842: INFO: simpletest.rc-vzb6t started at <nil> (0+0 container statuses recorded) Nov 26 23:25:08.842: INFO: simpletest.rc-7ppxt started at <nil> (0+0 container statuses recorded) Nov 26 23:25:08.842: INFO: simpletest.rc-rczdt started at <nil> (0+0 container statuses recorded) Nov 26 23:25:08.842: INFO: netserver-1 started at 2022-11-26 23:13:40 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:08.842: INFO: Container webserver ready: true, restart count 6 Nov 26 23:25:08.842: INFO: test-rs-rlcd5 started at 2022-11-26 23:19:54 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:08.842: INFO: Container httpd ready: true, restart count 0 Nov 26 23:25:08.842: INFO: pod-failure-ignore-ddmpv started at 2022-11-26 23:23:50 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:08.842: INFO: Container c ready: false, restart count 0 Nov 26 23:25:08.842: INFO: simpletest.rc-9sc82 started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:08.842: INFO: Container nginx ready: true, restart count 0 Nov 26 23:25:08.842: INFO: simpletest.rc-q8q28 started at 2022-11-26 23:24:10 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:08.842: INFO: Container nginx ready: true, restart count 0 Nov 26 23:25:08.842: INFO: simpletest.rc-2mfcn started at <nil> (0+0 container statuses recorded) Nov 26 23:25:08.842: INFO: simpletest.rc-88vj9 started at <nil> (0+0 container statuses recorded) Nov 26 23:25:08.842: INFO: hostexec-bootstrap-e2e-minion-group-l8ht-6ffqj started at 2022-11-26 23:14:05 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:08.842: INFO: Container agnhost-container ready: true, restart count 5 Nov 26 23:25:08.842: INFO: pod-failure-ignore-mt4mb started at 2022-11-26 23:23:45 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:08.842: INFO: Container c ready: false, restart count 0 Nov 26 23:25:08.842: INFO: execpodgr25x started at 2022-11-26 23:23:48 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:08.842: INFO: Container agnhost-container ready: true, restart count 0 Nov 26 23:25:08.842: INFO: replace-27825084-plcr4 started at 2022-11-26 23:24:00 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:08.842: INFO: Container c ready: true, restart count 0 Nov 26 23:25:08.842: INFO: inline-volume-tester-nqd44 started at 2022-11-26 23:18:28 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:08.842: INFO: Container csi-volume-tester ready: false, restart count 0 Nov 26 23:25:08.842: INFO: simpletest.rc-zrvv5 started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:08.842: INFO: Container nginx ready: false, restart count 0 Nov 26 23:25:08.842: INFO: simpletest.rc-j6nhq started at <nil> (0+0 container statuses recorded) Nov 26 23:25:08.842: INFO: coredns-6d97d5ddb-j25mc started at 2022-11-26 23:11:12 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:08.842: INFO: Container coredns ready: false, restart count 6 Nov 26 23:25:08.842: INFO: test-rs-jflmw started at 2022-11-26 23:24:02 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:08.842: INFO: Container httpd ready: true, restart count 2 Nov 26 23:25:08.842: INFO: ss2-1 started at 2022-11-26 23:24:02 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:08.842: INFO: Container webserver ready: true, restart count 3 Nov 26 23:25:08.842: INFO: simpletest.rc-hfg2l started at <nil> (0+0 container statuses recorded) Nov 26 23:25:08.842: INFO: simpletest.rc-t5r8v started at 2022-11-26 23:24:11 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:08.842: INFO: Container nginx ready: true, restart count 1 Nov 26 23:25:08.842: INFO: netserver-1 started at 2022-11-26 23:18:54 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:08.842: INFO: Container webserver ready: true, restart count 2 Nov 26 23:25:08.842: INFO: simpletest.rc-fdktq started at <nil> (0+0 container statuses recorded) Nov 26 23:25:08.842: INFO: pod-2c9ca969-f71c-470c-a591-eddc5680ebb6 started at 2022-11-26 23:15:47 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:08.842: INFO: Container write-pod ready: false, restart count 0 Nov 26 23:25:08.842: INFO: simpletest.rc-hvsd4 started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:08.842: INFO: Container nginx ready: true, restart count 1 Nov 26 23:25:08.842: INFO: simpletest.rc-95pbd started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:08.842: INFO: Container nginx ready: true, restart count 1 Nov 26 23:25:08.842: INFO: simpletest.rc-czsr7 started at <nil> (0+0 container statuses recorded) Nov 26 23:25:08.842: INFO: simpletest.rc-mvdr4 started at <nil> (0+0 container statuses recorded) Nov 26 23:25:09.499: INFO: Latency metrics for node bootstrap-e2e-minion-group-l8ht Nov 26 23:25:09.499: INFO: Logging node info for node bootstrap-e2e-minion-group-n9b1 Nov 26 23:25:09.547: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-n9b1 796907e0-52c8-4c84-815a-6442939836c4 8062 0 2022-11-26 23:10:52 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-n9b1 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-n9b1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-5727":"bootstrap-e2e-minion-group-n9b1","csi-hostpath-provisioning-254":"bootstrap-e2e-minion-group-n9b1","csi-mock-csi-mock-volumes-7584":"bootstrap-e2e-minion-group-n9b1","csi-mock-csi-mock-volumes-7940":"bootstrap-e2e-minion-group-n9b1"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 23:10:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 23:10:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {node-problem-detector Update v1 2022-11-26 23:22:02 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-11-26 23:24:03 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2022-11-26 23:25:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-6-1-5-ctl-skew/us-west1-b/bootstrap-e2e-minion-group-n9b1,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 23:22:02 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 23:22:02 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 23:22:02 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 23:22:02 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 23:22:02 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 23:22:02 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 23:22:02 +0000 UTC,LastTransitionTime:2022-11-26 23:10:56 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 23:11:08 +0000 UTC,LastTransitionTime:2022-11-26 23:11:08 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 23:25:02 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 23:25:02 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 23:25:02 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 23:25:02 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.145.73.48,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-n9b1.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-n9b1.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:47bcd2b143b08ae3cf2e280a7c6e673a,SystemUUID:47bcd2b1-43b0-8ae3-cf2e-280a7c6e673a,BootID:c567f407-918f-4298-a12f-a33a4e211fcf,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 registry.k8s.io/sig-storage/snapshot-controller:v6.1.0],SizeBytes:22620891,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-169^c8e3d50b-6de0-11ed-aed4-6a12d5ab5936 kubernetes.io/csi/csi-mock-csi-mock-volumes-7584^688f4ec1-6de1-11ed-8b45-9afa498cd345],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-169^c8e3d50b-6de0-11ed-aed4-6a12d5ab5936,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-7584^688f4ec1-6de1-11ed-8b45-9afa498cd345,DevicePath:,},},Config:nil,},} Nov 26 23:25:09.548: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-n9b1 Nov 26 23:25:09.592: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-n9b1 Nov 26 23:25:09.706: INFO: dns-test-37d137df-f1fb-46b2-81e9-153cb7845ef4 started at <nil> (0+0 container statuses recorded) Nov 26 23:25:09.706: INFO: nfs-injector started at 2022-11-26 23:18:28 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:09.706: INFO: Container nfs-injector ready: false, restart count 0 Nov 26 23:25:09.706: INFO: dns-test-c2505ebd-e6a3-455c-9a9f-58dbe21ea53c started at 2022-11-26 23:23:42 +0000 UTC (0+3 container statuses recorded) Nov 26 23:25:09.706: INFO: Container jessie-querier ready: true, restart count 0 Nov 26 23:25:09.706: INFO: Container querier ready: true, restart count 0 Nov 26 23:25:09.706: INFO: Container webserver ready: true, restart count 0 Nov 26 23:25:09.706: INFO: nfs-server started at 2022-11-26 23:18:21 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:09.706: INFO: Container nfs-server ready: true, restart count 2 Nov 26 23:25:09.706: INFO: hostexec-bootstrap-e2e-minion-group-n9b1-h77pq started at 2022-11-26 23:19:47 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:09.706: INFO: Container agnhost-container ready: true, restart count 2 Nov 26 23:25:09.706: INFO: hostpath-injector started at 2022-11-26 23:19:35 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:09.706: INFO: Container hostpath-injector ready: false, restart count 0 Nov 26 23:25:09.706: INFO: simpletest.rc-pkd4b started at <nil> (0+0 container statuses recorded) Nov 26 23:25:09.706: INFO: nfs-server started at 2022-11-26 23:13:40 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:09.706: INFO: Container nfs-server ready: false, restart count 4 Nov 26 23:25:09.706: INFO: netserver-2 started at 2022-11-26 23:13:41 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:09.706: INFO: Container webserver ready: true, restart count 2 Nov 26 23:25:09.706: INFO: hostpath-symlink-prep-provisioning-2139 started at 2022-11-26 23:13:54 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:09.706: INFO: Container init-volume-provisioning-2139 ready: false, restart count 0 Nov 26 23:25:09.706: INFO: inline-volume-tester-kccb4 started at 2022-11-26 23:19:31 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:09.706: INFO: Container csi-volume-tester ready: false, restart count 0 Nov 26 23:25:09.706: INFO: metrics-server-v0.5.2-867b8754b9-6gwjw started at 2022-11-26 23:11:21 +0000 UTC (0+2 container statuses recorded) Nov 26 23:25:09.706: INFO: Container metrics-server ready: false, restart count 6 Nov 26 23:25:09.706: INFO: Container metrics-server-nanny ready: false, restart count 6 Nov 26 23:25:09.706: INFO: netserver-2 started at 2022-11-26 23:18:54 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:09.706: INFO: Container webserver ready: true, restart count 1 Nov 26 23:25:09.706: INFO: simpletest.rc-2hh6h started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:09.706: INFO: Container nginx ready: true, restart count 0 Nov 26 23:25:09.706: INFO: alpine-nnp-nil-b4cd4bc5-9952-4e9b-8054-f9880757fdd1 started at <nil> (0+0 container statuses recorded) Nov 26 23:25:09.706: INFO: simpletest.rc-c4vdk started at <nil> (0+0 container statuses recorded) Nov 26 23:25:09.706: INFO: simpletest.rc-q96cd started at <nil> (0+0 container statuses recorded) Nov 26 23:25:09.706: INFO: simpletest.rc-qwqsv started at <nil> (0+0 container statuses recorded) Nov 26 23:25:09.706: INFO: annotationupdate34c6042a-c78f-4b49-904c-032a9afaf544 started at 2022-11-26 23:23:42 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:09.706: INFO: Container client-container ready: true, restart count 0 Nov 26 23:25:09.706: INFO: netserver-2 started at 2022-11-26 23:19:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:09.706: INFO: Container webserver ready: true, restart count 5 Nov 26 23:25:09.706: INFO: csi-hostpathplugin-0 started at 2022-11-26 23:19:31 +0000 UTC (0+7 container statuses recorded) Nov 26 23:25:09.706: INFO: Container csi-attacher ready: false, restart count 5 Nov 26 23:25:09.706: INFO: Container csi-provisioner ready: false, restart count 5 Nov 26 23:25:09.706: INFO: Container csi-resizer ready: false, restart count 5 Nov 26 23:25:09.706: INFO: Container csi-snapshotter ready: false, restart count 5 Nov 26 23:25:09.706: INFO: Container hostpath ready: false, restart count 5 Nov 26 23:25:09.706: INFO: Container liveness-probe ready: false, restart count 5 Nov 26 23:25:09.706: INFO: Container node-driver-registrar ready: false, restart count 5 Nov 26 23:25:09.706: INFO: simpletest.rc-q84md started at <nil> (0+0 container statuses recorded) Nov 26 23:25:09.706: INFO: hostexec-bootstrap-e2e-minion-group-n9b1-zsjf9 started at <nil> (0+0 container statuses recorded) Nov 26 23:25:09.706: INFO: simpletest.rc-2l65q started at <nil> (0+0 container statuses recorded) Nov 26 23:25:09.706: INFO: simpletest.rc-hzvfz started at <nil> (0+0 container statuses recorded) Nov 26 23:25:09.706: INFO: simpletest.rc-5cj45 started at <nil> (0+0 container statuses recorded) Nov 26 23:25:09.706: INFO: kube-proxy-bootstrap-e2e-minion-group-n9b1 started at 2022-11-26 23:10:52 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:09.706: INFO: Container kube-proxy ready: false, restart count 6 Nov 26 23:25:09.706: INFO: metadata-proxy-v0.1-h4wpl started at 2022-11-26 23:10:53 +0000 UTC (0+2 container statuses recorded) Nov 26 23:25:09.706: INFO: Container metadata-proxy ready: true, restart count 0 Nov 26 23:25:09.706: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Nov 26 23:25:09.706: INFO: volume-snapshot-controller-0 started at 2022-11-26 23:11:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:09.706: INFO: Container volume-snapshot-controller ready: false, restart count 4 Nov 26 23:25:09.706: INFO: csi-mockplugin-0 started at 2022-11-26 23:18:51 +0000 UTC (0+3 container statuses recorded) Nov 26 23:25:09.706: INFO: Container csi-provisioner ready: false, restart count 4 Nov 26 23:25:09.706: INFO: Container driver-registrar ready: false, restart count 4 Nov 26 23:25:09.706: INFO: Container mock ready: false, restart count 4 Nov 26 23:25:09.706: INFO: busybox-b8179d78-1934-400f-a7bf-f26dd814904c started at 2022-11-26 23:23:41 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:09.706: INFO: Container busybox ready: true, restart count 0 Nov 26 23:25:09.706: INFO: simpletest.rc-dvg8l started at <nil> (0+0 container statuses recorded) Nov 26 23:25:09.706: INFO: concurrent-27825080-kb7bb started at 2022-11-26 23:20:00 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:09.706: INFO: Container c ready: false, restart count 0 Nov 26 23:25:09.706: INFO: simpletest.rc-7n2vx started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:09.706: INFO: Container nginx ready: true, restart count 0 Nov 26 23:25:09.706: INFO: simpletest.rc-mpjvz started at <nil> (0+0 container statuses recorded) Nov 26 23:25:09.706: INFO: l7-default-backend-8549d69d99-zgjzh started at 2022-11-26 23:11:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:09.706: INFO: Container default-http-backend ready: true, restart count 0 Nov 26 23:25:09.706: INFO: server-envvars-6222e6ac-d567-472d-bd00-c996ebe3395c started at 2022-11-26 23:13:40 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:09.706: INFO: Container srv ready: false, restart count 4 Nov 26 23:25:09.706: INFO: pod-secrets-a152d9c1-cdeb-488b-9c0c-b830477f5f6c started at 2022-11-26 23:19:54 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:09.706: INFO: Container secret-test ready: false, restart count 1 Nov 26 23:25:09.706: INFO: execpods9dgn started at 2022-11-26 23:18:45 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:09.706: INFO: Container agnhost-container ready: true, restart count 2 Nov 26 23:25:09.706: INFO: simpletest.rc-hmgxt started at <nil> (0+0 container statuses recorded) Nov 26 23:25:09.706: INFO: e2e-2gjr9-l5xsj started at 2022-11-26 23:13:41 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:09.706: INFO: Container c ready: false, restart count 0 Nov 26 23:25:09.706: INFO: simpletest.rc-sf5jw started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:09.706: INFO: Container nginx ready: true, restart count 0 Nov 26 23:25:09.706: INFO: simpletest.rc-xt677 started at <nil> (0+0 container statuses recorded) Nov 26 23:25:09.706: INFO: simpletest.rc-vpt65 started at <nil> (0+0 container statuses recorded) Nov 26 23:25:09.706: INFO: pvc-volume-tester-h6ptm started at <nil> (0+0 container statuses recorded) Nov 26 23:25:09.706: INFO: simpletest.rc-ff8cc started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:09.706: INFO: Container nginx ready: true, restart count 0 Nov 26 23:25:09.706: INFO: pod-0b414c7b-dcc9-4e00-9536-9db8ccc1a7b7 started at 2022-11-26 23:19:47 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:09.706: INFO: Container test-container ready: false, restart count 0 Nov 26 23:25:09.706: INFO: sample-webhook-deployment-865554f4d9-4zmb9 started at 2022-11-26 23:23:42 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:09.706: INFO: Container sample-webhook ready: false, restart count 1 Nov 26 23:25:09.706: INFO: pod-projected-configmaps-334f9945-2444-46e4-b837-44369e43dccb started at 2022-11-26 23:19:59 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:09.706: INFO: Container agnhost-container ready: false, restart count 0 Nov 26 23:25:09.706: INFO: test-rs-ljz55 started at 2022-11-26 23:19:54 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:09.706: INFO: Container httpd ready: true, restart count 2 Nov 26 23:25:09.706: INFO: externalip-test-wfc9z started at 2022-11-26 23:18:39 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:09.706: INFO: Container externalip-test ready: true, restart count 0 Nov 26 23:25:09.706: INFO: csi-mockplugin-0 started at 2022-11-26 23:13:42 +0000 UTC (0+3 container statuses recorded) Nov 26 23:25:09.706: INFO: Container csi-provisioner ready: false, restart count 5 Nov 26 23:25:09.706: INFO: Container driver-registrar ready: false, restart count 5 Nov 26 23:25:09.706: INFO: Container mock ready: false, restart count 5 Nov 26 23:25:09.706: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 23:13:43 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:09.706: INFO: Container csi-attacher ready: true, restart count 3 Nov 26 23:25:09.706: INFO: host-test-container-pod started at 2022-11-26 23:19:29 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:09.706: INFO: Container agnhost-container ready: true, restart count 1 Nov 26 23:25:09.706: INFO: simpletest.rc-k95tx started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:09.706: INFO: Container nginx ready: true, restart count 0 Nov 26 23:25:09.706: INFO: simpletest.rc-cq84x started at <nil> (0+0 container statuses recorded) Nov 26 23:25:09.706: INFO: simpletest.rc-vzc27 started at <nil> (0+0 container statuses recorded) Nov 26 23:25:09.706: INFO: simpletest.rc-pjws9 started at <nil> (0+0 container statuses recorded) Nov 26 23:25:09.706: INFO: pod-secrets-e205404c-d02a-48b5-b795-ba659d81ee5b started at <nil> (0+0 container statuses recorded) Nov 26 23:25:09.706: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 23:23:43 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:09.706: INFO: Container csi-attacher ready: true, restart count 0 Nov 26 23:25:09.706: INFO: simpletest.rc-kdbtf started at <nil> (0+0 container statuses recorded) Nov 26 23:25:09.706: INFO: simpletest.rc-vmg49 started at <nil> (0+0 container statuses recorded) Nov 26 23:25:09.706: INFO: simpletest.rc-xdwbr started at <nil> (0+0 container statuses recorded) Nov 26 23:25:09.706: INFO: pfpod started at <nil> (0+0 container statuses recorded) Nov 26 23:25:09.706: INFO: csi-mockplugin-0 started at 2022-11-26 23:13:42 +0000 UTC (0+3 container statuses recorded) Nov 26 23:25:09.706: INFO: Container csi-provisioner ready: true, restart count 0 Nov 26 23:25:09.706: INFO: Container driver-registrar ready: true, restart count 0 Nov 26 23:25:09.706: INFO: Container mock ready: true, restart count 0 Nov 26 23:25:09.706: INFO: emptydir-injector started at 2022-11-26 23:23:42 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:09.706: INFO: Container emptydir-injector ready: false, restart count 1 Nov 26 23:25:09.706: INFO: execpoddl5wp started at 2022-11-26 23:18:24 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:09.706: INFO: Container agnhost-container ready: true, restart count 2 Nov 26 23:25:09.706: INFO: simpletest.rc-mr42d started at <nil> (0+0 container statuses recorded) Nov 26 23:25:09.706: INFO: simpletest.rc-mmvjs started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:09.706: INFO: Container nginx ready: true, restart count 0 Nov 26 23:25:09.706: INFO: simpletest.rc-kcjjc started at <nil> (0+0 container statuses recorded) Nov 26 23:25:09.706: INFO: hostexec-bootstrap-e2e-minion-group-n9b1-xzltr started at 2022-11-26 23:13:55 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:09.706: INFO: Container agnhost-container ready: true, restart count 5 Nov 26 23:25:09.706: INFO: simpletest.rc-bmbvf started at <nil> (0+0 container statuses recorded) Nov 26 23:25:09.706: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 23:18:51 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:09.706: INFO: Container csi-attacher ready: true, restart count 3 Nov 26 23:25:09.706: INFO: simpletest.rc-4n9fc started at <nil> (0+0 container statuses recorded) Nov 26 23:25:09.706: INFO: simpletest.rc-zwjbb started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:09.706: INFO: Container nginx ready: true, restart count 0 Nov 26 23:25:09.706: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 23:13:43 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:09.706: INFO: Container csi-attacher ready: false, restart count 3 Nov 26 23:25:09.706: INFO: csi-hostpathplugin-0 started at 2022-11-26 23:19:27 +0000 UTC (0+7 container statuses recorded) Nov 26 23:25:09.706: INFO: Container csi-attacher ready: false, restart count 5 Nov 26 23:25:09.706: INFO: Container csi-provisioner ready: false, restart count 5 Nov 26 23:25:09.706: INFO: Container csi-resizer ready: false, restart count 5 Nov 26 23:25:09.706: INFO: Container csi-snapshotter ready: false, restart count 5 Nov 26 23:25:09.706: INFO: Container hostpath ready: false, restart count 5 Nov 26 23:25:09.706: INFO: Container liveness-probe ready: false, restart count 5 Nov 26 23:25:09.706: INFO: Container node-driver-registrar ready: false, restart count 5 Nov 26 23:25:09.706: INFO: test-container-pod started at 2022-11-26 23:19:29 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:09.706: INFO: Container webserver ready: true, restart count 4 Nov 26 23:25:09.706: INFO: csi-mockplugin-0 started at 2022-11-26 23:23:43 +0000 UTC (0+3 container statuses recorded) Nov 26 23:25:09.706: INFO: Container csi-provisioner ready: true, restart count 0 Nov 26 23:25:09.706: INFO: Container driver-registrar ready: true, restart count 0 Nov 26 23:25:09.706: INFO: Container mock ready: true, restart count 0 Nov 26 23:25:09.706: INFO: agnhost started at 2022-11-26 23:13:56 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:09.706: INFO: Container agnhost ready: false, restart count 0 Nov 26 23:25:09.706: INFO: test-rs-znh42 started at 2022-11-26 23:23:43 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:09.706: INFO: Container httpd ready: true, restart count 1 Nov 26 23:25:09.706: INFO: simpletest.rc-z68xn started at 2022-11-26 23:24:10 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:09.706: INFO: Container nginx ready: false, restart count 0 Nov 26 23:25:09.706: INFO: sample-webhook-deployment-865554f4d9-jfnjx started at 2022-11-26 23:23:43 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:09.706: INFO: Container sample-webhook ready: true, restart count 3 Nov 26 23:25:09.706: INFO: csi-hostpathplugin-0 started at <nil> (0+0 container statuses recorded) Nov 26 23:25:09.707: INFO: simpletest.rc-ppgv4 started at <nil> (0+0 container statuses recorded) Nov 26 23:25:09.707: INFO: pod-exec-websocket-cb04b6b5-cb7c-4c75-84ae-5d6e56d0b6a4 started at <nil> (0+0 container statuses recorded) Nov 26 23:25:09.707: INFO: konnectivity-agent-bw7hk started at 2022-11-26 23:11:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:09.707: INFO: Container konnectivity-agent ready: false, restart count 5 Nov 26 23:25:09.707: INFO: csi-hostpathplugin-0 started at 2022-11-26 23:13:58 +0000 UTC (0+7 container statuses recorded) Nov 26 23:25:09.707: INFO: Container csi-attacher ready: true, restart count 1 Nov 26 23:25:09.707: INFO: Container csi-provisioner ready: true, restart count 1 Nov 26 23:25:09.707: INFO: Container csi-resizer ready: true, restart count 1 Nov 26 23:25:09.707: INFO: Container csi-snapshotter ready: true, restart count 1 Nov 26 23:25:09.707: INFO: Container hostpath ready: true, restart count 1 Nov 26 23:25:09.707: INFO: Container liveness-probe ready: true, restart count 1 Nov 26 23:25:09.707: INFO: Container node-driver-registrar ready: true, restart count 1 Nov 26 23:25:09.707: INFO: concurrent-27825083-ldnwm started at 2022-11-26 23:23:41 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:09.707: INFO: Container c ready: false, restart count 0 Nov 26 23:25:09.707: INFO: ss2-0 started at 2022-11-26 23:23:43 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:09.707: INFO: Container webserver ready: true, restart count 1 Nov 26 23:25:09.707: INFO: simpletest.rc-7xb2l started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:25:09.707: INFO: Container nginx ready: true, restart count 0 Nov 26 23:25:09.707: INFO: simpletest.rc-65qg4 started at <nil> (0+0 container statuses recorded) Nov 26 23:25:13.512: INFO: Latency metrics for node bootstrap-e2e-minion-group-n9b1 [DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] tear down framework | framework.go:193 STEP: Destroying namespace "webhook-2396" for this suite. 11/26/22 23:25:13.512 STEP: Destroying namespace "webhook-2396-markers" for this suite. 11/26/22 23:25:13.554
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\sshould\smutate\scustom\sresource\swith\sdifferent\sstored\sversion\s\[Conformance\]$'
test/e2e/framework/framework.go:241 k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc001205ef0) test/e2e/framework/framework.go:241 +0x96f There were additional failures detected after the initial failure: [PANICKED] Test Panicked In [AfterEach] at: /usr/local/go/src/runtime/panic.go:260 runtime error: invalid memory address or nil pointer dereference Full Stack Trace k8s.io/kubernetes/test/e2e/apimachinery.cleanWebhookTest({0x0, 0x0}, {0x0, 0x0}) test/e2e/apimachinery/webhook.go:1680 +0x46 k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.2() test/e2e/apimachinery/webhook.go:106 +0x2ffrom junit_01.xml
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] set up framework | framework.go:178 STEP: Creating a kubernetes client 11/26/22 23:28:49.1 Nov 26 23:28:49.100: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Building a namespace api object, basename webhook 11/26/22 23:28:49.102 Nov 26 23:28:49.142: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:28:51.182: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:28:53.182: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:28:55.182: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:28:57.181: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:28:59.182: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:29:01.181: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:29:03.181: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:29:05.182: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:29:07.182: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:29:09.182: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:29:11.182: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:29:13.182: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:29:15.182: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:29:17.182: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:29:19.182: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:29:19.222: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:29:19.222: INFO: Unexpected error: <*errors.errorString | 0xc000187d80>: { s: "timed out waiting for the condition", } Nov 26 23:29:19.222: FAIL: timed out waiting for the condition Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc001205ef0) test/e2e/framework/framework.go:241 +0x96f [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/framework/node/init/init.go:32 Nov 26 23:29:19.223: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/apimachinery/webhook.go:105 [DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] dump namespaces | framework.go:196 STEP: dump namespace information after failure 11/26/22 23:29:19.263 [DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] tear down framework | framework.go:193
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\sshould\smutate\scustom\sresource\swith\spruning\s\[Conformance\]$'
test/e2e/framework/framework.go:241 k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc000a0fe00) test/e2e/framework/framework.go:241 +0x96ffrom junit_01.xml
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] set up framework | framework.go:178 STEP: Creating a kubernetes client 11/26/22 23:54:18.224 Nov 26 23:54:18.224: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Building a namespace api object, basename webhook 11/26/22 23:54:18.226 Nov 26 23:54:18.266: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:54:20.306: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:54:22.306: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:54:24.306: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:54:26.306: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:54:28.306: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:54:30.306: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:54:32.306: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:54:34.306: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:54:36.305: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:54:38.306: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:54:40.306: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:54:42.306: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:54:44.306: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:54:46.306: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:54:48.306: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:54:48.345: INFO: Unexpected error while creating namespace: Post "https://34.83.128.61/api/v1/namespaces": dial tcp 34.83.128.61:443: connect: connection refused Nov 26 23:54:48.346: INFO: Unexpected error: <*errors.errorString | 0xc000115ca0>: { s: "timed out waiting for the condition", } Nov 26 23:54:48.346: FAIL: timed out waiting for the condition Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc000a0fe00) test/e2e/framework/framework.go:241 +0x96f [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/framework/node/init/init.go:32 Nov 26 23:54:48.346: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/apimachinery/webhook.go:105 [DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] dump namespaces | framework.go:196 STEP: dump namespace information after failure 11/26/22 23:54:48.543 [DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] tear down framework | framework.go:193
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\sshould\snot\sbe\sable\sto\smutate\sor\sprevent\sdeletion\sof\swebhook\sconfiguration\sobjects\s\[Conformance\]$'
test/e2e/apimachinery/webhook.go:826 k8s.io/kubernetes/test/e2e/apimachinery.deployWebhookAndService(0xc0010e7e00, {0xc00495f590, 0x2c}, 0xc005045040, 0x20fb, 0x20fc) test/e2e/apimachinery/webhook.go:826 +0xed2 k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.1() test/e2e/apimachinery/webhook.go:102 +0x226
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] set up framework | framework.go:178 STEP: Creating a kubernetes client 11/26/22 23:30:54.543 Nov 26 23:30:54.544: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Building a namespace api object, basename webhook 11/26/22 23:30:54.546 STEP: Waiting for a default service account to be provisioned in namespace 11/26/22 23:30:54.901 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 11/26/22 23:30:55.058 [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/apimachinery/webhook.go:90 STEP: Setting up server cert 11/26/22 23:30:55.538 STEP: Create role binding to let webhook read extension-apiserver-authentication 11/26/22 23:30:55.977 STEP: Deploying the webhook pod 11/26/22 23:30:56.079 STEP: Wait for the deployment to be ready 11/26/22 23:30:56.259 Nov 26 23:30:56.509: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 30, 56, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 30, 56, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 30, 56, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 30, 56, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:30:58.559: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 30, 56, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 30, 56, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 30, 56, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 30, 56, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:31:00.659: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 30, 56, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 30, 56, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 30, 56, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 30, 56, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:31:02.561: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 30, 56, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 30, 56, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 30, 56, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 30, 56, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:31:04.726: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 30, 56, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 30, 56, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 30, 56, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 30, 56, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:31:06.564: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 23, 30, 56, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 30, 56, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 23, 30, 56, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 23, 30, 56, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)} Nov 26 23:32:08.550: INFO: Unexpected error: waiting for the deployment status valid%!(EXTRA string=registry.k8s.io/e2e-test-images/agnhost:2.43, string=sample-webhook-deployment, string=webhook-7027): <*errors.errorString | 0xc0014be190>: { s: "error waiting for deployment \"sample-webhook-deployment\" status to match expectation: the server was unable to return a response in the time allotted, but may still be processing the request (get deployments.apps sample-webhook-deployment)", } Nov 26 23:32:08.550: FAIL: waiting for the deployment status valid%!(EXTRA string=registry.k8s.io/e2e-test-images/agnhost:2.43, string=sample-webhook-deployment, string=webhook-7027): error waiting for deployment "sample-webhook-deployment" status to match expectation: the server was unable to return a response in the time allotted, but may still be processing the request (get deployments.apps sample-webhook-deployment) Full Stack Trace k8s.io/kubernetes/test/e2e/apimachinery.deployWebhookAndService(0xc0010e7e00, {0xc00495f590, 0x2c}, 0xc005045040, 0x20fb, 0x20fc) test/e2e/apimachinery/webhook.go:826 +0xed2 k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.1() test/e2e/apimachinery/webhook.go:102 +0x226 [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/framework/node/init/init.go:32 Nov 26 23:32:08.551: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/apimachinery/webhook.go:105 [DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] dump namespaces | framework.go:196 STEP: dump namespace information after failure 11/26/22 23:32:13.042 STEP: Collecting events from namespace "webhook-7027". 11/26/22 23:32:13.042 STEP: Found 13 events. 11/26/22 23:32:13.083 Nov 26 23:32:13.083: INFO: At 2022-11-26 23:30:56 +0000 UTC - event for sample-webhook-deployment: {deployment-controller } ScalingReplicaSet: Scaled up replica set sample-webhook-deployment-865554f4d9 to 1 Nov 26 23:32:13.083: INFO: At 2022-11-26 23:30:56 +0000 UTC - event for sample-webhook-deployment-865554f4d9: {replicaset-controller } SuccessfulCreate: Created pod: sample-webhook-deployment-865554f4d9-k8x2c Nov 26 23:32:13.083: INFO: At 2022-11-26 23:30:56 +0000 UTC - event for sample-webhook-deployment-865554f4d9-k8x2c: {default-scheduler } Scheduled: Successfully assigned webhook-7027/sample-webhook-deployment-865554f4d9-k8x2c to bootstrap-e2e-minion-group-l8ht Nov 26 23:32:13.083: INFO: At 2022-11-26 23:30:57 +0000 UTC - event for sample-webhook-deployment-865554f4d9-k8x2c: {kubelet bootstrap-e2e-minion-group-l8ht} FailedMount: MountVolume.SetUp failed for volume "webhook-certs" : failed to sync secret cache: timed out waiting for the condition Nov 26 23:32:13.083: INFO: At 2022-11-26 23:31:00 +0000 UTC - event for sample-webhook-deployment-865554f4d9-k8x2c: {kubelet bootstrap-e2e-minion-group-l8ht} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Nov 26 23:32:13.083: INFO: At 2022-11-26 23:31:00 +0000 UTC - event for sample-webhook-deployment-865554f4d9-k8x2c: {kubelet bootstrap-e2e-minion-group-l8ht} Created: Created container sample-webhook Nov 26 23:32:13.083: INFO: At 2022-11-26 23:31:00 +0000 UTC - event for sample-webhook-deployment-865554f4d9-k8x2c: {kubelet bootstrap-e2e-minion-group-l8ht} Started: Started container sample-webhook Nov 26 23:32:13.083: INFO: At 2022-11-26 23:31:02 +0000 UTC - event for sample-webhook-deployment-865554f4d9-k8x2c: {kubelet bootstrap-e2e-minion-group-l8ht} Unhealthy: Readiness probe failed: Get "https://10.64.2.244:8444/readyz": dial tcp 10.64.2.244:8444: connect: connection refused Nov 26 23:32:13.083: INFO: At 2022-11-26 23:31:02 +0000 UTC - event for sample-webhook-deployment-865554f4d9-k8x2c: {kubelet bootstrap-e2e-minion-group-l8ht} Killing: Stopping container sample-webhook Nov 26 23:32:13.083: INFO: At 2022-11-26 23:31:03 +0000 UTC - event for sample-webhook-deployment-865554f4d9-k8x2c: {kubelet bootstrap-e2e-minion-group-l8ht} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Nov 26 23:32:13.083: INFO: At 2022-11-26 23:31:08 +0000 UTC - event for sample-webhook-deployment-865554f4d9-k8x2c: {kubelet bootstrap-e2e-minion-group-l8ht} BackOff: Back-off restarting failed container sample-webhook in pod sample-webhook-deployment-865554f4d9-k8x2c_webhook-7027(ee6a4379-2803-4a31-958d-d34fcf40dc95) Nov 26 23:32:13.083: INFO: At 2022-11-26 23:31:09 +0000 UTC - event for sample-webhook-deployment-865554f4d9-k8x2c: {kubelet bootstrap-e2e-minion-group-l8ht} Unhealthy: Readiness probe failed: Get "https://10.64.2.249:8444/readyz": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) Nov 26 23:32:13.083: INFO: At 2022-11-26 23:31:29 +0000 UTC - event for sample-webhook-deployment-865554f4d9-k8x2c: {kubelet bootstrap-e2e-minion-group-l8ht} Unhealthy: Readiness probe failed: Get "https://10.64.2.253:8444/readyz": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) Nov 26 23:32:13.124: INFO: POD NODE PHASE GRACE CONDITIONS Nov 26 23:32:13.124: INFO: sample-webhook-deployment-865554f4d9-k8x2c bootstrap-e2e-minion-group-l8ht Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-11-26 23:30:56 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2022-11-26 23:32:00 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2022-11-26 23:32:00 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-11-26 23:30:56 +0000 UTC }] Nov 26 23:32:13.124: INFO: Nov 26 23:32:13.220: INFO: Logging node info for node bootstrap-e2e-master Nov 26 23:32:13.262: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master c85fbb04-d865-42ae-b40a-365f0873d077 8475 0 2022-11-26 23:10:47 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 23:10:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-11-26 23:11:08 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-11-26 23:11:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-11-26 23:29:38 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-6-1-5-ctl-skew/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3858374656 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3596230656 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 23:11:08 +0000 UTC,LastTransitionTime:2022-11-26 23:11:08 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 23:29:38 +0000 UTC,LastTransitionTime:2022-11-26 23:10:47 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 23:29:38 +0000 UTC,LastTransitionTime:2022-11-26 23:10:47 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 23:29:38 +0000 UTC,LastTransitionTime:2022-11-26 23:10:47 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 23:29:38 +0000 UTC,LastTransitionTime:2022-11-26 23:11:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:34.83.128.61,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:51f618a4ea82aa4d3795e4cfa76e3a28,SystemUUID:51f618a4-ea82-aa4d-3795-e4cfa76e3a28,BootID:eb1eb4fb-e105-4d49-9289-0d31902f8c4d,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:135160272,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:124990265,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:57660216,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:2c111f004bec24888d8cfa2a812a38fb8341350abac67dcd0ac64e709dfe389c registry.k8s.io/kas-network-proxy/proxy-server:v0.0.33],SizeBytes:22020129,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 26 23:32:13.263: INFO: Logging kubelet events for node bootstrap-e2e-master Nov 26 23:32:13.327: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-master Nov 26 23:32:13.398: INFO: etcd-server-events-bootstrap-e2e-master started at 2022-11-26 23:10:04 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.398: INFO: Container etcd-container ready: true, restart count 3 Nov 26 23:32:13.398: INFO: kube-controller-manager-bootstrap-e2e-master started at 2022-11-26 23:10:04 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.398: INFO: Container kube-controller-manager ready: false, restart count 7 Nov 26 23:32:13.398: INFO: kube-addon-manager-bootstrap-e2e-master started at 2022-11-26 23:10:21 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.398: INFO: Container kube-addon-manager ready: true, restart count 2 Nov 26 23:32:13.398: INFO: l7-lb-controller-bootstrap-e2e-master started at 2022-11-26 23:10:21 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.398: INFO: Container l7-lb-controller ready: false, restart count 7 Nov 26 23:32:13.398: INFO: metadata-proxy-v0.1-cs4d8 started at 2022-11-26 23:11:29 +0000 UTC (0+2 container statuses recorded) Nov 26 23:32:13.398: INFO: Container metadata-proxy ready: true, restart count 0 Nov 26 23:32:13.398: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Nov 26 23:32:13.398: INFO: kube-scheduler-bootstrap-e2e-master started at 2022-11-26 23:10:04 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.398: INFO: Container kube-scheduler ready: false, restart count 5 Nov 26 23:32:13.398: INFO: etcd-server-bootstrap-e2e-master started at 2022-11-26 23:10:04 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.398: INFO: Container etcd-container ready: true, restart count 4 Nov 26 23:32:13.398: INFO: konnectivity-server-bootstrap-e2e-master started at 2022-11-26 23:10:04 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.398: INFO: Container konnectivity-server-container ready: true, restart count 1 Nov 26 23:32:13.398: INFO: kube-apiserver-bootstrap-e2e-master started at 2022-11-26 23:10:04 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.398: INFO: Container kube-apiserver ready: false, restart count 4 Nov 26 23:32:13.618: INFO: Latency metrics for node bootstrap-e2e-master Nov 26 23:32:13.618: INFO: Logging node info for node bootstrap-e2e-minion-group-dr7t Nov 26 23:32:13.661: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-dr7t b4041686-ad54-48f5-95c3-e848d9a8f0a7 9571 0 2022-11-26 23:10:49 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-dr7t kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-dr7t topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-5883":"bootstrap-e2e-minion-group-dr7t","csi-hostpath-ephemeral-8027":"bootstrap-e2e-minion-group-dr7t","csi-hostpath-volume-expand-3788":"bootstrap-e2e-minion-group-dr7t","csi-mock-csi-mock-volumes-28":"bootstrap-e2e-minion-group-dr7t","csi-mock-csi-mock-volumes-7211":"bootstrap-e2e-minion-group-dr7t"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 23:10:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 23:10:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {node-problem-detector Update v1 2022-11-26 23:29:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-11-26 23:30:04 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-11-26 23:30:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-6-1-5-ctl-skew/us-west1-b/bootstrap-e2e-minion-group-dr7t,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 23:29:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 23:29:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 23:29:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 23:29:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 23:29:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 23:29:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 23:29:40 +0000 UTC,LastTransitionTime:2022-11-26 23:10:53 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 23:11:08 +0000 UTC,LastTransitionTime:2022-11-26 23:11:08 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 23:30:56 +0000 UTC,LastTransitionTime:2022-11-26 23:10:49 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 23:30:56 +0000 UTC,LastTransitionTime:2022-11-26 23:10:49 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 23:30:56 +0000 UTC,LastTransitionTime:2022-11-26 23:10:49 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 23:30:56 +0000 UTC,LastTransitionTime:2022-11-26 23:10:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:35.185.223.63,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-dr7t.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-dr7t.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:29f409e413f0ebfffc6ee0c012a074c7,SystemUUID:29f409e4-13f0-ebff-fc6e-e0c012a074c7,BootID:a3bfef7b-2d61-4ac5-a15e-34631edb66c9,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 26 23:32:13.661: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-dr7t Nov 26 23:32:13.710: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-dr7t Nov 26 23:32:13.880: INFO: simpletest.rc-jz7rl started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.880: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:13.880: INFO: simpletest.rc-fgdjw started at 2022-11-26 23:24:11 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.880: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:13.880: INFO: metadata-proxy-v0.1-5cxbq started at 2022-11-26 23:10:50 +0000 UTC (0+2 container statuses recorded) Nov 26 23:32:13.880: INFO: Container metadata-proxy ready: true, restart count 0 Nov 26 23:32:13.880: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Nov 26 23:32:13.880: INFO: pod-hostip-ca4d6a7e-d19f-41f7-a0c0-3ba1daa0f976 started at 2022-11-26 23:23:56 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.880: INFO: Container test ready: true, restart count 2 Nov 26 23:32:13.880: INFO: simpletest.rc-vqn8l started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.880: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:13.880: INFO: external-provisioner-fslzm started at 2022-11-26 23:30:55 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.880: INFO: Container nfs-provisioner ready: true, restart count 2 Nov 26 23:32:13.880: INFO: simpletest.rc-4xnc8 started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.880: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:13.880: INFO: csi-mockplugin-resizer-0 started at 2022-11-26 23:13:58 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.880: INFO: Container csi-resizer ready: true, restart count 5 Nov 26 23:32:13.880: INFO: simpletest.rc-c9cjf started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.880: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:13.880: INFO: sample-webhook-deployment-865554f4d9-l9hxx started at 2022-11-26 23:30:56 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.880: INFO: Container sample-webhook ready: true, restart count 0 Nov 26 23:32:13.880: INFO: coredns-6d97d5ddb-tfljm started at 2022-11-26 23:11:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.880: INFO: Container coredns ready: false, restart count 7 Nov 26 23:32:13.880: INFO: konnectivity-agent-bdgkf started at 2022-11-26 23:11:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.880: INFO: Container konnectivity-agent ready: false, restart count 6 Nov 26 23:32:13.880: INFO: inline-volume-tester-mndlt started at 2022-11-26 23:14:00 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.880: INFO: Container csi-volume-tester ready: false, restart count 0 Nov 26 23:32:13.880: INFO: csi-hostpathplugin-0 started at 2022-11-26 23:20:01 +0000 UTC (0+7 container statuses recorded) Nov 26 23:32:13.880: INFO: Container csi-attacher ready: false, restart count 5 Nov 26 23:32:13.880: INFO: Container csi-provisioner ready: false, restart count 5 Nov 26 23:32:13.880: INFO: Container csi-resizer ready: false, restart count 5 Nov 26 23:32:13.880: INFO: Container csi-snapshotter ready: false, restart count 5 Nov 26 23:32:13.880: INFO: Container hostpath ready: false, restart count 5 Nov 26 23:32:13.880: INFO: Container liveness-probe ready: false, restart count 5 Nov 26 23:32:13.880: INFO: Container node-driver-registrar ready: false, restart count 5 Nov 26 23:32:13.880: INFO: simpletest.rc-r48g7 started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.880: INFO: Container nginx ready: true, restart count 4 Nov 26 23:32:13.880: INFO: simpletest.rc-ns9qh started at 2022-11-26 23:24:10 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.880: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:13.880: INFO: backofflimit-k6h5t started at 2022-11-26 23:31:02 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.880: INFO: Container c ready: false, restart count 0 Nov 26 23:32:13.880: INFO: externalip-test-glqb4 started at 2022-11-26 23:18:39 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.880: INFO: Container externalip-test ready: true, restart count 4 Nov 26 23:32:13.880: INFO: simpletest.rc-74l76 started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.880: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:13.880: INFO: ss2-0 started at 2022-11-26 23:30:57 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.880: INFO: Container webserver ready: true, restart count 0 Nov 26 23:32:13.880: INFO: simpletest.rc-pwcsr started at 2022-11-26 23:24:10 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.880: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:13.880: INFO: kube-proxy-bootstrap-e2e-minion-group-dr7t started at 2022-11-26 23:10:49 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.880: INFO: Container kube-proxy ready: false, restart count 7 Nov 26 23:32:13.880: INFO: simpletest.rc-gqz24 started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.880: INFO: Container nginx ready: false, restart count 2 Nov 26 23:32:13.880: INFO: csi-hostpathplugin-0 started at 2022-11-26 23:15:49 +0000 UTC (0+7 container statuses recorded) Nov 26 23:32:13.880: INFO: Container csi-attacher ready: true, restart count 4 Nov 26 23:32:13.880: INFO: Container csi-provisioner ready: true, restart count 4 Nov 26 23:32:13.880: INFO: Container csi-resizer ready: true, restart count 4 Nov 26 23:32:13.880: INFO: Container csi-snapshotter ready: true, restart count 4 Nov 26 23:32:13.880: INFO: Container hostpath ready: true, restart count 4 Nov 26 23:32:13.880: INFO: Container liveness-probe ready: true, restart count 4 Nov 26 23:32:13.880: INFO: Container node-driver-registrar ready: true, restart count 4 Nov 26 23:32:13.880: INFO: simpletest.rc-k5zrz started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.880: INFO: Container nginx ready: false, restart count 4 Nov 26 23:32:13.880: INFO: simpletest.rc-c5h8h started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.880: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:13.880: INFO: simpletest.rc-t7xqp started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.880: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:13.880: INFO: simpletest.rc-k6n62 started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.880: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:13.880: INFO: e2e-2gjr9-9fzdt started at 2022-11-26 23:13:41 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.880: INFO: Container c ready: false, restart count 0 Nov 26 23:32:13.880: INFO: client-envvars-94091b6a-29ad-4b9a-9ad7-528612eb4de4 started at 2022-11-26 23:13:52 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.880: INFO: Container env3cont ready: false, restart count 0 Nov 26 23:32:13.880: INFO: simpletest.rc-v9jc5 started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.880: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:13.880: INFO: externalname-service-kgwxz started at 2022-11-26 23:30:56 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.880: INFO: Container externalname-service ready: true, restart count 0 Nov 26 23:32:13.880: INFO: netserver-0 started at 2022-11-26 23:13:40 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.880: INFO: Container webserver ready: true, restart count 7 Nov 26 23:32:13.880: INFO: simpletest.rc-z4cfk started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.880: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:13.880: INFO: e2e-2gjr9-mw95z started at 2022-11-26 23:13:46 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.880: INFO: Container c ready: false, restart count 0 Nov 26 23:32:13.880: INFO: simpletest.rc-5lcbg started at 2022-11-26 23:24:11 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.880: INFO: Container nginx ready: true, restart count 5 Nov 26 23:32:13.880: INFO: test-rs-7t6dx started at 2022-11-26 23:30:55 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.880: INFO: Container httpd ready: false, restart count 1 Nov 26 23:32:13.880: INFO: simpletest.rc-d4qlz started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.880: INFO: Container nginx ready: true, restart count 3 Nov 26 23:32:13.880: INFO: kube-dns-autoscaler-5f6455f985-2twl5 started at 2022-11-26 23:11:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.880: INFO: Container autoscaler ready: false, restart count 7 Nov 26 23:32:13.880: INFO: hostexec-bootstrap-e2e-minion-group-dr7t-ssljm started at 2022-11-26 23:13:55 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.880: INFO: Container agnhost-container ready: true, restart count 4 Nov 26 23:32:13.880: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 23:13:58 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.880: INFO: Container csi-attacher ready: true, restart count 5 Nov 26 23:32:13.880: INFO: test-rs-zwkkr started at 2022-11-26 23:19:54 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.880: INFO: Container httpd ready: true, restart count 5 Nov 26 23:32:13.880: INFO: csi-mockplugin-0 started at 2022-11-26 23:23:56 +0000 UTC (0+3 container statuses recorded) Nov 26 23:32:13.880: INFO: Container csi-provisioner ready: true, restart count 4 Nov 26 23:32:13.880: INFO: Container driver-registrar ready: true, restart count 5 Nov 26 23:32:13.880: INFO: Container mock ready: true, restart count 4 Nov 26 23:32:13.880: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 23:23:56 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.880: INFO: Container csi-attacher ready: true, restart count 4 Nov 26 23:32:13.880: INFO: simpletest.rc-grs4f started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.880: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:13.880: INFO: simpletest.rc-fvdxd started at 2022-11-26 23:24:10 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.880: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:13.880: INFO: simpletest.rc-hrx7l started at 2022-11-26 23:24:11 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.880: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:13.880: INFO: replace-27825091-d7l4n started at 2022-11-26 23:31:00 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.880: INFO: Container c ready: true, restart count 1 Nov 26 23:32:13.880: INFO: external-provisioner-wrpbw started at 2022-11-26 23:14:05 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.880: INFO: Container nfs-provisioner ready: true, restart count 4 Nov 26 23:32:13.880: INFO: pod1 started at 2022-11-26 23:18:15 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.880: INFO: Container agnhost-container ready: false, restart count 3 Nov 26 23:32:13.880: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 23:15:48 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.880: INFO: Container csi-attacher ready: false, restart count 5 Nov 26 23:32:13.880: INFO: inline-volume-tester-65qqv started at 2022-11-26 23:23:51 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.880: INFO: Container csi-volume-tester ready: false, restart count 0 Nov 26 23:32:13.880: INFO: simpletest.rc-cvkmj started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.880: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:13.880: INFO: csi-mockplugin-0 started at 2022-11-26 23:16:14 +0000 UTC (0+4 container statuses recorded) Nov 26 23:32:13.880: INFO: Container busybox ready: false, restart count 6 Nov 26 23:32:13.880: INFO: Container csi-provisioner ready: false, restart count 6 Nov 26 23:32:13.880: INFO: Container driver-registrar ready: true, restart count 6 Nov 26 23:32:13.880: INFO: Container mock ready: true, restart count 6 Nov 26 23:32:13.880: INFO: successful-jobs-history-limit-27825091-mr7tr started at 2022-11-26 23:31:00 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.880: INFO: Container c ready: false, restart count 0 Nov 26 23:32:13.880: INFO: simpletest.rc-mvsml started at 2022-11-26 23:24:10 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.880: INFO: Container nginx ready: false, restart count 1 Nov 26 23:32:13.881: INFO: external-provisioner-9dc9l started at 2022-11-26 23:13:43 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.881: INFO: Container nfs-provisioner ready: true, restart count 4 Nov 26 23:32:13.881: INFO: simpletest.rc-fwmr7 started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.881: INFO: Container nginx ready: true, restart count 3 Nov 26 23:32:13.881: INFO: hostexec-bootstrap-e2e-minion-group-dr7t-4qhfn started at 2022-11-26 23:24:03 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.881: INFO: Container agnhost-container ready: true, restart count 2 Nov 26 23:32:13.881: INFO: ss2-2 started at 2022-11-26 23:30:33 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.881: INFO: Container webserver ready: true, restart count 2 Nov 26 23:32:13.881: INFO: simpletest.rc-m6r9w started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.881: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:13.881: INFO: simpletest.rc-vj7jd started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.881: INFO: Container nginx ready: false, restart count 4 Nov 26 23:32:13.881: INFO: simpletest.rc-7c2t4 started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.881: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:13.881: INFO: netserver-0 started at 2022-11-26 23:30:55 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.881: INFO: Container webserver ready: true, restart count 2 Nov 26 23:32:13.881: INFO: client-containers-a07ad6d5-f09c-4873-aa1a-59d19e7db754 started at 2022-11-26 23:30:56 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.881: INFO: Container agnhost-container ready: true, restart count 0 Nov 26 23:32:13.881: INFO: external-provisioner-fwvdj started at 2022-11-26 23:13:53 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.881: INFO: Container nfs-provisioner ready: true, restart count 5 Nov 26 23:32:13.881: INFO: csi-mockplugin-0 started at 2022-11-26 23:15:48 +0000 UTC (0+3 container statuses recorded) Nov 26 23:32:13.881: INFO: Container csi-provisioner ready: false, restart count 5 Nov 26 23:32:13.881: INFO: Container driver-registrar ready: true, restart count 6 Nov 26 23:32:13.881: INFO: Container mock ready: false, restart count 5 Nov 26 23:32:13.881: INFO: simpletest.rc-bbtzn started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.881: INFO: Container nginx ready: false, restart count 2 Nov 26 23:32:13.881: INFO: simpletest.rc-kkv97 started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.881: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:13.881: INFO: hostexec-bootstrap-e2e-minion-group-dr7t-8hn6w started at 2022-11-26 23:30:33 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.881: INFO: Container agnhost-container ready: true, restart count 0 Nov 26 23:32:13.881: INFO: hostpath-symlink-prep-provisioning-2423 started at 2022-11-26 23:14:01 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.881: INFO: Container init-volume-provisioning-2423 ready: false, restart count 0 Nov 26 23:32:13.881: INFO: netserver-0 started at 2022-11-26 23:18:54 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.881: INFO: Container webserver ready: true, restart count 6 Nov 26 23:32:13.881: INFO: netserver-0 started at 2022-11-26 23:19:06 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.881: INFO: Container webserver ready: false, restart count 6 Nov 26 23:32:13.881: INFO: simpletest.rc-v5cwl started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.881: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:13.881: INFO: simpletest.rc-5xfcl started at 2022-11-26 23:24:10 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.881: INFO: Container nginx ready: false, restart count 1 Nov 26 23:32:13.881: INFO: csi-hostpathplugin-0 started at 2022-11-26 23:13:45 +0000 UTC (0+7 container statuses recorded) Nov 26 23:32:13.881: INFO: Container csi-attacher ready: false, restart count 6 Nov 26 23:32:13.881: INFO: Container csi-provisioner ready: false, restart count 6 Nov 26 23:32:13.881: INFO: Container csi-resizer ready: false, restart count 6 Nov 26 23:32:13.881: INFO: Container csi-snapshotter ready: false, restart count 6 Nov 26 23:32:13.881: INFO: Container hostpath ready: false, restart count 6 Nov 26 23:32:13.881: INFO: Container liveness-probe ready: false, restart count 6 Nov 26 23:32:13.881: INFO: Container node-driver-registrar ready: false, restart count 6 Nov 26 23:32:13.881: INFO: csi-hostpathplugin-0 started at 2022-11-26 23:15:48 +0000 UTC (0+7 container statuses recorded) Nov 26 23:32:13.881: INFO: Container csi-attacher ready: true, restart count 2 Nov 26 23:32:13.881: INFO: Container csi-provisioner ready: true, restart count 2 Nov 26 23:32:13.881: INFO: Container csi-resizer ready: true, restart count 2 Nov 26 23:32:13.881: INFO: Container csi-snapshotter ready: true, restart count 2 Nov 26 23:32:13.881: INFO: Container hostpath ready: true, restart count 2 Nov 26 23:32:13.881: INFO: Container liveness-probe ready: true, restart count 2 Nov 26 23:32:13.881: INFO: Container node-driver-registrar ready: true, restart count 2 Nov 26 23:32:13.881: INFO: simpletest.rc-lmsws started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.881: INFO: Container nginx ready: true, restart count 3 Nov 26 23:32:13.881: INFO: concurrent-27825091-kqhhk started at 2022-11-26 23:31:00 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.881: INFO: Container c ready: false, restart count 0 Nov 26 23:32:13.881: INFO: csi-mockplugin-0 started at 2022-11-26 23:13:58 +0000 UTC (0+3 container statuses recorded) Nov 26 23:32:13.881: INFO: Container csi-provisioner ready: true, restart count 5 Nov 26 23:32:13.881: INFO: Container driver-registrar ready: true, restart count 5 Nov 26 23:32:13.881: INFO: Container mock ready: true, restart count 5 Nov 26 23:32:13.881: INFO: simpletest.rc-vmjnr started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:13.881: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:14.466: INFO: Latency metrics for node bootstrap-e2e-minion-group-dr7t Nov 26 23:32:14.466: INFO: Logging node info for node bootstrap-e2e-minion-group-l8ht Nov 26 23:32:14.510: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-l8ht 3e5210d0-ba6b-4f56-896c-40aaae5093d0 9667 0 2022-11-26 23:10:52 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-l8ht kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-l8ht topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-2215":"bootstrap-e2e-minion-group-l8ht","csi-hostpath-ephemeral-3757":"bootstrap-e2e-minion-group-l8ht","csi-mock-csi-mock-volumes-1468":"bootstrap-e2e-minion-group-l8ht","csi-mock-csi-mock-volumes-355":"bootstrap-e2e-minion-group-l8ht","csi-mock-csi-mock-volumes-7659":"bootstrap-e2e-minion-group-l8ht"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 23:10:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 23:10:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {node-problem-detector Update v1 2022-11-26 23:29:41 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-11-26 23:30:56 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2022-11-26 23:30:59 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-6-1-5-ctl-skew/us-west1-b/bootstrap-e2e-minion-group-l8ht,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 23:29:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 23:29:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 23:29:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 23:29:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 23:29:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 23:29:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 23:29:41 +0000 UTC,LastTransitionTime:2022-11-26 23:10:55 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 23:11:08 +0000 UTC,LastTransitionTime:2022-11-26 23:11:08 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 23:30:56 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 23:30:56 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 23:30:56 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 23:30:56 +0000 UTC,LastTransitionTime:2022-11-26 23:10:52 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:34.168.47.71,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-l8ht.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-l8ht.c.k8s-gce-cvm-1-6-1-5-ctl-skew.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:89b0fd3f78d194fccba6eb2ce27680f6,SystemUUID:89b0fd3f-78d1-94fc-cba6-eb2ce27680f6,BootID:ec1fa0a7-81b7-48ec-8da0-cc1b45a14fc8,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-2215^54ec9437-6de2-11ed-a59d-c2129b99100c kubernetes.io/csi/csi-hostpath-ephemeral-2215^5e526a82-6de2-11ed-a59d-c2129b99100c kubernetes.io/csi/csi-hostpath-provisioning-55^28d8d761-6de0-11ed-8c44-7ec558aa6670],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-2215^5e526a82-6de2-11ed-a59d-c2129b99100c,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-55^28d8d761-6de0-11ed-8c44-7ec558aa6670,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-2215^54ec9437-6de2-11ed-a59d-c2129b99100c,DevicePath:,},},Config:nil,},} Nov 26 23:32:14.511: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-l8ht Nov 26 23:32:14.555: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-l8ht Nov 26 23:32:14.654: INFO: csi-hostpathplugin-0 started at 2022-11-26 23:13:43 +0000 UTC (0+7 container statuses recorded) Nov 26 23:32:14.654: INFO: Container csi-attacher ready: false, restart count 4 Nov 26 23:32:14.654: INFO: Container csi-provisioner ready: false, restart count 4 Nov 26 23:32:14.654: INFO: Container csi-resizer ready: false, restart count 4 Nov 26 23:32:14.654: INFO: Container csi-snapshotter ready: false, restart count 4 Nov 26 23:32:14.654: INFO: Container hostpath ready: false, restart count 4 Nov 26 23:32:14.654: INFO: Container liveness-probe ready: false, restart count 4 Nov 26 23:32:14.654: INFO: Container node-driver-registrar ready: false, restart count 5 Nov 26 23:32:14.654: INFO: external-provisioner-l4hjd started at 2022-11-26 23:18:15 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.654: INFO: Container nfs-provisioner ready: true, restart count 4 Nov 26 23:32:14.654: INFO: simpletest.rc-47jfp started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.654: INFO: Container nginx ready: true, restart count 3 Nov 26 23:32:14.654: INFO: simpletest.rc-768cr started at 2022-11-26 23:24:11 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.654: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:14.654: INFO: netserver-1 started at 2022-11-26 23:30:55 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.654: INFO: Container webserver ready: true, restart count 2 Nov 26 23:32:14.654: INFO: konnectivity-agent-rhvvx started at 2022-11-26 23:11:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.654: INFO: Container konnectivity-agent ready: false, restart count 7 Nov 26 23:32:14.654: INFO: ss2-1 started at 2022-11-26 23:30:42 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.654: INFO: Container webserver ready: true, restart count 2 Nov 26 23:32:14.654: INFO: test-rs-4vhzr started at 2022-11-26 23:31:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.654: INFO: Container httpd ready: true, restart count 0 Nov 26 23:32:14.654: INFO: simpletest.rc-7n2qg started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.654: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:14.654: INFO: simpletest.rc-lslmb started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.654: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:14.654: INFO: test-cleanup-controller-w66lq started at 2022-11-26 23:14:02 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.654: INFO: Container httpd ready: true, restart count 3 Nov 26 23:32:14.654: INFO: simpletest.rc-vzb6t started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.654: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:14.654: INFO: simpletest.rc-7ppxt started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.654: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:14.654: INFO: simpletest.rc-rczdt started at 2022-11-26 23:24:10 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.654: INFO: Container nginx ready: true, restart count 3 Nov 26 23:32:14.654: INFO: inline-volume-tester-rx8k7 started at 2022-11-26 23:30:38 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.654: INFO: Container csi-volume-tester ready: false, restart count 0 Nov 26 23:32:14.654: INFO: netserver-1 started at 2022-11-26 23:13:40 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.654: INFO: Container webserver ready: false, restart count 8 Nov 26 23:32:14.654: INFO: test-rs-rlcd5 started at 2022-11-26 23:19:54 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.654: INFO: Container httpd ready: true, restart count 1 Nov 26 23:32:14.654: INFO: simpletest.rc-9sc82 started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.654: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:14.654: INFO: simpletest.rc-q8q28 started at 2022-11-26 23:24:10 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.654: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:14.654: INFO: hostexec-bootstrap-e2e-minion-group-l8ht-6ffqj started at 2022-11-26 23:14:05 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.654: INFO: Container agnhost-container ready: true, restart count 5 Nov 26 23:32:14.654: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 23:30:33 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.654: INFO: Container csi-attacher ready: true, restart count 0 Nov 26 23:32:14.654: INFO: inline-volume-tester-nqd44 started at 2022-11-26 23:18:28 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.654: INFO: Container csi-volume-tester ready: false, restart count 0 Nov 26 23:32:14.654: INFO: simpletest.rc-2mfcn started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.654: INFO: Container nginx ready: true, restart count 3 Nov 26 23:32:14.654: INFO: simpletest.rc-88vj9 started at 2022-11-26 23:24:11 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.654: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:14.654: INFO: simpletest.rc-zrvv5 started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.654: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:14.654: INFO: simpletest.rc-j6nhq started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.654: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:14.654: INFO: coredns-6d97d5ddb-j25mc started at 2022-11-26 23:11:12 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.654: INFO: Container coredns ready: false, restart count 7 Nov 26 23:32:14.654: INFO: simpletest.rc-hfg2l started at 2022-11-26 23:24:10 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.654: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:14.654: INFO: simpletest.rc-t5r8v started at 2022-11-26 23:24:11 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.654: INFO: Container nginx ready: false, restart count 3 Nov 26 23:32:14.654: INFO: hostexec-bootstrap-e2e-minion-group-l8ht-xvf2z started at 2022-11-26 23:30:33 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.654: INFO: Container agnhost-container ready: true, restart count 0 Nov 26 23:32:14.654: INFO: netserver-1 started at 2022-11-26 23:18:54 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.654: INFO: Container webserver ready: false, restart count 3 Nov 26 23:32:14.654: INFO: simpletest.rc-fdktq started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.654: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:14.654: INFO: pod-2c9ca969-f71c-470c-a591-eddc5680ebb6 started at 2022-11-26 23:15:47 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.654: INFO: Container write-pod ready: false, restart count 0 Nov 26 23:32:14.654: INFO: simpletest.rc-hvsd4 started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.654: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:14.654: INFO: simpletest.rc-95pbd started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.654: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:14.654: INFO: simpletest.rc-czsr7 started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.654: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:14.654: INFO: simpletest.rc-mvdr4 started at 2022-11-26 23:24:10 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.654: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:14.654: INFO: inline-volume-tester2-4fbtj started at 2022-11-26 23:30:54 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.654: INFO: Container csi-volume-tester ready: true, restart count 0 Nov 26 23:32:14.654: INFO: externalname-service-6jhjf started at 2022-11-26 23:30:56 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.654: INFO: Container externalname-service ready: true, restart count 0 Nov 26 23:32:14.654: INFO: csi-hostpathplugin-0 started at 2022-11-26 23:14:04 +0000 UTC (0+7 container statuses recorded) Nov 26 23:32:14.654: INFO: Container csi-attacher ready: false, restart count 7 Nov 26 23:32:14.654: INFO: Container csi-provisioner ready: false, restart count 7 Nov 26 23:32:14.654: INFO: Container csi-resizer ready: false, restart count 7 Nov 26 23:32:14.654: INFO: Container csi-snapshotter ready: false, restart count 7 Nov 26 23:32:14.654: INFO: Container hostpath ready: false, restart count 7 Nov 26 23:32:14.654: INFO: Container liveness-probe ready: false, restart count 7 Nov 26 23:32:14.654: INFO: Container node-driver-registrar ready: false, restart count 6 Nov 26 23:32:14.654: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 23:15:47 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.654: INFO: Container csi-attacher ready: true, restart count 4 Nov 26 23:32:14.654: INFO: liveness-d534e81f-ba57-43f0-a7ed-ae77c4a39ae7 started at 2022-11-26 23:23:58 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.654: INFO: Container agnhost-container ready: true, restart count 1 Nov 26 23:32:14.654: INFO: simpletest.rc-d8tnq started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.654: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:14.654: INFO: simpletest.rc-tmr7r started at 2022-11-26 23:24:09 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.654: INFO: Container nginx ready: true, restart count 1 Nov 26 23:32:14.654: INFO: concurrent-27825091-4rnxd started at 2022-11-26 23:31:00 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.654: INFO: Container c ready: false, restart count 0 Nov 26 23:32:14.654: INFO: csi-hostpathplugin-0 started at 2022-11-26 23:30:33 +0000 UTC (0+7 container statuses recorded) Nov 26 23:32:14.654: INFO: Container csi-attacher ready: true, restart count 0 Nov 26 23:32:14.654: INFO: Container csi-provisioner ready: true, restart count 0 Nov 26 23:32:14.654: INFO: Container csi-resizer ready: true, restart count 0 Nov 26 23:32:14.654: INFO: Container csi-snapshotter ready: true, restart count 0 Nov 26 23:32:14.654: INFO: Container hostpath ready: true, restart count 0 Nov 26 23:32:14.654: INFO: Container liveness-probe ready: true, restart count 0 Nov 26 23:32:14.654: INFO: Container node-driver-registrar ready: true, restart count 0 Nov 26 23:32:14.654: INFO: simpletest.rc-t7wx8 started at 2022-11-26 23:24:08 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.654: INFO: Container nginx ready: true, restart count 0 Nov 26 23:32:14.654: INFO: simpletest.rc-p9bpg started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.654: INFO: Container nginx ready: true, restart count 3 Nov 26 23:32:14.654: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 23:24:11 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.654: INFO: Container csi-attacher ready: true, restart count 2 Nov 26 23:32:14.654: INFO: kube-proxy-bootstrap-e2e-minion-group-l8ht started at 2022-11-26 23:10:52 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.654: INFO: Container kube-proxy ready: false, restart count 7 Nov 26 23:32:14.654: INFO: netserver-1 started at 2022-11-26 23:19:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.654: INFO: Container webserver ready: true, restart count 2 Nov 26 23:32:14.654: INFO: simpletest.rc-8kjlk started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.654: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:14.654: INFO: simpletest.rc-wzrjg started at 2022-11-26 23:24:07 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.654: INFO: Container nginx ready: true, restart count 2 Nov 26 23:32:14.654: INFO: csi-mockplugin-0 started at 2022-11-26 23:30:33 +0000 UTC (0+3 container statuses recorded) Nov 26 23:32:14.654: INFO: Container csi-provisioner ready: true, restart count 0 Nov 26 23:32:14.654: INFO: Container driver-registrar ready: true, restart count 0 Nov 26 23:32:14.654: INFO: Container mock ready: true, restart count 0 Nov 26 23:32:14.654: INFO: forbid-27825091-7wspw started at 2022-11-26 23:31:00 +0000 UTC (0+1 container statuses recorded) Nov 26 23:32:14.654: INFO: Container c ready: false, restart count 0 Nov 26 23:32:14.654: INFO: metadata-proxy-v0.1-n8dk7 started at 2022-11-26 23:10:53 +0000 UTC (0+2 container statuses recorded) Nov 26 23:32:14.654: INFO: Container metadata-proxy ready: true, restart count 0 Nov 26 23:32:14.654: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Nov 26 23:32:14.654: INFO: simpletest.rc-zr9cg st