Result | FAILURE |
Tests | 32 failed / 768 succeeded |
Started | |
Elapsed | 45m10s |
Revision | master |
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\sExternal\sStorage\s\[Driver\:\sebs\.csi\.aws\.com\]\s\[Testpattern\:\sDynamic\sPV\s\(default\sfs\)\]\sfsgroupchangepolicy\s\(OnRootMismatch\)\[LinuxOnly\]\,\spod\screated\swith\san\sinitial\sfsgroup\,\snew\spod\sfsgroup\sapplied\sto\svolume\scontents$'
test/e2e/storage/testsuites/fsgroupchangepolicy.go:216 Jan 21 17:44:04.336: Unexpected error: <*errors.errorString | 0xc002a30f60>: { s: "pod \"pod-fe7c6a63-1f80-4b91-ac3a-2dfe1958668a\" is not Running: timed out waiting for the condition", } pod "pod-fe7c6a63-1f80-4b91-ac3a-2dfe1958668a" is not Running: timed out waiting for the condition occurred test/e2e/storage/testsuites/fsgroupchangepolicy.go:264from junit_01.xml
[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy test/e2e/storage/framework/testsuite.go:51 [BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy test/e2e/framework/framework.go:187 �[1mSTEP�[0m: Creating a kubernetes client Jan 21 17:39:01.315: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename fsgroupchangepolicy �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace [It] (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents test/e2e/storage/testsuites/fsgroupchangepolicy.go:216 Jan 21 17:39:02.820: INFO: Creating resource for dynamic PV Jan 21 17:39:02.820: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} �[1mSTEP�[0m: creating a StorageClass fsgroupchangepolicy-8614-e2e-sc8xp47 �[1mSTEP�[0m: creating a claim Jan 21 17:39:03.039: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil �[1mSTEP�[0m: Creating Pod in namespace fsgroupchangepolicy-8614 with fsgroup 1000 Jan 21 17:44:04.336: FAIL: Unexpected error: <*errors.errorString | 0xc002a30f60>: { s: "pod \"pod-fe7c6a63-1f80-4b91-ac3a-2dfe1958668a\" is not Running: timed out waiting for the condition", } pod "pod-fe7c6a63-1f80-4b91-ac3a-2dfe1958668a" is not Running: timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/storage/testsuites.createPodAndVerifyContentGid(0xc0038e0300, 0xc0028c1060, 0x1, {0x0, 0x0}, {0x0, 0x0}) test/e2e/storage/testsuites/fsgroupchangepolicy.go:264 +0x151 k8s.io/kubernetes/test/e2e/storage/testsuites.(*fsGroupChangePolicyTestSuite).DefineTests.func3() test/e2e/storage/testsuites/fsgroupchangepolicy.go:235 +0x298 k8s.io/kubernetes/test/e2e.RunE2ETests(0x25761d7?) test/e2e/e2e.go:130 +0x6bb k8s.io/kubernetes/test/e2e.TestE2E(0x0?) test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc00097ed00, 0x741f9a8) /usr/local/go/src/testing/testing.go:1446 +0x10b created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1493 +0x35f �[1mSTEP�[0m: Deleting pvc Jan 21 17:44:04.767: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.comt28qq" Jan 21 17:44:04.984: INFO: Waiting up to 3m0s for PersistentVolume pvc-a83809dc-9682-437d-a758-d8c2dd3a898d to get deleted Jan 21 17:44:05.199: INFO: PersistentVolume pvc-a83809dc-9682-437d-a758-d8c2dd3a898d found and phase=Bound (215.002672ms) Jan 21 17:44:10.414: INFO: PersistentVolume pvc-a83809dc-9682-437d-a758-d8c2dd3a898d found and phase=Bound (5.430266348s) Jan 21 17:44:15.632: INFO: PersistentVolume pvc-a83809dc-9682-437d-a758-d8c2dd3a898d found and phase=Bound (10.648375539s) Jan 21 17:44:20.851: INFO: PersistentVolume pvc-a83809dc-9682-437d-a758-d8c2dd3a898d found and phase=Bound (15.867283749s) Jan 21 17:44:26.071: INFO: PersistentVolume pvc-a83809dc-9682-437d-a758-d8c2dd3a898d found and phase=Bound (21.086555573s) Jan 21 17:44:31.289: INFO: PersistentVolume pvc-a83809dc-9682-437d-a758-d8c2dd3a898d found and phase=Bound (26.30484742s) Jan 21 17:44:36.505: INFO: PersistentVolume pvc-a83809dc-9682-437d-a758-d8c2dd3a898d found and phase=Bound (31.52147318s) Jan 21 17:44:41.725: INFO: PersistentVolume pvc-a83809dc-9682-437d-a758-d8c2dd3a898d found and phase=Bound (36.741128739s) Jan 21 17:44:46.941: INFO: PersistentVolume pvc-a83809dc-9682-437d-a758-d8c2dd3a898d found and phase=Bound (41.956886649s) Jan 21 17:44:52.157: INFO: PersistentVolume pvc-a83809dc-9682-437d-a758-d8c2dd3a898d found and phase=Bound (47.173192558s) Jan 21 17:44:57.374: INFO: PersistentVolume pvc-a83809dc-9682-437d-a758-d8c2dd3a898d found and phase=Bound (52.389511504s) Jan 21 17:45:02.589: INFO: PersistentVolume pvc-a83809dc-9682-437d-a758-d8c2dd3a898d found and phase=Bound (57.605341416s) Jan 21 17:45:07.805: INFO: PersistentVolume pvc-a83809dc-9682-437d-a758-d8c2dd3a898d found and phase=Bound (1m2.820680431s) Jan 21 17:45:13.020: INFO: PersistentVolume pvc-a83809dc-9682-437d-a758-d8c2dd3a898d found and phase=Bound (1m8.035907641s) Jan 21 17:45:18.235: INFO: PersistentVolume pvc-a83809dc-9682-437d-a758-d8c2dd3a898d found and phase=Bound (1m13.251316859s) Jan 21 17:45:23.451: INFO: PersistentVolume pvc-a83809dc-9682-437d-a758-d8c2dd3a898d found and phase=Bound (1m18.46747221s) Jan 21 17:45:28.668: INFO: PersistentVolume pvc-a83809dc-9682-437d-a758-d8c2dd3a898d found and phase=Bound (1m23.683859238s) Jan 21 17:45:33.884: INFO: PersistentVolume pvc-a83809dc-9682-437d-a758-d8c2dd3a898d found and phase=Bound (1m28.900170214s) Jan 21 17:45:39.100: INFO: PersistentVolume pvc-a83809dc-9682-437d-a758-d8c2dd3a898d found and phase=Bound (1m34.116309331s) Jan 21 17:45:44.316: INFO: PersistentVolume pvc-a83809dc-9682-437d-a758-d8c2dd3a898d found and phase=Bound (1m39.331727725s) Jan 21 17:45:49.532: INFO: PersistentVolume pvc-a83809dc-9682-437d-a758-d8c2dd3a898d found and phase=Bound (1m44.5482896s) Jan 21 17:45:54.750: INFO: PersistentVolume pvc-a83809dc-9682-437d-a758-d8c2dd3a898d found and phase=Bound (1m49.765789077s) Jan 21 17:45:59.965: INFO: PersistentVolume pvc-a83809dc-9682-437d-a758-d8c2dd3a898d found and phase=Bound (1m54.981131071s) Jan 21 17:46:05.180: INFO: PersistentVolume pvc-a83809dc-9682-437d-a758-d8c2dd3a898d found and phase=Bound (2m0.196458591s) Jan 21 17:46:10.399: INFO: PersistentVolume pvc-a83809dc-9682-437d-a758-d8c2dd3a898d found and phase=Bound (2m5.415360071s) Jan 21 17:46:15.618: INFO: PersistentVolume pvc-a83809dc-9682-437d-a758-d8c2dd3a898d found and phase=Bound (2m10.633506451s) Jan 21 17:46:20.834: INFO: PersistentVolume pvc-a83809dc-9682-437d-a758-d8c2dd3a898d found and phase=Bound (2m15.849704966s) Jan 21 17:46:26.050: INFO: PersistentVolume pvc-a83809dc-9682-437d-a758-d8c2dd3a898d found and phase=Bound (2m21.065639196s) Jan 21 17:46:31.268: INFO: PersistentVolume pvc-a83809dc-9682-437d-a758-d8c2dd3a898d found and phase=Bound (2m26.283895135s) Jan 21 17:46:36.484: INFO: PersistentVolume pvc-a83809dc-9682-437d-a758-d8c2dd3a898d found and phase=Bound (2m31.499628593s) Jan 21 17:46:41.703: INFO: PersistentVolume pvc-a83809dc-9682-437d-a758-d8c2dd3a898d found and phase=Bound (2m36.719291739s) Jan 21 17:46:46.919: INFO: PersistentVolume pvc-a83809dc-9682-437d-a758-d8c2dd3a898d found and phase=Bound (2m41.935217186s) Jan 21 17:46:52.135: INFO: PersistentVolume pvc-a83809dc-9682-437d-a758-d8c2dd3a898d found and phase=Bound (2m47.151264017s) Jan 21 17:46:57.351: INFO: PersistentVolume pvc-a83809dc-9682-437d-a758-d8c2dd3a898d found and phase=Bound (2m52.36699887s) Jan 21 17:47:02.567: INFO: PersistentVolume pvc-a83809dc-9682-437d-a758-d8c2dd3a898d found and phase=Bound (2m57.58253947s) �[1mSTEP�[0m: Deleting sc Jan 21 17:47:07.783: FAIL: while cleanup resource Unexpected error: <errors.aggregate | len:1, cap:1>: [ [ { msg: "persistent Volume pvc-a83809dc-9682-437d-a758-d8c2dd3a898d not deleted by dynamic provisioner: PersistentVolume pvc-a83809dc-9682-437d-a758-d8c2dd3a898d still exists within 3m0s", err: { s: "PersistentVolume pvc-a83809dc-9682-437d-a758-d8c2dd3a898d still exists within 3m0s", }, }, ], ] persistent Volume pvc-a83809dc-9682-437d-a758-d8c2dd3a898d not deleted by dynamic provisioner: PersistentVolume pvc-a83809dc-9682-437d-a758-d8c2dd3a898d still exists within 3m0s occurred Full Stack Trace k8s.io/kubernetes/test/e2e/storage/testsuites.(*fsGroupChangePolicyTestSuite).DefineTests.func2() test/e2e/storage/testsuites/fsgroupchangepolicy.go:134 +0x24c panic({0x6ccb940, 0xc0030cdb00}) /usr/local/go/src/runtime/panic.go:884 +0x212 k8s.io/kubernetes/test/e2e/framework/ginkgowrapper.Fail.func1() test/e2e/framework/ginkgowrapper/wrapper.go:63 +0x7d panic({0x63535e0, 0x7a2fa70}) /usr/local/go/src/runtime/panic.go:884 +0x212 k8s.io/kubernetes/test/e2e/framework/ginkgowrapper.Fail({0xc003674140, 0x13b}, {0xc0028c0d28?, 0x7170289?, 0xc0028c0d48?}) test/e2e/framework/ginkgowrapper/wrapper.go:67 +0x197 k8s.io/kubernetes/test/e2e/framework.Fail({0xc003674000, 0x126}, {0xc002ee2c30?, 0xc003674000?, 0xc0032fe1a0?}) test/e2e/framework/log.go:63 +0x145 k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion.(*Assertion).match(0xc0028c0e90, {0x7a5a5b8, 0xa705d80}, 0x0, {0x0, 0x0, 0x0}) vendor/github.com/onsi/gomega/internal/assertion/assertion.go:79 +0x1bd k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion.(*Assertion).NotTo(0xc0028c0e90, {0x7a5a5b8, 0xa705d80}, {0x0, 0x0, 0x0}) vendor/github.com/onsi/gomega/internal/assertion/assertion.go:48 +0x92 k8s.io/kubernetes/test/e2e/framework.ExpectNoErrorWithOffset(0x7aa8fd8?, {0x7a339c0?, 0xc002a30f60?}, {0x0?, 0x2?, 0x7f44750933c8?}) test/e2e/framework/expect.go:46 +0x9d k8s.io/kubernetes/test/e2e/framework.ExpectNoError(...) test/e2e/framework/expect.go:40 k8s.io/kubernetes/test/e2e/storage/testsuites.createPodAndVerifyContentGid(0xc0038e0300, 0xc0028c1060, 0x1, {0x0, 0x0}, {0x0, 0x0}) test/e2e/storage/testsuites/fsgroupchangepolicy.go:264 +0x151 k8s.io/kubernetes/test/e2e/storage/testsuites.(*fsGroupChangePolicyTestSuite).DefineTests.func3() test/e2e/storage/testsuites/fsgroupchangepolicy.go:235 +0x298 k8s.io/kubernetes/test/e2e.RunE2ETests(0x25761d7?) test/e2e/e2e.go:130 +0x6bb k8s.io/kubernetes/test/e2e.TestE2E(0x0?) test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc00097ed00, 0x741f9a8) /usr/local/go/src/testing/testing.go:1446 +0x10b created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1493 +0x35f [AfterEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy test/e2e/framework/framework.go:188 �[1mSTEP�[0m: Collecting events from namespace "fsgroupchangepolicy-8614". �[1mSTEP�[0m: Found 16 events. Jan 21 17:47:08.000: INFO: At 2023-01-21 17:39:03 +0000 UTC - event for ebs.csi.aws.comt28qq: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding Jan 21 17:47:08.000: INFO: At 2023-01-21 17:39:03 +0000 UTC - event for ebs.csi.aws.comt28qq: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "ebs.csi.aws.com" or manually created by system administrator Jan 21 17:47:08.000: INFO: At 2023-01-21 17:39:03 +0000 UTC - event for ebs.csi.aws.comt28qq: {ebs.csi.aws.com_i-089df1bd1599c9fac_03469ea2-d998-4877-9ae8-7d6c7d24e21a } Provisioning: External provisioner is provisioning volume for claim "fsgroupchangepolicy-8614/ebs.csi.aws.comt28qq" Jan 21 17:47:08.000: INFO: At 2023-01-21 17:39:06 +0000 UTC - event for ebs.csi.aws.comt28qq: {ebs.csi.aws.com_i-089df1bd1599c9fac_03469ea2-d998-4877-9ae8-7d6c7d24e21a } ProvisioningSucceeded: Successfully provisioned volume pvc-a83809dc-9682-437d-a758-d8c2dd3a898d Jan 21 17:47:08.000: INFO: At 2023-01-21 17:39:07 +0000 UTC - event for pod-fe7c6a63-1f80-4b91-ac3a-2dfe1958668a: {default-scheduler } Scheduled: Successfully assigned fsgroupchangepolicy-8614/pod-fe7c6a63-1f80-4b91-ac3a-2dfe1958668a to i-0c9a59753149775ab Jan 21 17:47:08.000: INFO: At 2023-01-21 17:39:09 +0000 UTC - event for pod-fe7c6a63-1f80-4b91-ac3a-2dfe1958668a: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-a83809dc-9682-437d-a758-d8c2dd3a898d" Jan 21 17:47:08.000: INFO: At 2023-01-21 17:39:18 +0000 UTC - event for pod-fe7c6a63-1f80-4b91-ac3a-2dfe1958668a: {kubelet i-0c9a59753149775ab} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "31ba2863ff376e88e3d9fc7cf9d149232a11c3a2e5270fa9bbc1fce0a2e28938": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:47:08.000: INFO: At 2023-01-21 17:39:31 +0000 UTC - event for pod-fe7c6a63-1f80-4b91-ac3a-2dfe1958668a: {kubelet i-0c9a59753149775ab} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a38043c6cb0358fbb37ee627073408dbebbe69f7d021dabd96a5ec5ebe9e1878": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:47:08.000: INFO: At 2023-01-21 17:39:45 +0000 UTC - event for pod-fe7c6a63-1f80-4b91-ac3a-2dfe1958668a: {kubelet i-0c9a59753149775ab} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a1e4bfb2c4be4139259d0f98b8d8e9751d9fd8a45d5ba1fe0d82227f851864e7": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:47:08.000: INFO: At 2023-01-21 17:40:00 +0000 UTC - event for pod-fe7c6a63-1f80-4b91-ac3a-2dfe1958668a: {kubelet i-0c9a59753149775ab} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "71313e87e8d9cc30f1932885315cb42e36dee7439c5e4254d3e2e76ac689da4d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:47:08.000: INFO: At 2023-01-21 17:40:11 +0000 UTC - event for pod-fe7c6a63-1f80-4b91-ac3a-2dfe1958668a: {kubelet i-0c9a59753149775ab} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "50f48828a990ddd041c97515b78eedfeb96fe201560ecd53de296ef91df29eb0": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:47:08.000: INFO: At 2023-01-21 17:40:22 +0000 UTC - event for pod-fe7c6a63-1f80-4b91-ac3a-2dfe1958668a: {kubelet i-0c9a59753149775ab} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "5cef84da3aab5191b9b915d38e55020256686a92aa57f3ee31c548027b0403ca": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:47:08.000: INFO: At 2023-01-21 17:40:36 +0000 UTC - event for pod-fe7c6a63-1f80-4b91-ac3a-2dfe1958668a: {kubelet i-0c9a59753149775ab} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "c2cf406213d415596df4e46993d823988d9621cfbe5054032a530466cb42febd": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:47:08.000: INFO: At 2023-01-21 17:40:47 +0000 UTC - event for pod-fe7c6a63-1f80-4b91-ac3a-2dfe1958668a: {kubelet i-0c9a59753149775ab} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "77cf616ae5361da6b4a8cb9b645fb3b4f5549b03cbd4b944c8e70a478c3147ee": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:47:08.000: INFO: At 2023-01-21 17:41:01 +0000 UTC - event for pod-fe7c6a63-1f80-4b91-ac3a-2dfe1958668a: {kubelet i-0c9a59753149775ab} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a60b73586a216d8acf21be32a9d028d8f5deadce8d757713239f7b1e62a4199d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:47:08.000: INFO: At 2023-01-21 17:41:12 +0000 UTC - event for pod-fe7c6a63-1f80-4b91-ac3a-2dfe1958668a: {kubelet i-0c9a59753149775ab} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "171639e58b23994f561615996c2b54a0feb465cbff67b1b69c72bb6cc20c251b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:47:08.215: INFO: POD NODE PHASE GRACE CONDITIONS Jan 21 17:47:08.215: INFO: pod-fe7c6a63-1f80-4b91-ac3a-2dfe1958668a i-0c9a59753149775ab Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:39:07 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:39:07 +0000 UTC ContainersNotReady containers with unready status: [write-pod]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:39:07 +0000 UTC ContainersNotReady containers with unready status: [write-pod]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:39:07 +0000 UTC }] Jan 21 17:47:08.215: INFO: Jan 21 17:47:08.432: INFO: Unable to fetch fsgroupchangepolicy-8614/pod-fe7c6a63-1f80-4b91-ac3a-2dfe1958668a/write-pod logs: the server rejected our request for an unknown reason (get pods pod-fe7c6a63-1f80-4b91-ac3a-2dfe1958668a) Jan 21 17:47:08.648: INFO: Logging node info for node i-03775830c60663d32 Jan 21 17:47:08.864: INFO: Node Info: &Node{ObjectMeta:{i-03775830c60663d32 7e863bb0-bd92-4fd6-abc2-40d9e11317f1 30913 0 2023-01-21 17:22:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-southeast-1 failure-domain.beta.kubernetes.io/zone:ap-southeast-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-03775830c60663d32 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-southeast-1a topology.hostpath.csi/node:i-03775830c60663d32 topology.kubernetes.io/region:ap-southeast-1 topology.kubernetes.io/zone:ap-southeast-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.55.172 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-03775830c60663d32"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-21 17:37:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-21 17:43:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-southeast-1a/i-03775830c60663d32,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078252032 0} {<nil>} 3982668Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973394432 0} {<nil>} 3880268Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 17:43:21 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 17:43:21 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 17:43:21 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 17:43:21 +0000 UTC,LastTransitionTime:2023-01-21 17:23:06 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.55.172,},NodeAddress{Type:ExternalIP,Address:13.229.107.111,},NodeAddress{Type:InternalDNS,Address:i-03775830c60663d32.ap-southeast-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-03775830c60663d32.ap-southeast-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-229-107-111.ap-southeast-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec283bf7e7ad98bfb3e8e233a27b8209,SystemUUID:ec283bf7-e7ad-98bf-b3e8-e233a27b8209,BootID:a0bdbc5b-a9a7-47cf-88a5-9de3c7f8b2ce,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.24.10,KubeProxyVersion:v1.24.10,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.24.10],SizeBytes:112211511,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa k8s.gcr.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb k8s.gcr.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 k8s.gcr.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a k8s.gcr.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 k8s.gcr.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 k8s.gcr.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f k8s.gcr.io/e2e-test-images/nginx:1.15-2],SizeBytes:7000509,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7],SizeBytes:311278,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 21 17:47:08.864: INFO: Logging kubelet events for node i-03775830c60663d32 Jan 21 17:47:09.081: INFO: Logging pods the kubelet thinks is on node i-03775830c60663d32 Jan 21 17:47:09.518: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-tfbvc started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:09.519: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:47:09.519: INFO: hostexec-i-03775830c60663d32-5pm8v started at 2023-01-21 17:47:04 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:09.519: INFO: Container agnhost-container ready: true, restart count 0 Jan 21 17:47:09.519: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-49cq9 started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:09.519: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:47:09.519: INFO: ebs-csi-node-lsgbl started at 2023-01-21 17:22:46 +0000 UTC (0+3 container statuses recorded) Jan 21 17:47:09.519: INFO: Container ebs-plugin ready: true, restart count 0 Jan 21 17:47:09.519: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:47:09.519: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 21 17:47:09.519: INFO: cilium-2tq4w started at 2023-01-21 17:22:46 +0000 UTC (1+1 container statuses recorded) Jan 21 17:47:09.519: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 21 17:47:09.519: INFO: Container cilium-agent ready: true, restart count 0 Jan 21 17:47:09.519: INFO: test-pod started at 2023-01-21 17:47:09 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:09.519: INFO: Container nginx ready: false, restart count 0 Jan 21 17:47:09.519: INFO: hostexec-i-03775830c60663d32-h4jm4 started at 2023-01-21 17:45:03 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:09.519: INFO: Container agnhost-container ready: true, restart count 0 Jan 21 17:47:09.519: INFO: netserver-0 started at 2023-01-21 17:45:12 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:09.519: INFO: Container webserver ready: false, restart count 0 Jan 21 17:47:09.519: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-m9bgz started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:09.519: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:47:09.519: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-vjvht started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:09.519: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:47:09.519: INFO: pod-projected-secrets-0da06512-5c21-4d72-a2c9-3392bd5c6e89 started at 2023-01-21 17:44:29 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:09.519: INFO: Container secret-volume-test ready: false, restart count 0 Jan 21 17:47:09.519: INFO: termination-message-containerf7a29c43-fda8-453c-8178-763ce83a42aa started at 2023-01-21 17:45:05 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:09.519: INFO: Container termination-message-container ready: false, restart count 0 Jan 21 17:47:09.519: INFO: pod-a138f362-77a8-42b7-be7c-81ec30a1b470 started at 2023-01-21 17:45:08 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:09.519: INFO: Container write-pod ready: false, restart count 0 Jan 21 17:47:09.519: INFO: netserver-0 started at 2023-01-21 17:44:45 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:09.519: INFO: Container webserver ready: false, restart count 0 Jan 21 17:47:09.519: INFO: netserver-0 started at 2023-01-21 17:44:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:09.519: INFO: Container webserver ready: false, restart count 0 Jan 21 17:47:09.519: INFO: externalname-service-2dzs9 started at 2023-01-21 17:44:17 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:09.519: INFO: Container externalname-service ready: false, restart count 0 Jan 21 17:47:09.519: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-f7vgb started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:09.519: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:47:09.519: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-8vz56 started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:09.519: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:47:09.519: INFO: rs-gqcsw started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:09.519: INFO: Container donothing ready: false, restart count 0 Jan 21 17:47:09.519: INFO: security-context-438aba9f-ab6c-4a18-8b67-6b803986e06f started at 2023-01-21 17:44:07 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:09.519: INFO: Container test-container ready: false, restart count 0 Jan 21 17:47:09.519: INFO: rs-6zfxj started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:09.519: INFO: Container donothing ready: false, restart count 0 Jan 21 17:47:09.519: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-nwcqs started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:09.519: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:47:09.519: INFO: rs-8t6wd started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:09.519: INFO: Container donothing ready: true, restart count 0 Jan 21 17:47:09.519: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-g72gd started at 2023-01-21 17:37:50 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:09.519: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:47:09.519: INFO: sample-webhook-deployment-68c7bd4684-gmll7 started at 2023-01-21 17:44:17 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:09.519: INFO: Container sample-webhook ready: false, restart count 0 Jan 21 17:47:09.519: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-8b9jt started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:09.519: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:47:09.519: INFO: pod-projected-configmaps-4a3b7bfa-4656-4473-85e4-36e0b966a7cc started at 2023-01-21 17:45:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:09.519: INFO: Container agnhost-container ready: false, restart count 0 Jan 21 17:47:09.519: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-k4jpx started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:09.519: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:47:09.519: INFO: pod-with-prestop-exec-hook started at 2023-01-21 17:44:21 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:09.519: INFO: Container pod-with-prestop-exec-hook ready: false, restart count 0 Jan 21 17:47:09.519: INFO: termination-message-containerc3566fe9-0af4-4730-b56f-b8798d88d529 started at 2023-01-21 17:44:38 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:09.519: INFO: Container termination-message-container ready: false, restart count 0 Jan 21 17:47:10.324: INFO: Latency metrics for node i-03775830c60663d32 Jan 21 17:47:10.324: INFO: Logging node info for node i-089df1bd1599c9fac Jan 21 17:47:10.540: INFO: Node Info: &Node{ObjectMeta:{i-089df1bd1599c9fac 5933bf32-55e4-4bc6-811a-9ebde5df5619 31031 0 2023-01-21 17:20:48 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-southeast-1 failure-domain.beta.kubernetes.io/zone:ap-southeast-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-089df1bd1599c9fac kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:ap-southeast-1a topology.kubernetes.io/region:ap-southeast-1 topology.kubernetes.io/zone:ap-southeast-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.40.1 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-089df1bd1599c9fac"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-21 17:20:48 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-21 17:21:14 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:21:23 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:21:23 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 17:21:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-21 17:23:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-southeast-1a/i-089df1bd1599c9fac,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3889451008 0} {<nil>} 3798292Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3784593408 0} {<nil>} 3695892Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 17:43:38 +0000 UTC,LastTransitionTime:2023-01-21 17:20:46 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 17:43:38 +0000 UTC,LastTransitionTime:2023-01-21 17:20:46 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 17:43:38 +0000 UTC,LastTransitionTime:2023-01-21 17:20:46 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 17:43:38 +0000 UTC,LastTransitionTime:2023-01-21 17:21:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.40.1,},NodeAddress{Type:ExternalIP,Address:13.212.76.186,},NodeAddress{Type:InternalDNS,Address:i-089df1bd1599c9fac.ap-southeast-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-089df1bd1599c9fac.ap-southeast-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-212-76-186.ap-southeast-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec28683bad10cfdec8fa4bd6c22408b7,SystemUUID:ec28683b-ad10-cfde-c8fa-4bd6c22408b7,BootID:a32c6813-ffd6-4923-a901-e3a8658adebd,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.24.10,KubeProxyVersion:v1.24.10,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64@sha256:6db2761074bae8385aa601d4b45ab065893cfdc258d8b2593fc56698c44dbee5 k8s.gcr.io/kube-apiserver-amd64:v1.24.10 registry.k8s.io/kube-apiserver-amd64:v1.24.10],SizeBytes:131733971,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64@sha256:8867df47c332bae8dfd061b4d4230cd0febcc5a8a427ecb2e8f70b33ffc6d732 k8s.gcr.io/kube-controller-manager-amd64:v1.24.10 registry.k8s.io/kube-controller-manager-amd64:v1.24.10],SizeBytes:121342265,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.24.10],SizeBytes:112211511,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64@sha256:a589f10748fa227ea6ebf0730126f3f192cbdbb2c7f96a9d4685cabb86eb1cbc k8s.gcr.io/kube-scheduler-amd64:v1.24.10 registry.k8s.io/kube-scheduler-amd64:v1.24.10],SizeBytes:52751160,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-beta.2],SizeBytes:43191763,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-beta.2],SizeBytes:42821714,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:245e81c2ed53b5508a6f687f3ab0c724b9ab31e6a5fa5e6d2f814981ab6ce55f registry.k8s.io/provider-aws/cloud-controller-manager:v1.24.3],SizeBytes:18282737,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-beta.2],SizeBytes:4965793,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 21 17:47:10.540: INFO: Logging kubelet events for node i-089df1bd1599c9fac Jan 21 17:47:10.759: INFO: Logging pods the kubelet thinks is on node i-089df1bd1599c9fac Jan 21 17:47:10.982: INFO: ebs-csi-controller-779575c67d-scjvt started at 2023-01-21 17:21:19 +0000 UTC (0+5 container statuses recorded) Jan 21 17:47:10.982: INFO: Container csi-attacher ready: true, restart count 0 Jan 21 17:47:10.982: INFO: Container csi-provisioner ready: true, restart count 0 Jan 21 17:47:10.982: INFO: Container csi-resizer ready: true, restart count 0 Jan 21 17:47:10.982: INFO: Container ebs-plugin ready: true, restart count 0 Jan 21 17:47:10.982: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:47:10.982: INFO: kube-controller-manager-i-089df1bd1599c9fac started at 2023-01-21 17:20:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:10.982: INFO: Container kube-controller-manager ready: true, restart count 3 Jan 21 17:47:10.982: INFO: etcd-manager-events-i-089df1bd1599c9fac started at 2023-01-21 17:20:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:10.982: INFO: Container etcd-manager ready: true, restart count 0 Jan 21 17:47:10.982: INFO: etcd-manager-main-i-089df1bd1599c9fac started at 2023-01-21 17:20:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:10.982: INFO: Container etcd-manager ready: true, restart count 0 Jan 21 17:47:10.982: INFO: kops-controller-7fpkx started at 2023-01-21 17:21:18 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:10.982: INFO: Container kops-controller ready: true, restart count 0 Jan 21 17:47:10.982: INFO: ebs-csi-node-j7jjl started at 2023-01-21 17:21:19 +0000 UTC (0+3 container statuses recorded) Jan 21 17:47:10.982: INFO: Container ebs-plugin ready: true, restart count 0 Jan 21 17:47:10.982: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:47:10.982: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 21 17:47:10.982: INFO: dns-controller-7d4957564c-rk48f started at 2023-01-21 17:21:19 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:10.982: INFO: Container dns-controller ready: true, restart count 0 Jan 21 17:47:10.982: INFO: kube-scheduler-i-089df1bd1599c9fac started at 2023-01-21 17:20:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:10.982: INFO: Container kube-scheduler ready: true, restart count 0 Jan 21 17:47:10.982: INFO: kube-apiserver-i-089df1bd1599c9fac started at 2023-01-21 17:20:10 +0000 UTC (0+2 container statuses recorded) Jan 21 17:47:10.982: INFO: Container healthcheck ready: true, restart count 0 Jan 21 17:47:10.982: INFO: Container kube-apiserver ready: true, restart count 1 Jan 21 17:47:10.982: INFO: aws-cloud-controller-manager-lt9wb started at 2023-01-21 17:21:18 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:10.982: INFO: Container aws-cloud-controller-manager ready: true, restart count 0 Jan 21 17:47:10.982: INFO: cilium-nj7m8 started at 2023-01-21 17:21:19 +0000 UTC (1+1 container statuses recorded) Jan 21 17:47:10.982: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 21 17:47:10.982: INFO: Container cilium-agent ready: true, restart count 1 Jan 21 17:47:10.983: INFO: cilium-operator-8d8478c74-hpl2l started at 2023-01-21 17:21:19 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:10.983: INFO: Container cilium-operator ready: true, restart count 0 Jan 21 17:47:11.679: INFO: Latency metrics for node i-089df1bd1599c9fac Jan 21 17:47:11.679: INFO: Logging node info for node i-0c9a59753149775ab Jan 21 17:47:11.899: INFO: Node Info: &Node{ObjectMeta:{i-0c9a59753149775ab 5c157934-21a3-4b7b-9fa3-5c66b5b25ec5 31621 0 2023-01-21 17:22:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-southeast-1 failure-domain.beta.kubernetes.io/zone:ap-southeast-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0c9a59753149775ab kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-southeast-1a topology.hostpath.csi/node:i-0c9a59753149775ab topology.kubernetes.io/region:ap-southeast-1 topology.kubernetes.io/zone:ap-southeast-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.34.240 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-2289":"i-0c9a59753149775ab","ebs.csi.aws.com":"i-0c9a59753149775ab"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-21 17:37:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-21 17:39:09 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-21 17:39:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-southeast-1a/i-0c9a59753149775ab,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 17:44:24 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 17:44:24 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 17:44:24 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 17:44:24 +0000 UTC,LastTransitionTime:2023-01-21 17:23:06 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.34.240,},NodeAddress{Type:ExternalIP,Address:13.212.2.160,},NodeAddress{Type:InternalDNS,Address:i-0c9a59753149775ab.ap-southeast-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0c9a59753149775ab.ap-southeast-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-212-2-160.ap-southeast-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2610052ce207b4f84f50e9ba8d53ab,SystemUUID:ec261005-2ce2-07b4-f84f-50e9ba8d53ab,BootID:ff39a0e3-8cb1-4190-8b6d-8912e2826f9a,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.24.10,KubeProxyVersion:v1.24.10,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.24.10],SizeBytes:112211511,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa k8s.gcr.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb k8s.gcr.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 k8s.gcr.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a k8s.gcr.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 k8s.gcr.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 k8s.gcr.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f k8s.gcr.io/e2e-test-images/nginx:1.15-2],SizeBytes:7000509,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7],SizeBytes:311278,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-2289^c0d62f16-99b2-11ed-8b7e-4a565f54742c kubernetes.io/csi/ebs.csi.aws.com^vol-08c4c6da9de04f66c],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-08c4c6da9de04f66c,DevicePath:,},},Config:nil,},} Jan 21 17:47:11.899: INFO: Logging kubelet events for node i-0c9a59753149775ab Jan 21 17:47:12.116: INFO: Logging pods the kubelet thinks is on node i-0c9a59753149775ab Jan 21 17:47:12.344: INFO: pvc-volume-tester-n795w started at 2023-01-21 17:40:54 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:12.344: INFO: Container volume-tester ready: false, restart count 0 Jan 21 17:47:12.344: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-lwrkc started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:12.344: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:47:12.344: INFO: rs-mkvfg started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:12.344: INFO: Container donothing ready: false, restart count 0 Jan 21 17:47:12.344: INFO: pod-subpath-test-inlinevolume-gkbp started at 2023-01-21 17:45:21 +0000 UTC (1+1 container statuses recorded) Jan 21 17:47:12.344: INFO: Init container init-volume-inlinevolume-gkbp ready: false, restart count 0 Jan 21 17:47:12.344: INFO: Container test-container-subpath-inlinevolume-gkbp ready: false, restart count 0 Jan 21 17:47:12.344: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-s4jct started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:12.344: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:47:12.344: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-lhl2j started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:12.344: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:47:12.344: INFO: cilium-7h9rt started at 2023-01-21 17:22:46 +0000 UTC (1+1 container statuses recorded) Jan 21 17:47:12.344: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 21 17:47:12.344: INFO: Container cilium-agent ready: true, restart count 0 Jan 21 17:47:12.344: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-rvh9t started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:12.344: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:47:12.344: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-b7bsr started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:12.344: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:47:12.344: INFO: netserver-1 started at 2023-01-21 17:44:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:12.344: INFO: Container webserver ready: false, restart count 0 Jan 21 17:47:12.344: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-w47qr started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:12.344: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:47:12.344: INFO: rs-fjjf2 started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:12.344: INFO: Container donothing ready: false, restart count 0 Jan 21 17:47:12.344: INFO: csi-mockplugin-0 started at 2023-01-21 17:38:20 +0000 UTC (0+3 container statuses recorded) Jan 21 17:47:12.344: INFO: Container csi-provisioner ready: true, restart count 0 Jan 21 17:47:12.344: INFO: Container driver-registrar ready: true, restart count 0 Jan 21 17:47:12.344: INFO: Container mock ready: true, restart count 0 Jan 21 17:47:12.344: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-drmzt started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:12.344: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:47:12.344: INFO: local-injector started at 2023-01-21 17:43:51 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:12.344: INFO: Container local-injector ready: false, restart count 0 Jan 21 17:47:12.344: INFO: netserver-1 started at 2023-01-21 17:45:12 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:12.344: INFO: Container webserver ready: false, restart count 0 Jan 21 17:47:12.344: INFO: ebs-csi-node-vzcrc started at 2023-01-21 17:22:46 +0000 UTC (0+3 container statuses recorded) Jan 21 17:47:12.344: INFO: Container ebs-plugin ready: true, restart count 0 Jan 21 17:47:12.344: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:47:12.344: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 21 17:47:12.344: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-6hvtr started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:12.344: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:47:12.344: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-g9wzw started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:12.344: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:47:12.344: INFO: hostexec-i-0c9a59753149775ab-2lps6 started at 2023-01-21 17:47:08 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:12.344: INFO: Container agnhost-container ready: true, restart count 0 Jan 21 17:47:12.344: INFO: csi-mockplugin-attacher-0 started at 2023-01-21 17:38:21 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:12.344: INFO: Container csi-attacher ready: false, restart count 0 Jan 21 17:47:12.344: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-z9h5n started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:12.344: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:47:12.344: INFO: netserver-1 started at 2023-01-21 17:44:45 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:12.344: INFO: Container webserver ready: false, restart count 0 Jan 21 17:47:12.344: INFO: pod-handle-http-request started at 2023-01-21 17:39:27 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:12.344: INFO: Container agnhost-container ready: true, restart count 0 Jan 21 17:47:12.344: INFO: hostexec-i-0c9a59753149775ab-rxv2t started at 2023-01-21 17:43:28 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:12.344: INFO: Container agnhost-container ready: true, restart count 0 Jan 21 17:47:12.344: INFO: pod-fe7c6a63-1f80-4b91-ac3a-2dfe1958668a started at 2023-01-21 17:39:07 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:12.344: INFO: Container write-pod ready: false, restart count 0 Jan 21 17:47:13.102: INFO: Latency metrics for node i-0c9a59753149775ab Jan 21 17:47:13.102: INFO: Logging node info for node i-0d64fae545fa8bf3f Jan 21 17:47:13.318: INFO: Node Info: &Node{ObjectMeta:{i-0d64fae545fa8bf3f 77fc61e9-438c-4f3e-98aa-2b457c1202a0 31733 0 2023-01-21 17:22:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-southeast-1 failure-domain.beta.kubernetes.io/zone:ap-southeast-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0d64fae545fa8bf3f kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-southeast-1a topology.hostpath.csi/node:i-0d64fae545fa8bf3f topology.kubernetes.io/region:ap-southeast-1 topology.kubernetes.io/zone:ap-southeast-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.53.147 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-volume-expand-9636":"i-0d64fae545fa8bf3f","ebs.csi.aws.com":"i-0d64fae545fa8bf3f"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-21 17:37:47 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-21 17:44:29 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-21 17:44:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-southeast-1a/i-0d64fae545fa8bf3f,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 17:44:32 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 17:44:32 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 17:44:32 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 17:44:32 +0000 UTC,LastTransitionTime:2023-01-21 17:23:05 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.53.147,},NodeAddress{Type:ExternalIP,Address:13.229.75.189,},NodeAddress{Type:InternalDNS,Address:i-0d64fae545fa8bf3f.ap-southeast-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0d64fae545fa8bf3f.ap-southeast-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-229-75-189.ap-southeast-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2dfae26c309b0dd5a9ccb311cb6042,SystemUUID:ec2dfae2-6c30-9b0d-d5a9-ccb311cb6042,BootID:6e6cce59-de74-4521-b0ec-ab95e71b1046,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.24.10,KubeProxyVersion:v1.24.10,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.24.10],SizeBytes:112211511,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c k8s.gcr.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/sample-apiserver@sha256:f9c93b92b6ff750b41a93c4e4fe0bfe384597aeb841e2539d5444815c55b2d8f k8s.gcr.io/e2e-test-images/sample-apiserver:1.17.5],SizeBytes:24316368,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa k8s.gcr.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb k8s.gcr.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 k8s.gcr.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a k8s.gcr.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 k8s.gcr.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7],SizeBytes:311278,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-volume-expand-9636^40436064-99b3-11ed-aefe-f2f9c54a4473],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-volume-expand-9636^40436064-99b3-11ed-aefe-f2f9c54a4473,DevicePath:,},},Config:nil,},} Jan 21 17:47:13.318: INFO: Logging kubelet events for node i-0d64fae545fa8bf3f Jan 21 17:47:13.536: INFO: Logging pods the kubelet thinks is on node i-0d64fae545fa8bf3f Jan 21 17:47:13.762: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-gplfc started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:13.762: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:47:13.762: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-kprqk started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:13.762: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:47:13.762: INFO: netserver-2 started at 2023-01-21 17:45:12 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:13.762: INFO: Container webserver ready: false, restart count 0 Jan 21 17:47:13.762: INFO: netserver-2 started at 2023-01-21 17:44:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:13.762: INFO: Container webserver ready: false, restart count 0 Jan 21 17:47:13.762: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-hrf6g started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:13.762: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:47:13.762: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-nkjzz started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:13.762: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: false, restart count 0 Jan 21 17:47:13.762: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-857g9 started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:13.762: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:47:13.762: INFO: cilium-gv5dw started at 2023-01-21 17:22:46 +0000 UTC (1+1 container statuses recorded) Jan 21 17:47:13.762: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 21 17:47:13.762: INFO: Container cilium-agent ready: true, restart count 0 Jan 21 17:47:13.762: INFO: coredns-6dd78b7459-44jzj started at 2023-01-21 17:23:22 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:13.762: INFO: Container coredns ready: true, restart count 0 Jan 21 17:47:13.762: INFO: csi-hostpathplugin-0 started at 2023-01-21 17:44:10 +0000 UTC (0+7 container statuses recorded) Jan 21 17:47:13.762: INFO: Container csi-attacher ready: true, restart count 0 Jan 21 17:47:13.762: INFO: Container csi-provisioner ready: true, restart count 0 Jan 21 17:47:13.762: INFO: Container csi-resizer ready: true, restart count 0 Jan 21 17:47:13.762: INFO: Container csi-snapshotter ready: true, restart count 0 Jan 21 17:47:13.762: INFO: Container hostpath ready: true, restart count 0 Jan 21 17:47:13.762: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:47:13.762: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 21 17:47:13.762: INFO: netserver-2 started at 2023-01-21 17:44:45 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:13.762: INFO: Container webserver ready: false, restart count 0 Jan 21 17:47:13.762: INFO: csi-hostpathplugin-0 started at 2023-01-21 17:45:35 +0000 UTC (0+7 container statuses recorded) Jan 21 17:47:13.762: INFO: Container csi-attacher ready: false, restart count 0 Jan 21 17:47:13.762: INFO: Container csi-provisioner ready: false, restart count 0 Jan 21 17:47:13.762: INFO: Container csi-resizer ready: false, restart count 0 Jan 21 17:47:13.762: INFO: Container csi-snapshotter ready: false, restart count 0 Jan 21 17:47:13.762: INFO: Container hostpath ready: false, restart count 0 Jan 21 17:47:13.762: INFO: Container liveness-probe ready: false, restart count 0 Jan 21 17:47:13.762: INFO: Container node-driver-registrar ready: false, restart count 0 Jan 21 17:47:13.762: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-k5qhx started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:13.762: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:47:13.762: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-gj9hg started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:13.762: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:47:13.762: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-dhzrx started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:13.762: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:47:13.762: INFO: rs-rvl99 started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:13.762: INFO: Container donothing ready: false, restart count 0 Jan 21 17:47:13.762: INFO: pod-c4a96c13-73b3-4bb4-b100-d87d572fe413 started at 2023-01-21 17:44:29 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:13.762: INFO: Container write-pod ready: false, restart count 0 Jan 21 17:47:13.762: INFO: rs-cgktj started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:13.762: INFO: Container donothing ready: true, restart count 0 Jan 21 17:47:13.762: INFO: ebs-csi-node-k2jhx started at 2023-01-21 17:22:46 +0000 UTC (0+3 container statuses recorded) Jan 21 17:47:13.762: INFO: Container ebs-plugin ready: true, restart count 0 Jan 21 17:47:13.763: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:47:13.763: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 21 17:47:13.763: INFO: externalname-service-nz5lf started at 2023-01-21 17:44:17 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:13.763: INFO: Container externalname-service ready: false, restart count 0 Jan 21 17:47:13.763: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-fbjxh started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:13.763: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:47:13.763: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-zjvp4 started at 2023-01-21 17:37:50 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:13.763: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:47:14.529: INFO: Latency metrics for node i-0d64fae545fa8bf3f Jan 21 17:47:14.529: INFO: Logging node info for node i-0e989f541e95bf4a9 Jan 21 17:47:14.745: INFO: Node Info: &Node{ObjectMeta:{i-0e989f541e95bf4a9 bf125f17-fba9-4a1f-bf10-621d29cd68aa 30967 0 2023-01-21 17:22:44 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-southeast-1 failure-domain.beta.kubernetes.io/zone:ap-southeast-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0e989f541e95bf4a9 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-southeast-1a topology.hostpath.csi/node:i-0e989f541e95bf4a9 topology.kubernetes.io/region:ap-southeast-1 topology.kubernetes.io/zone:ap-southeast-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.55.136 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0e989f541e95bf4a9"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-21 17:22:44 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:22:44 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 17:22:44 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-21 17:22:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-21 17:22:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-21 17:37:47 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-21 17:38:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-southeast-1a/i-0e989f541e95bf4a9,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078206976 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973349376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 17:43:29 +0000 UTC,LastTransitionTime:2023-01-21 17:22:44 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 17:43:29 +0000 UTC,LastTransitionTime:2023-01-21 17:22:44 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 17:43:29 +0000 UTC,LastTransitionTime:2023-01-21 17:22:44 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 17:43:29 +0000 UTC,LastTransitionTime:2023-01-21 17:23:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.55.136,},NodeAddress{Type:ExternalIP,Address:13.212.153.84,},NodeAddress{Type:InternalDNS,Address:i-0e989f541e95bf4a9.ap-southeast-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0e989f541e95bf4a9.ap-southeast-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-212-153-84.ap-southeast-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec253ae18d864ba53e81f21cc4edca85,SystemUUID:ec253ae1-8d86-4ba5-3e81-f21cc4edca85,BootID:4abbb0c1-a455-4297-b376-571ca9fcdc78,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.24.10,KubeProxyVersion:v1.24.10,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.24.10],SizeBytes:112211511,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c k8s.gcr.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa k8s.gcr.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb k8s.gcr.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 k8s.gcr.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a k8s.gcr.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf k8s.gcr.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 k8s.gcr.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7],SizeBytes:311278,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 21 17:47:14.745: INFO: Logging kubelet events for node i-0e989f541e95bf4a9 Jan 21 17:47:14.963: INFO: Logging pods the kubelet thinks is on node i-0e989f541e95bf4a9 Jan 21 17:47:15.188: INFO: hostexec-i-0e989f541e95bf4a9-l5vnf started at 2023-01-21 17:44:08 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:15.188: INFO: Container agnhost-container ready: true, restart count 0 Jan 21 17:47:15.188: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-xtpv2 started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:15.188: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:47:15.188: INFO: coredns-6dd78b7459-m68gs started at 2023-01-21 17:23:04 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:15.188: INFO: Container coredns ready: true, restart count 0 Jan 21 17:47:15.188: INFO: pod-ca7f77c6-03f7-48db-ac18-47b4f6e40077 started at 2023-01-21 17:44:15 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:15.188: INFO: Container write-pod ready: false, restart count 0 Jan 21 17:47:15.188: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-ztjxc started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:15.188: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:47:15.188: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-nhfcv started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:15.188: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:47:15.188: INFO: coredns-autoscaler-5f76bf6c7b-lkrtx started at 2023-01-21 17:23:04 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:15.188: INFO: Container autoscaler ready: true, restart count 0 Jan 21 17:47:15.188: INFO: netserver-3 started at 2023-01-21 17:45:13 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:15.188: INFO: Container webserver ready: false, restart count 0 Jan 21 17:47:15.188: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-ndn5x started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:15.188: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:47:15.188: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-zrrqp started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:15.188: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:47:15.188: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-vj75s started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:15.188: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:47:15.188: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-s2hll started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:15.188: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:47:15.188: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-tz4hj started at 2023-01-21 17:37:50 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:15.188: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:47:15.188: INFO: ebs-csi-node-b9gk6 started at 2023-01-21 17:22:45 +0000 UTC (0+3 container statuses recorded) Jan 21 17:47:15.188: INFO: Container ebs-plugin ready: true, restart count 0 Jan 21 17:47:15.188: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:47:15.188: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 21 17:47:15.188: INFO: netserver-3 started at 2023-01-21 17:44:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:15.188: INFO: Container webserver ready: false, restart count 0 Jan 21 17:47:15.188: INFO: netserver-3 started at 2023-01-21 17:44:45 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:15.188: INFO: Container webserver ready: false, restart count 0 Jan 21 17:47:15.188: INFO: hostexec-i-0e989f541e95bf4a9-g7jqg started at 2023-01-21 17:44:18 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:15.188: INFO: Container agnhost-container ready: true, restart count 0 Jan 21 17:47:15.188: INFO: pod-49325389-814c-4807-8002-37e9e3cc1f79 started at 2023-01-21 17:44:23 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:15.188: INFO: Container write-pod ready: false, restart count 0 Jan 21 17:47:15.188: INFO: rs-d9mjn started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:15.188: INFO: Container donothing ready: false, restart count 0 Jan 21 17:47:15.188: INFO: rs-vk2fw started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:15.188: INFO: Container donothing ready: false, restart count 0 Jan 21 17:47:15.188: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-59wkt started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:15.188: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:47:15.188: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-h9gs9 started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:15.188: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:47:15.188: INFO: cilium-8cmqj started at 2023-01-21 17:22:45 +0000 UTC (1+1 container statuses recorded) Jan 21 17:47:15.188: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 21 17:47:15.188: INFO: Container cilium-agent ready: true, restart count 0 Jan 21 17:47:15.188: INFO: rs-r8h6b started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:47:15.188: INFO: Container donothing ready: false, restart count 0 Jan 21 17:47:15.908: INFO: Latency metrics for node i-0e989f541e95bf4a9 Jan 21 17:47:15.908: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "fsgroupchangepolicy-8614" for this suite.
Find pod-fe7c6a63-1f80-4b91-ac3a-2dfe1958668a mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\sshould\shonor\stimeout\s\[Conformance\]$'
test/e2e/apimachinery/webhook.go:89 Jan 21 17:49:18.336: waiting for the deployment status valid%!(EXTRA string=k8s.gcr.io/e2e-test-images/agnhost:2.39, string=sample-webhook-deployment, string=webhook-7976) Unexpected error: <*errors.errorString | 0xc00220ab70>: { s: "error waiting for deployment \"sample-webhook-deployment\" status to match expectation: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:\"Available\", Status:\"False\", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:\"MinimumReplicasUnavailable\", Message:\"Deployment does not have minimum availability.\"}, v1.DeploymentCondition{Type:\"Progressing\", Status:\"True\", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:\"ReplicaSetUpdated\", Message:\"ReplicaSet \\\"sample-webhook-deployment-68c7bd4684\\\" is progressing.\"}}, CollisionCount:(*int32)(nil)}", } error waiting for deployment "sample-webhook-deployment" status to match expectation: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} occurred test/e2e/apimachinery/webhook.go:826from junit_08.xml
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/framework/framework.go:187 �[1mSTEP�[0m: Creating a kubernetes client Jan 21 17:44:14.332: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename webhook �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/apimachinery/webhook.go:89 �[1mSTEP�[0m: Setting up server cert �[1mSTEP�[0m: Create role binding to let webhook read extension-apiserver-authentication �[1mSTEP�[0m: Deploying the webhook pod �[1mSTEP�[0m: Wait for the deployment to be ready Jan 21 17:44:17.906: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:44:20.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:44:22.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:44:24.123: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:44:26.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:44:28.123: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:44:30.124: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:44:32.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:44:34.123: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:44:36.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:44:38.123: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:44:40.123: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:44:42.123: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:44:44.123: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:44:46.123: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:44:48.123: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:44:50.123: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:44:52.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:44:54.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:44:56.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:44:58.125: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:45:00.123: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:45:02.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:45:04.123: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:45:06.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:45:08.123: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:45:10.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:45:12.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:45:14.123: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:45:16.123: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:45:18.123: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:45:20.123: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:45:22.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:45:24.123: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:45:26.123: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:45:28.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:45:30.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:45:32.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:45:34.123: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:45:36.123: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:45:38.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:45:40.123: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:45:42.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:45:44.123: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:45:46.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:45:48.128: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:45:50.121: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:45:52.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:45:54.123: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:45:56.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:45:58.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:46:00.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:46:02.123: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:46:04.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:46:06.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:46:08.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:46:10.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:46:12.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:46:14.123: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:46:16.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:46:18.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:46:20.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:46:22.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:46:24.123: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:46:26.123: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:46:28.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:46:30.123: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:46:32.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:46:34.123: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:46:36.123: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:46:38.123: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:46:40.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:46:42.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:46:44.123: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:46:46.123: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:46:48.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:46:50.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:46:52.121: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:46:54.121: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:46:56.123: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:46:58.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:47:00.123: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:47:02.123: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:47:04.123: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:47:06.123: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:47:08.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:47:10.127: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:47:12.121: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:47:14.123: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:47:16.121: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:47:18.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:47:20.123: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:47:22.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:47:24.123: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:47:26.126: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:47:28.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:47:30.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:47:32.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:47:34.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:47:36.123: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:47:38.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:47:40.123: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:47:42.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:47:44.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:47:46.123: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:47:48.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:47:50.126: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:47:52.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:47:54.123: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:47:56.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:47:58.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:48:00.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:48:02.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:48:04.123: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:48:06.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:48:08.123: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:48:10.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:48:12.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:48:14.125: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:48:16.123: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:48:18.123: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:48:20.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:48:22.121: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:48:24.123: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:48:26.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:48:28.121: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:48:30.121: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:48:32.121: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:48:34.121: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:48:36.123: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:48:38.121: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:48:40.121: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:48:42.121: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:48:44.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:48:46.121: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:48:48.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:48:50.121: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:48:52.121: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:48:54.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:48:56.121: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:48:58.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:49:00.121: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:49:02.121: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:49:04.121: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:49:06.121: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:49:08.121: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:49:10.138: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:49:12.122: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:49:14.121: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:49:16.123: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:49:18.121: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:49:18.336: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 21 17:49:18.336: FAIL: waiting for the deployment status valid%!(EXTRA string=k8s.gcr.io/e2e-test-images/agnhost:2.39, string=sample-webhook-deployment, string=webhook-7976) Unexpected error: <*errors.errorString | 0xc00220ab70>: { s: "error waiting for deployment \"sample-webhook-deployment\" status to match expectation: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:\"Available\", Status:\"False\", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:\"MinimumReplicasUnavailable\", Message:\"Deployment does not have minimum availability.\"}, v1.DeploymentCondition{Type:\"Progressing\", Status:\"True\", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:\"ReplicaSetUpdated\", Message:\"ReplicaSet \\\"sample-webhook-deployment-68c7bd4684\\\" is progressing.\"}}, CollisionCount:(*int32)(nil)}", } error waiting for deployment "sample-webhook-deployment" status to match expectation: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 17, 44, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-68c7bd4684\" is progressing."}}, CollisionCount:(*int32)(nil)} occurred Full Stack Trace k8s.io/kubernetes/test/e2e/apimachinery.deployWebhookAndService(0xc0012e5080, {0xc0059dda70, 0x27}, 0xc00178d540, 0x20fb, 0x20fc) test/e2e/apimachinery/webhook.go:826 +0xeb0 k8s.io/kubernetes/test/e2e/apimachinery.glob..func27.1() test/e2e/apimachinery/webhook.go:101 +0x226 k8s.io/kubernetes/test/e2e.RunE2ETests(0x25761d7?) test/e2e/e2e.go:130 +0x6bb k8s.io/kubernetes/test/e2e.TestE2E(0x24e52d9?) test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc000d581a0, 0x741f9a8) /usr/local/go/src/testing/testing.go:1446 +0x10b created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1493 +0x35f [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/framework/framework.go:188 �[1mSTEP�[0m: Collecting events from namespace "webhook-7976". �[1mSTEP�[0m: Found 13 events. Jan 21 17:49:18.551: INFO: At 2023-01-21 17:44:17 +0000 UTC - event for sample-webhook-deployment: {deployment-controller } ScalingReplicaSet: Scaled up replica set sample-webhook-deployment-68c7bd4684 to 1 Jan 21 17:49:18.551: INFO: At 2023-01-21 17:44:17 +0000 UTC - event for sample-webhook-deployment-68c7bd4684: {replicaset-controller } SuccessfulCreate: Created pod: sample-webhook-deployment-68c7bd4684-gmll7 Jan 21 17:49:18.551: INFO: At 2023-01-21 17:44:17 +0000 UTC - event for sample-webhook-deployment-68c7bd4684-gmll7: {kubelet i-03775830c60663d32} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "0dc1072b09eca15814f5ad3aee0f49875f55482cb9f8895e58c0c82a3a0ed0b9": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:18.551: INFO: At 2023-01-21 17:44:17 +0000 UTC - event for sample-webhook-deployment-68c7bd4684-gmll7: {default-scheduler } Scheduled: Successfully assigned webhook-7976/sample-webhook-deployment-68c7bd4684-gmll7 to i-03775830c60663d32 Jan 21 17:49:18.551: INFO: At 2023-01-21 17:44:31 +0000 UTC - event for sample-webhook-deployment-68c7bd4684-gmll7: {kubelet i-03775830c60663d32} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d53b650065501f3f5fbefbd1cf856f3a2d7e77f63bf252097c4eaa7bded49eea": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:18.552: INFO: At 2023-01-21 17:44:46 +0000 UTC - event for sample-webhook-deployment-68c7bd4684-gmll7: {kubelet i-03775830c60663d32} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e33387656b7a3a61de5596f0d18721e502e4343db64c5764f59c4e77a6840938": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:18.552: INFO: At 2023-01-21 17:44:58 +0000 UTC - event for sample-webhook-deployment-68c7bd4684-gmll7: {kubelet i-03775830c60663d32} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "f2292fe660b1e8e4f84ee061813e3960b515849211da42599049c34d1a2a0185": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:18.552: INFO: At 2023-01-21 17:45:12 +0000 UTC - event for sample-webhook-deployment-68c7bd4684-gmll7: {kubelet i-03775830c60663d32} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "c9efbd1c1c2b2b0ca2532a02b33a27ba96d9f96a2214e7fb37832e788b4e5022": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:18.552: INFO: At 2023-01-21 17:45:25 +0000 UTC - event for sample-webhook-deployment-68c7bd4684-gmll7: {kubelet i-03775830c60663d32} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "2837fcf5b88f597ae0f7a1fa4929bee91e61ac88f7105781629d2de43217582e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:18.552: INFO: At 2023-01-21 17:45:36 +0000 UTC - event for sample-webhook-deployment-68c7bd4684-gmll7: {kubelet i-03775830c60663d32} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "da0ada780d198a021e588783e60bbaf63c533d8bdd04153ed358fad3043abb11": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:18.552: INFO: At 2023-01-21 17:45:51 +0000 UTC - event for sample-webhook-deployment-68c7bd4684-gmll7: {kubelet i-03775830c60663d32} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "c20ee69b1b72540d95848237ae2e6e2aeb5a71a78999cdae7dc14fbb3d808056": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:18.552: INFO: At 2023-01-21 17:46:07 +0000 UTC - event for sample-webhook-deployment-68c7bd4684-gmll7: {kubelet i-03775830c60663d32} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "829ace81a20927025ec31a962cf6ad550bec564377991b07d551730a498140eb": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:18.552: INFO: At 2023-01-21 17:46:20 +0000 UTC - event for sample-webhook-deployment-68c7bd4684-gmll7: {kubelet i-03775830c60663d32} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ac74ce689cbd8fca8a017289fd61fe563850f7c8211b40f39e3d9af014c6af9d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:18.766: INFO: POD NODE PHASE GRACE CONDITIONS Jan 21 17:49:18.766: INFO: sample-webhook-deployment-68c7bd4684-gmll7 i-03775830c60663d32 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:44:17 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:44:17 +0000 UTC ContainersNotReady containers with unready status: [sample-webhook]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:44:17 +0000 UTC ContainersNotReady containers with unready status: [sample-webhook]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:44:17 +0000 UTC }] Jan 21 17:49:18.766: INFO: Jan 21 17:49:18.981: INFO: Unable to fetch webhook-7976/sample-webhook-deployment-68c7bd4684-gmll7/sample-webhook logs: the server rejected our request for an unknown reason (get pods sample-webhook-deployment-68c7bd4684-gmll7) Jan 21 17:49:19.197: INFO: Logging node info for node i-03775830c60663d32 Jan 21 17:49:19.411: INFO: Node Info: &Node{ObjectMeta:{i-03775830c60663d32 7e863bb0-bd92-4fd6-abc2-40d9e11317f1 33014 0 2023-01-21 17:22:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-southeast-1 failure-domain.beta.kubernetes.io/zone:ap-southeast-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-03775830c60663d32 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-southeast-1a topology.hostpath.csi/node:i-03775830c60663d32 topology.kubernetes.io/region:ap-southeast-1 topology.kubernetes.io/zone:ap-southeast-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.55.172 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-03775830c60663d32"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-21 17:37:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-21 17:47:21 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-21 17:47:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-southeast-1a/i-03775830c60663d32,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078252032 0} {<nil>} 3982668Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973394432 0} {<nil>} 3880268Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 17:47:26 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 17:47:26 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 17:47:26 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 17:47:26 +0000 UTC,LastTransitionTime:2023-01-21 17:23:06 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.55.172,},NodeAddress{Type:ExternalIP,Address:13.229.107.111,},NodeAddress{Type:InternalDNS,Address:i-03775830c60663d32.ap-southeast-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-03775830c60663d32.ap-southeast-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-229-107-111.ap-southeast-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec283bf7e7ad98bfb3e8e233a27b8209,SystemUUID:ec283bf7-e7ad-98bf-b3e8-e233a27b8209,BootID:a0bdbc5b-a9a7-47cf-88a5-9de3c7f8b2ce,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.24.10,KubeProxyVersion:v1.24.10,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.24.10],SizeBytes:112211511,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa k8s.gcr.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb k8s.gcr.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 k8s.gcr.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a k8s.gcr.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 k8s.gcr.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 k8s.gcr.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f k8s.gcr.io/e2e-test-images/nginx:1.15-2],SizeBytes:7000509,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7],SizeBytes:311278,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-05ce4ba3795a29b88],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-05ce4ba3795a29b88,DevicePath:,},},Config:nil,},} Jan 21 17:49:19.412: INFO: Logging kubelet events for node i-03775830c60663d32 Jan 21 17:49:19.628: INFO: Logging pods the kubelet thinks is on node i-03775830c60663d32 Jan 21 17:49:19.864: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-49cq9 started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:19.864: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:19.864: INFO: ebs-csi-node-lsgbl started at 2023-01-21 17:22:46 +0000 UTC (0+3 container statuses recorded) Jan 21 17:49:19.864: INFO: Container ebs-plugin ready: true, restart count 0 Jan 21 17:49:19.864: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:49:19.864: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 21 17:49:19.864: INFO: cilium-2tq4w started at 2023-01-21 17:22:46 +0000 UTC (1+1 container statuses recorded) Jan 21 17:49:19.864: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 21 17:49:19.864: INFO: Container cilium-agent ready: true, restart count 0 Jan 21 17:49:19.864: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-tfbvc started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:19.864: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:19.864: INFO: suspend-true-to-false-h2lzk started at 2023-01-21 17:48:40 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:19.864: INFO: Container c ready: false, restart count 0 Jan 21 17:49:19.864: INFO: pod-fa8f7974-7a8f-4d0a-a9f4-246237bfa8b6 started at 2023-01-21 17:49:16 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:19.864: INFO: Container write-pod ready: false, restart count 0 Jan 21 17:49:19.864: INFO: hostexec-i-03775830c60663d32-h4jm4 started at 2023-01-21 17:45:03 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:19.864: INFO: Container agnhost-container ready: true, restart count 0 Jan 21 17:49:19.864: INFO: netserver-0 started at 2023-01-21 17:45:12 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:19.864: INFO: Container webserver ready: false, restart count 0 Jan 21 17:49:19.864: INFO: hairpin started at 2023-01-21 17:47:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:19.864: INFO: Container agnhost-container ready: false, restart count 0 Jan 21 17:49:19.864: INFO: pod-projected-secrets-0da06512-5c21-4d72-a2c9-3392bd5c6e89 started at 2023-01-21 17:44:29 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:19.864: INFO: Container secret-volume-test ready: false, restart count 0 Jan 21 17:49:19.864: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-m9bgz started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:19.864: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:19.864: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-vjvht started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:19.864: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:19.864: INFO: netserver-0 started at 2023-01-21 17:44:45 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:19.864: INFO: Container webserver ready: true, restart count 0 Jan 21 17:49:19.864: INFO: netserver-0 started at 2023-01-21 17:44:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:19.864: INFO: Container webserver ready: false, restart count 0 Jan 21 17:49:19.864: INFO: termination-message-containerf7a29c43-fda8-453c-8178-763ce83a42aa started at 2023-01-21 17:45:05 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:19.864: INFO: Container termination-message-container ready: false, restart count 0 Jan 21 17:49:19.864: INFO: pod-a138f362-77a8-42b7-be7c-81ec30a1b470 started at 2023-01-21 17:45:08 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:19.864: INFO: Container write-pod ready: false, restart count 0 Jan 21 17:49:19.864: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-f7vgb started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:19.864: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:19.864: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-8vz56 started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:19.864: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:19.864: INFO: rs-gqcsw started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:19.864: INFO: Container donothing ready: false, restart count 0 Jan 21 17:49:19.864: INFO: externalname-service-2dzs9 started at 2023-01-21 17:44:17 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:19.864: INFO: Container externalname-service ready: false, restart count 0 Jan 21 17:49:19.864: INFO: pod-5c06b80d-aa28-4f8c-b34f-91a4e97e33ea started at 2023-01-21 17:47:19 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:19.864: INFO: Container write-pod ready: false, restart count 0 Jan 21 17:49:19.864: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-nwcqs started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:19.864: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:19.864: INFO: rs-6zfxj started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:19.864: INFO: Container donothing ready: false, restart count 0 Jan 21 17:49:19.864: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-g72gd started at 2023-01-21 17:37:50 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:19.864: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:19.864: INFO: sample-webhook-deployment-68c7bd4684-gmll7 started at 2023-01-21 17:44:17 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:19.864: INFO: Container sample-webhook ready: false, restart count 0 Jan 21 17:49:19.864: INFO: rs-8t6wd started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:19.864: INFO: Container donothing ready: true, restart count 0 Jan 21 17:49:19.864: INFO: pod-with-prestop-exec-hook started at 2023-01-21 17:44:21 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:19.864: INFO: Container pod-with-prestop-exec-hook ready: false, restart count 0 Jan 21 17:49:19.864: INFO: suspend-true-to-false-ctf95 started at 2023-01-21 17:48:40 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:19.864: INFO: Container c ready: false, restart count 0 Jan 21 17:49:19.864: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-8b9jt started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:19.864: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:19.864: INFO: hostexec-i-03775830c60663d32-8wzpb started at 2023-01-21 17:49:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:19.865: INFO: Container agnhost-container ready: true, restart count 0 Jan 21 17:49:19.865: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-k4jpx started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:19.865: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:20.782: INFO: Latency metrics for node i-03775830c60663d32 Jan 21 17:49:20.782: INFO: Logging node info for node i-089df1bd1599c9fac Jan 21 17:49:20.996: INFO: Node Info: &Node{ObjectMeta:{i-089df1bd1599c9fac 5933bf32-55e4-4bc6-811a-9ebde5df5619 33466 0 2023-01-21 17:20:48 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-southeast-1 failure-domain.beta.kubernetes.io/zone:ap-southeast-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-089df1bd1599c9fac kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:ap-southeast-1a topology.kubernetes.io/region:ap-southeast-1 topology.kubernetes.io/zone:ap-southeast-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.40.1 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-089df1bd1599c9fac"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-21 17:20:48 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-21 17:21:14 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:21:23 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:21:23 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 17:21:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-21 17:23:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-southeast-1a/i-089df1bd1599c9fac,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3889451008 0} {<nil>} 3798292Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3784593408 0} {<nil>} 3695892Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 17:48:44 +0000 UTC,LastTransitionTime:2023-01-21 17:20:46 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 17:48:44 +0000 UTC,LastTransitionTime:2023-01-21 17:20:46 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 17:48:44 +0000 UTC,LastTransitionTime:2023-01-21 17:20:46 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 17:48:44 +0000 UTC,LastTransitionTime:2023-01-21 17:21:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.40.1,},NodeAddress{Type:ExternalIP,Address:13.212.76.186,},NodeAddress{Type:InternalDNS,Address:i-089df1bd1599c9fac.ap-southeast-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-089df1bd1599c9fac.ap-southeast-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-212-76-186.ap-southeast-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec28683bad10cfdec8fa4bd6c22408b7,SystemUUID:ec28683b-ad10-cfde-c8fa-4bd6c22408b7,BootID:a32c6813-ffd6-4923-a901-e3a8658adebd,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.24.10,KubeProxyVersion:v1.24.10,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64@sha256:6db2761074bae8385aa601d4b45ab065893cfdc258d8b2593fc56698c44dbee5 k8s.gcr.io/kube-apiserver-amd64:v1.24.10 registry.k8s.io/kube-apiserver-amd64:v1.24.10],SizeBytes:131733971,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64@sha256:8867df47c332bae8dfd061b4d4230cd0febcc5a8a427ecb2e8f70b33ffc6d732 k8s.gcr.io/kube-controller-manager-amd64:v1.24.10 registry.k8s.io/kube-controller-manager-amd64:v1.24.10],SizeBytes:121342265,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.24.10],SizeBytes:112211511,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64@sha256:a589f10748fa227ea6ebf0730126f3f192cbdbb2c7f96a9d4685cabb86eb1cbc k8s.gcr.io/kube-scheduler-amd64:v1.24.10 registry.k8s.io/kube-scheduler-amd64:v1.24.10],SizeBytes:52751160,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-beta.2],SizeBytes:43191763,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-beta.2],SizeBytes:42821714,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:245e81c2ed53b5508a6f687f3ab0c724b9ab31e6a5fa5e6d2f814981ab6ce55f registry.k8s.io/provider-aws/cloud-controller-manager:v1.24.3],SizeBytes:18282737,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-beta.2],SizeBytes:4965793,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 21 17:49:20.997: INFO: Logging kubelet events for node i-089df1bd1599c9fac Jan 21 17:49:21.213: INFO: Logging pods the kubelet thinks is on node i-089df1bd1599c9fac Jan 21 17:49:21.435: INFO: kube-controller-manager-i-089df1bd1599c9fac started at 2023-01-21 17:20:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:21.435: INFO: Container kube-controller-manager ready: true, restart count 3 Jan 21 17:49:21.435: INFO: etcd-manager-events-i-089df1bd1599c9fac started at 2023-01-21 17:20:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:21.435: INFO: Container etcd-manager ready: true, restart count 0 Jan 21 17:49:21.435: INFO: etcd-manager-main-i-089df1bd1599c9fac started at 2023-01-21 17:20:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:21.435: INFO: Container etcd-manager ready: true, restart count 0 Jan 21 17:49:21.435: INFO: kops-controller-7fpkx started at 2023-01-21 17:21:18 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:21.435: INFO: Container kops-controller ready: true, restart count 0 Jan 21 17:49:21.435: INFO: ebs-csi-node-j7jjl started at 2023-01-21 17:21:19 +0000 UTC (0+3 container statuses recorded) Jan 21 17:49:21.435: INFO: Container ebs-plugin ready: true, restart count 0 Jan 21 17:49:21.435: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:49:21.435: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 21 17:49:21.435: INFO: ebs-csi-controller-779575c67d-scjvt started at 2023-01-21 17:21:19 +0000 UTC (0+5 container statuses recorded) Jan 21 17:49:21.435: INFO: Container csi-attacher ready: true, restart count 0 Jan 21 17:49:21.435: INFO: Container csi-provisioner ready: true, restart count 0 Jan 21 17:49:21.435: INFO: Container csi-resizer ready: true, restart count 0 Jan 21 17:49:21.435: INFO: Container ebs-plugin ready: true, restart count 0 Jan 21 17:49:21.435: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:49:21.435: INFO: kube-scheduler-i-089df1bd1599c9fac started at 2023-01-21 17:20:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:21.435: INFO: Container kube-scheduler ready: true, restart count 0 Jan 21 17:49:21.435: INFO: kube-apiserver-i-089df1bd1599c9fac started at 2023-01-21 17:20:10 +0000 UTC (0+2 container statuses recorded) Jan 21 17:49:21.435: INFO: Container healthcheck ready: true, restart count 0 Jan 21 17:49:21.435: INFO: Container kube-apiserver ready: true, restart count 1 Jan 21 17:49:21.435: INFO: aws-cloud-controller-manager-lt9wb started at 2023-01-21 17:21:18 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:21.435: INFO: Container aws-cloud-controller-manager ready: true, restart count 0 Jan 21 17:49:21.435: INFO: cilium-nj7m8 started at 2023-01-21 17:21:19 +0000 UTC (1+1 container statuses recorded) Jan 21 17:49:21.435: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 21 17:49:21.435: INFO: Container cilium-agent ready: true, restart count 1 Jan 21 17:49:21.435: INFO: cilium-operator-8d8478c74-hpl2l started at 2023-01-21 17:21:19 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:21.435: INFO: Container cilium-operator ready: true, restart count 0 Jan 21 17:49:21.435: INFO: dns-controller-7d4957564c-rk48f started at 2023-01-21 17:21:19 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:21.435: INFO: Container dns-controller ready: true, restart count 0 Jan 21 17:49:22.128: INFO: Latency metrics for node i-089df1bd1599c9fac Jan 21 17:49:22.128: INFO: Logging node info for node i-0c9a59753149775ab Jan 21 17:49:22.344: INFO: Node Info: &Node{ObjectMeta:{i-0c9a59753149775ab 5c157934-21a3-4b7b-9fa3-5c66b5b25ec5 33220 0 2023-01-21 17:22:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-southeast-1 failure-domain.beta.kubernetes.io/zone:ap-southeast-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0c9a59753149775ab kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-southeast-1a topology.hostpath.csi/node:i-0c9a59753149775ab topology.kubernetes.io/region:ap-southeast-1 topology.kubernetes.io/zone:ap-southeast-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.34.240 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0c9a59753149775ab"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-21 17:37:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-21 17:47:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-southeast-1a/i-0c9a59753149775ab,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 17:47:38 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 17:47:38 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 17:47:38 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 17:47:38 +0000 UTC,LastTransitionTime:2023-01-21 17:23:06 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.34.240,},NodeAddress{Type:ExternalIP,Address:13.212.2.160,},NodeAddress{Type:InternalDNS,Address:i-0c9a59753149775ab.ap-southeast-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0c9a59753149775ab.ap-southeast-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-212-2-160.ap-southeast-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2610052ce207b4f84f50e9ba8d53ab,SystemUUID:ec261005-2ce2-07b4-f84f-50e9ba8d53ab,BootID:ff39a0e3-8cb1-4190-8b6d-8912e2826f9a,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.24.10,KubeProxyVersion:v1.24.10,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.24.10],SizeBytes:112211511,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa k8s.gcr.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb k8s.gcr.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 k8s.gcr.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a k8s.gcr.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 k8s.gcr.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 k8s.gcr.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f k8s.gcr.io/e2e-test-images/nginx:1.15-2],SizeBytes:7000509,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7],SizeBytes:311278,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 21 17:49:22.344: INFO: Logging kubelet events for node i-0c9a59753149775ab Jan 21 17:49:22.561: INFO: Logging pods the kubelet thinks is on node i-0c9a59753149775ab Jan 21 17:49:22.784: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-6hvtr started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:22.784: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:22.784: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-g9wzw started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:22.784: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:22.784: INFO: netserver-1 started at 2023-01-21 17:44:45 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:22.784: INFO: Container webserver ready: false, restart count 0 Jan 21 17:49:22.784: INFO: pod-handle-http-request started at 2023-01-21 17:39:27 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:22.784: INFO: Container agnhost-container ready: true, restart count 0 Jan 21 17:49:22.784: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-z9h5n started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:22.784: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:22.784: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-lwrkc started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:22.784: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:22.784: INFO: rs-mkvfg started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:22.784: INFO: Container donothing ready: false, restart count 0 Jan 21 17:49:22.784: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-s4jct started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:22.784: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:22.784: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-lhl2j started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:22.784: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:22.784: INFO: cilium-7h9rt started at 2023-01-21 17:22:46 +0000 UTC (1+1 container statuses recorded) Jan 21 17:49:22.784: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 21 17:49:22.784: INFO: Container cilium-agent ready: true, restart count 0 Jan 21 17:49:22.784: INFO: pod-subpath-test-inlinevolume-gkbp started at 2023-01-21 17:45:21 +0000 UTC (1+1 container statuses recorded) Jan 21 17:49:22.784: INFO: Init container init-volume-inlinevolume-gkbp ready: false, restart count 0 Jan 21 17:49:22.784: INFO: Container test-container-subpath-inlinevolume-gkbp ready: false, restart count 0 Jan 21 17:49:22.784: INFO: ss2-0 started at 2023-01-21 17:47:15 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:22.784: INFO: Container webserver ready: false, restart count 0 Jan 21 17:49:22.784: INFO: netserver-1 started at 2023-01-21 17:44:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:22.784: INFO: Container webserver ready: true, restart count 0 Jan 21 17:49:22.784: INFO: pod-init-15c5b058-f29b-4a6e-bb36-6f1eb27d04a1 started at 2023-01-21 17:48:47 +0000 UTC (2+1 container statuses recorded) Jan 21 17:49:22.784: INFO: Init container init1 ready: false, restart count 0 Jan 21 17:49:22.784: INFO: Init container init2 ready: false, restart count 0 Jan 21 17:49:22.784: INFO: Container run1 ready: false, restart count 0 Jan 21 17:49:22.784: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-w47qr started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:22.784: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:22.784: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-rvh9t started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:22.784: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:22.784: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-b7bsr started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:22.784: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:22.784: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-drmzt started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:22.784: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:22.784: INFO: netserver-1 started at 2023-01-21 17:45:12 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:22.784: INFO: Container webserver ready: false, restart count 0 Jan 21 17:49:22.784: INFO: pfpod started at 2023-01-21 17:47:14 +0000 UTC (0+2 container statuses recorded) Jan 21 17:49:22.784: INFO: Container portforwardtester ready: false, restart count 0 Jan 21 17:49:22.784: INFO: Container readiness ready: false, restart count 0 Jan 21 17:49:22.784: INFO: ebs-csi-node-vzcrc started at 2023-01-21 17:22:46 +0000 UTC (0+3 container statuses recorded) Jan 21 17:49:22.784: INFO: Container ebs-plugin ready: true, restart count 0 Jan 21 17:49:22.784: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:49:22.784: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 21 17:49:22.784: INFO: rs-fjjf2 started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:22.784: INFO: Container donothing ready: false, restart count 0 Jan 21 17:49:23.519: INFO: Latency metrics for node i-0c9a59753149775ab Jan 21 17:49:23.519: INFO: Logging node info for node i-0d64fae545fa8bf3f Jan 21 17:49:23.734: INFO: Node Info: &Node{ObjectMeta:{i-0d64fae545fa8bf3f 77fc61e9-438c-4f3e-98aa-2b457c1202a0 31733 0 2023-01-21 17:22:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-southeast-1 failure-domain.beta.kubernetes.io/zone:ap-southeast-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0d64fae545fa8bf3f kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-southeast-1a topology.hostpath.csi/node:i-0d64fae545fa8bf3f topology.kubernetes.io/region:ap-southeast-1 topology.kubernetes.io/zone:ap-southeast-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.53.147 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-volume-expand-9636":"i-0d64fae545fa8bf3f","ebs.csi.aws.com":"i-0d64fae545fa8bf3f"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-21 17:37:47 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-21 17:44:29 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-21 17:44:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-southeast-1a/i-0d64fae545fa8bf3f,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 17:44:32 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 17:44:32 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 17:44:32 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 17:44:32 +0000 UTC,LastTransitionTime:2023-01-21 17:23:05 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.53.147,},NodeAddress{Type:ExternalIP,Address:13.229.75.189,},NodeAddress{Type:InternalDNS,Address:i-0d64fae545fa8bf3f.ap-southeast-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0d64fae545fa8bf3f.ap-southeast-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-229-75-189.ap-southeast-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2dfae26c309b0dd5a9ccb311cb6042,SystemUUID:ec2dfae2-6c30-9b0d-d5a9-ccb311cb6042,BootID:6e6cce59-de74-4521-b0ec-ab95e71b1046,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.24.10,KubeProxyVersion:v1.24.10,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.24.10],SizeBytes:112211511,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c k8s.gcr.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/sample-apiserver@sha256:f9c93b92b6ff750b41a93c4e4fe0bfe384597aeb841e2539d5444815c55b2d8f k8s.gcr.io/e2e-test-images/sample-apiserver:1.17.5],SizeBytes:24316368,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa k8s.gcr.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb k8s.gcr.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 k8s.gcr.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a k8s.gcr.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 k8s.gcr.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7],SizeBytes:311278,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-volume-expand-9636^40436064-99b3-11ed-aefe-f2f9c54a4473],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-volume-expand-9636^40436064-99b3-11ed-aefe-f2f9c54a4473,DevicePath:,},},Config:nil,},} Jan 21 17:49:23.734: INFO: Logging kubelet events for node i-0d64fae545fa8bf3f Jan 21 17:49:23.951: INFO: Logging pods the kubelet thinks is on node i-0d64fae545fa8bf3f Jan 21 17:49:24.178: INFO: netserver-2 started at 2023-01-21 17:44:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:24.178: INFO: Container webserver ready: false, restart count 0 Jan 21 17:49:24.178: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-hrf6g started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:24.178: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:24.178: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-nkjzz started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:24.178: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: false, restart count 0 Jan 21 17:49:24.178: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-857g9 started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:24.178: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:24.178: INFO: cilium-gv5dw started at 2023-01-21 17:22:46 +0000 UTC (1+1 container statuses recorded) Jan 21 17:49:24.178: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 21 17:49:24.178: INFO: Container cilium-agent ready: true, restart count 0 Jan 21 17:49:24.178: INFO: csi-mockplugin-0 started at 2023-01-21 17:47:26 +0000 UTC (0+3 container statuses recorded) Jan 21 17:49:24.178: INFO: Container csi-provisioner ready: false, restart count 0 Jan 21 17:49:24.178: INFO: Container driver-registrar ready: false, restart count 0 Jan 21 17:49:24.178: INFO: Container mock ready: false, restart count 0 Jan 21 17:49:24.178: INFO: csi-mockplugin-attacher-0 started at 2023-01-21 17:47:26 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:24.178: INFO: Container csi-attacher ready: false, restart count 0 Jan 21 17:49:24.178: INFO: coredns-6dd78b7459-44jzj started at 2023-01-21 17:23:22 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:24.178: INFO: Container coredns ready: true, restart count 0 Jan 21 17:49:24.178: INFO: csi-hostpathplugin-0 started at 2023-01-21 17:44:10 +0000 UTC (0+7 container statuses recorded) Jan 21 17:49:24.178: INFO: Container csi-attacher ready: true, restart count 0 Jan 21 17:49:24.178: INFO: Container csi-provisioner ready: true, restart count 0 Jan 21 17:49:24.178: INFO: Container csi-resizer ready: true, restart count 0 Jan 21 17:49:24.178: INFO: Container csi-snapshotter ready: true, restart count 0 Jan 21 17:49:24.178: INFO: Container hostpath ready: true, restart count 0 Jan 21 17:49:24.178: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:49:24.178: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 21 17:49:24.178: INFO: netserver-2 started at 2023-01-21 17:44:45 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:24.178: INFO: Container webserver ready: false, restart count 0 Jan 21 17:49:24.178: INFO: csi-hostpathplugin-0 started at 2023-01-21 17:45:35 +0000 UTC (0+7 container statuses recorded) Jan 21 17:49:24.178: INFO: Container csi-attacher ready: false, restart count 0 Jan 21 17:49:24.178: INFO: Container csi-provisioner ready: false, restart count 0 Jan 21 17:49:24.178: INFO: Container csi-resizer ready: false, restart count 0 Jan 21 17:49:24.178: INFO: Container csi-snapshotter ready: false, restart count 0 Jan 21 17:49:24.178: INFO: Container hostpath ready: false, restart count 0 Jan 21 17:49:24.178: INFO: Container liveness-probe ready: false, restart count 0 Jan 21 17:49:24.178: INFO: Container node-driver-registrar ready: false, restart count 0 Jan 21 17:49:24.178: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-k5qhx started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:24.178: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:24.178: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-gj9hg started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:24.178: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:24.178: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-dhzrx started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:24.178: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:24.178: INFO: rs-rvl99 started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:24.178: INFO: Container donothing ready: false, restart count 0 Jan 21 17:49:24.178: INFO: pod-c4a96c13-73b3-4bb4-b100-d87d572fe413 started at 2023-01-21 17:44:29 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:24.178: INFO: Container write-pod ready: false, restart count 0 Jan 21 17:49:24.178: INFO: rs-cgktj started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:24.178: INFO: Container donothing ready: true, restart count 0 Jan 21 17:49:24.178: INFO: ebs-csi-node-k2jhx started at 2023-01-21 17:22:46 +0000 UTC (0+3 container statuses recorded) Jan 21 17:49:24.179: INFO: Container ebs-plugin ready: true, restart count 0 Jan 21 17:49:24.179: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:49:24.179: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 21 17:49:24.179: INFO: externalname-service-nz5lf started at 2023-01-21 17:44:17 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:24.179: INFO: Container externalname-service ready: false, restart count 0 Jan 21 17:49:24.179: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-fbjxh started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:24.179: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:24.179: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-zjvp4 started at 2023-01-21 17:37:50 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:24.179: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:24.179: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-gplfc started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:24.179: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:24.179: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-kprqk started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:24.179: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:24.179: INFO: netserver-2 started at 2023-01-21 17:45:12 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:24.179: INFO: Container webserver ready: false, restart count 0 Jan 21 17:49:24.900: INFO: Latency metrics for node i-0d64fae545fa8bf3f Jan 21 17:49:24.900: INFO: Logging node info for node i-0e989f541e95bf4a9 Jan 21 17:49:25.118: INFO: Node Info: &Node{ObjectMeta:{i-0e989f541e95bf4a9 bf125f17-fba9-4a1f-bf10-621d29cd68aa 33425 0 2023-01-21 17:22:44 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-southeast-1 failure-domain.beta.kubernetes.io/zone:ap-southeast-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0e989f541e95bf4a9 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-southeast-1a topology.hostpath.csi/node:i-0e989f541e95bf4a9 topology.kubernetes.io/region:ap-southeast-1 topology.kubernetes.io/zone:ap-southeast-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.55.136 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0e989f541e95bf4a9"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-21 17:22:44 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:22:44 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 17:22:44 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-21 17:22:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-21 17:22:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-21 17:37:47 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-21 17:38:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-southeast-1a/i-0e989f541e95bf4a9,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078206976 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973349376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 17:48:37 +0000 UTC,LastTransitionTime:2023-01-21 17:22:44 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 17:48:37 +0000 UTC,LastTransitionTime:2023-01-21 17:22:44 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 17:48:37 +0000 UTC,LastTransitionTime:2023-01-21 17:22:44 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 17:48:37 +0000 UTC,LastTransitionTime:2023-01-21 17:23:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.55.136,},NodeAddress{Type:ExternalIP,Address:13.212.153.84,},NodeAddress{Type:InternalDNS,Address:i-0e989f541e95bf4a9.ap-southeast-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0e989f541e95bf4a9.ap-southeast-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-212-153-84.ap-southeast-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec253ae18d864ba53e81f21cc4edca85,SystemUUID:ec253ae1-8d86-4ba5-3e81-f21cc4edca85,BootID:4abbb0c1-a455-4297-b376-571ca9fcdc78,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.24.10,KubeProxyVersion:v1.24.10,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.24.10],SizeBytes:112211511,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c k8s.gcr.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa k8s.gcr.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb k8s.gcr.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 k8s.gcr.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a k8s.gcr.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf k8s.gcr.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 k8s.gcr.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7],SizeBytes:311278,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 21 17:49:25.118: INFO: Logging kubelet events for node i-0e989f541e95bf4a9 Jan 21 17:49:25.334: INFO: Logging pods the kubelet thinks is on node i-0e989f541e95bf4a9 Jan 21 17:49:25.559: INFO: cilium-8cmqj started at 2023-01-21 17:22:45 +0000 UTC (1+1 container statuses recorded) Jan 21 17:49:25.559: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 21 17:49:25.559: INFO: Container cilium-agent ready: true, restart count 0 Jan 21 17:49:25.559: INFO: rs-r8h6b started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:25.559: INFO: Container donothing ready: false, restart count 0 Jan 21 17:49:25.559: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-xtpv2 started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:25.559: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:25.559: INFO: hostexec-i-0e989f541e95bf4a9-l5vnf started at 2023-01-21 17:44:08 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:25.559: INFO: Container agnhost-container ready: true, restart count 0 Jan 21 17:49:25.559: INFO: coredns-6dd78b7459-m68gs started at 2023-01-21 17:23:04 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:25.559: INFO: Container coredns ready: true, restart count 0 Jan 21 17:49:25.559: INFO: pod-ca7f77c6-03f7-48db-ac18-47b4f6e40077 started at 2023-01-21 17:44:15 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:25.559: INFO: Container write-pod ready: false, restart count 0 Jan 21 17:49:25.559: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-ztjxc started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:25.559: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:25.559: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-nhfcv started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:25.559: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:25.559: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-ndn5x started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:25.559: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:25.559: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-zrrqp started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:25.559: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:25.559: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-vj75s started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:25.559: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:25.559: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-s2hll started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:25.559: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:25.559: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-tz4hj started at 2023-01-21 17:37:50 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:25.559: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:25.559: INFO: coredns-autoscaler-5f76bf6c7b-lkrtx started at 2023-01-21 17:23:04 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:25.559: INFO: Container autoscaler ready: true, restart count 0 Jan 21 17:49:25.559: INFO: netserver-3 started at 2023-01-21 17:45:13 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:25.559: INFO: Container webserver ready: false, restart count 0 Jan 21 17:49:25.559: INFO: netserver-3 started at 2023-01-21 17:44:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:25.560: INFO: Container webserver ready: false, restart count 0 Jan 21 17:49:25.560: INFO: netserver-3 started at 2023-01-21 17:44:45 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:25.560: INFO: Container webserver ready: false, restart count 0 Jan 21 17:49:25.560: INFO: ebs-csi-node-b9gk6 started at 2023-01-21 17:22:45 +0000 UTC (0+3 container statuses recorded) Jan 21 17:49:25.560: INFO: Container ebs-plugin ready: true, restart count 0 Jan 21 17:49:25.560: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:49:25.560: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 21 17:49:25.560: INFO: rs-d9mjn started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:25.560: INFO: Container donothing ready: false, restart count 0 Jan 21 17:49:25.560: INFO: rs-vk2fw started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:25.560: INFO: Container donothing ready: false, restart count 0 Jan 21 17:49:25.560: INFO: hostexec-i-0e989f541e95bf4a9-g7jqg started at 2023-01-21 17:44:18 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:25.560: INFO: Container agnhost-container ready: true, restart count 0 Jan 21 17:49:25.560: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-h9gs9 started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:25.560: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:25.560: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-59wkt started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:25.560: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:26.295: INFO: Latency metrics for node i-0e989f541e95bf4a9 �[1mSTEP�[0m: Collecting events from namespace "webhook-7976-markers". �[1mSTEP�[0m: Found 0 events. Jan 21 17:49:26.723: INFO: POD NODE PHASE GRACE CONDITIONS Jan 21 17:49:26.723: INFO: Jan 21 17:49:26.939: INFO: Logging node info for node i-03775830c60663d32 Jan 21 17:49:27.153: INFO: Node Info: &Node{ObjectMeta:{i-03775830c60663d32 7e863bb0-bd92-4fd6-abc2-40d9e11317f1 33014 0 2023-01-21 17:22:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-southeast-1 failure-domain.beta.kubernetes.io/zone:ap-southeast-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-03775830c60663d32 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-southeast-1a topology.hostpath.csi/node:i-03775830c60663d32 topology.kubernetes.io/region:ap-southeast-1 topology.kubernetes.io/zone:ap-southeast-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.55.172 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-03775830c60663d32"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-21 17:37:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-21 17:47:21 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-21 17:47:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-southeast-1a/i-03775830c60663d32,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078252032 0} {<nil>} 3982668Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973394432 0} {<nil>} 3880268Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 17:47:26 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 17:47:26 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 17:47:26 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 17:47:26 +0000 UTC,LastTransitionTime:2023-01-21 17:23:06 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.55.172,},NodeAddress{Type:ExternalIP,Address:13.229.107.111,},NodeAddress{Type:InternalDNS,Address:i-03775830c60663d32.ap-southeast-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-03775830c60663d32.ap-southeast-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-229-107-111.ap-southeast-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec283bf7e7ad98bfb3e8e233a27b8209,SystemUUID:ec283bf7-e7ad-98bf-b3e8-e233a27b8209,BootID:a0bdbc5b-a9a7-47cf-88a5-9de3c7f8b2ce,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.24.10,KubeProxyVersion:v1.24.10,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.24.10],SizeBytes:112211511,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa k8s.gcr.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb k8s.gcr.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 k8s.gcr.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a k8s.gcr.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 k8s.gcr.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 k8s.gcr.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f k8s.gcr.io/e2e-test-images/nginx:1.15-2],SizeBytes:7000509,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7],SizeBytes:311278,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-05ce4ba3795a29b88],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-05ce4ba3795a29b88,DevicePath:,},},Config:nil,},} Jan 21 17:49:27.153: INFO: Logging kubelet events for node i-03775830c60663d32 Jan 21 17:49:27.370: INFO: Logging pods the kubelet thinks is on node i-03775830c60663d32 Jan 21 17:49:27.597: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-vjvht started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:27.597: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:27.597: INFO: pod-projected-secrets-0da06512-5c21-4d72-a2c9-3392bd5c6e89 started at 2023-01-21 17:44:29 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:27.597: INFO: Container secret-volume-test ready: false, restart count 0 Jan 21 17:49:27.597: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-m9bgz started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:27.597: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:27.597: INFO: netserver-0 started at 2023-01-21 17:44:45 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:27.597: INFO: Container webserver ready: true, restart count 0 Jan 21 17:49:27.597: INFO: termination-message-containerf7a29c43-fda8-453c-8178-763ce83a42aa started at 2023-01-21 17:45:05 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:27.597: INFO: Container termination-message-container ready: false, restart count 0 Jan 21 17:49:27.597: INFO: pod-a138f362-77a8-42b7-be7c-81ec30a1b470 started at 2023-01-21 17:45:08 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:27.597: INFO: Container write-pod ready: false, restart count 0 Jan 21 17:49:27.597: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-f7vgb started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:27.598: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:27.598: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-8vz56 started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:27.598: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:27.598: INFO: rs-gqcsw started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:27.598: INFO: Container donothing ready: false, restart count 0 Jan 21 17:49:27.598: INFO: externalname-service-2dzs9 started at 2023-01-21 17:44:17 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:27.598: INFO: Container externalname-service ready: false, restart count 0 Jan 21 17:49:27.598: INFO: pod-5c06b80d-aa28-4f8c-b34f-91a4e97e33ea started at 2023-01-21 17:47:19 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:27.598: INFO: Container write-pod ready: false, restart count 0 Jan 21 17:49:27.598: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-nwcqs started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:27.598: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:27.598: INFO: rs-6zfxj started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:27.598: INFO: Container donothing ready: false, restart count 0 Jan 21 17:49:27.598: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-g72gd started at 2023-01-21 17:37:50 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:27.598: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:27.598: INFO: sample-webhook-deployment-68c7bd4684-gmll7 started at 2023-01-21 17:44:17 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:27.598: INFO: Container sample-webhook ready: false, restart count 0 Jan 21 17:49:27.598: INFO: rs-8t6wd started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:27.598: INFO: Container donothing ready: true, restart count 0 Jan 21 17:49:27.598: INFO: foo-v2vd7 started at 2023-01-21 17:49:26 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:27.598: INFO: Container c ready: false, restart count 0 Jan 21 17:49:27.598: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-k4jpx started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:27.598: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:27.598: INFO: pod-with-prestop-exec-hook started at 2023-01-21 17:44:21 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:27.598: INFO: Container pod-with-prestop-exec-hook ready: false, restart count 0 Jan 21 17:49:27.598: INFO: suspend-true-to-false-ctf95 started at 2023-01-21 17:48:40 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:27.598: INFO: Container c ready: false, restart count 0 Jan 21 17:49:27.598: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-8b9jt started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:27.598: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:27.598: INFO: hostexec-i-03775830c60663d32-8wzpb started at 2023-01-21 17:49:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:27.598: INFO: Container agnhost-container ready: true, restart count 0 Jan 21 17:49:27.598: INFO: pod-fa8f7974-7a8f-4d0a-a9f4-246237bfa8b6 started at 2023-01-21 17:49:16 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:27.598: INFO: Container write-pod ready: false, restart count 0 Jan 21 17:49:27.598: INFO: foo-c5bqp started at 2023-01-21 17:49:26 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:27.598: INFO: Container c ready: false, restart count 0 Jan 21 17:49:27.598: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-49cq9 started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:27.598: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:27.598: INFO: ebs-csi-node-lsgbl started at 2023-01-21 17:22:46 +0000 UTC (0+3 container statuses recorded) Jan 21 17:49:27.598: INFO: Container ebs-plugin ready: true, restart count 0 Jan 21 17:49:27.598: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:49:27.598: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 21 17:49:27.598: INFO: cilium-2tq4w started at 2023-01-21 17:22:46 +0000 UTC (1+1 container statuses recorded) Jan 21 17:49:27.598: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 21 17:49:27.598: INFO: Container cilium-agent ready: true, restart count 0 Jan 21 17:49:27.598: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-tfbvc started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:27.598: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:27.598: INFO: suspend-true-to-false-h2lzk started at 2023-01-21 17:48:40 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:27.598: INFO: Container c ready: false, restart count 0 Jan 21 17:49:27.598: INFO: hostexec-i-03775830c60663d32-h4jm4 started at 2023-01-21 17:45:03 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:27.598: INFO: Container agnhost-container ready: true, restart count 0 Jan 21 17:49:27.598: INFO: netserver-0 started at 2023-01-21 17:45:12 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:27.598: INFO: Container webserver ready: false, restart count 0 Jan 21 17:49:27.598: INFO: hairpin started at 2023-01-21 17:47:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:27.598: INFO: Container agnhost-container ready: false, restart count 0 Jan 21 17:49:28.330: INFO: Latency metrics for node i-03775830c60663d32 Jan 21 17:49:28.331: INFO: Logging node info for node i-089df1bd1599c9fac Jan 21 17:49:28.545: INFO: Node Info: &Node{ObjectMeta:{i-089df1bd1599c9fac 5933bf32-55e4-4bc6-811a-9ebde5df5619 33466 0 2023-01-21 17:20:48 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-southeast-1 failure-domain.beta.kubernetes.io/zone:ap-southeast-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-089df1bd1599c9fac kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:ap-southeast-1a topology.kubernetes.io/region:ap-southeast-1 topology.kubernetes.io/zone:ap-southeast-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.40.1 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-089df1bd1599c9fac"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-21 17:20:48 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-21 17:21:14 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:21:23 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:21:23 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 17:21:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-21 17:23:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-southeast-1a/i-089df1bd1599c9fac,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3889451008 0} {<nil>} 3798292Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3784593408 0} {<nil>} 3695892Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 17:48:44 +0000 UTC,LastTransitionTime:2023-01-21 17:20:46 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 17:48:44 +0000 UTC,LastTransitionTime:2023-01-21 17:20:46 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 17:48:44 +0000 UTC,LastTransitionTime:2023-01-21 17:20:46 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 17:48:44 +0000 UTC,LastTransitionTime:2023-01-21 17:21:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.40.1,},NodeAddress{Type:ExternalIP,Address:13.212.76.186,},NodeAddress{Type:InternalDNS,Address:i-089df1bd1599c9fac.ap-southeast-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-089df1bd1599c9fac.ap-southeast-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-212-76-186.ap-southeast-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec28683bad10cfdec8fa4bd6c22408b7,SystemUUID:ec28683b-ad10-cfde-c8fa-4bd6c22408b7,BootID:a32c6813-ffd6-4923-a901-e3a8658adebd,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.24.10,KubeProxyVersion:v1.24.10,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64@sha256:6db2761074bae8385aa601d4b45ab065893cfdc258d8b2593fc56698c44dbee5 k8s.gcr.io/kube-apiserver-amd64:v1.24.10 registry.k8s.io/kube-apiserver-amd64:v1.24.10],SizeBytes:131733971,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64@sha256:8867df47c332bae8dfd061b4d4230cd0febcc5a8a427ecb2e8f70b33ffc6d732 k8s.gcr.io/kube-controller-manager-amd64:v1.24.10 registry.k8s.io/kube-controller-manager-amd64:v1.24.10],SizeBytes:121342265,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.24.10],SizeBytes:112211511,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64@sha256:a589f10748fa227ea6ebf0730126f3f192cbdbb2c7f96a9d4685cabb86eb1cbc k8s.gcr.io/kube-scheduler-amd64:v1.24.10 registry.k8s.io/kube-scheduler-amd64:v1.24.10],SizeBytes:52751160,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-beta.2],SizeBytes:43191763,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-beta.2],SizeBytes:42821714,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:245e81c2ed53b5508a6f687f3ab0c724b9ab31e6a5fa5e6d2f814981ab6ce55f registry.k8s.io/provider-aws/cloud-controller-manager:v1.24.3],SizeBytes:18282737,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-beta.2],SizeBytes:4965793,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 21 17:49:28.546: INFO: Logging kubelet events for node i-089df1bd1599c9fac Jan 21 17:49:28.763: INFO: Logging pods the kubelet thinks is on node i-089df1bd1599c9fac Jan 21 17:49:28.985: INFO: cilium-operator-8d8478c74-hpl2l started at 2023-01-21 17:21:19 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:28.985: INFO: Container cilium-operator ready: true, restart count 0 Jan 21 17:49:28.985: INFO: dns-controller-7d4957564c-rk48f started at 2023-01-21 17:21:19 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:28.985: INFO: Container dns-controller ready: true, restart count 0 Jan 21 17:49:28.985: INFO: kube-scheduler-i-089df1bd1599c9fac started at 2023-01-21 17:20:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:28.985: INFO: Container kube-scheduler ready: true, restart count 0 Jan 21 17:49:28.985: INFO: kube-apiserver-i-089df1bd1599c9fac started at 2023-01-21 17:20:10 +0000 UTC (0+2 container statuses recorded) Jan 21 17:49:28.985: INFO: Container healthcheck ready: true, restart count 0 Jan 21 17:49:28.985: INFO: Container kube-apiserver ready: true, restart count 1 Jan 21 17:49:28.985: INFO: aws-cloud-controller-manager-lt9wb started at 2023-01-21 17:21:18 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:28.985: INFO: Container aws-cloud-controller-manager ready: true, restart count 0 Jan 21 17:49:28.985: INFO: cilium-nj7m8 started at 2023-01-21 17:21:19 +0000 UTC (1+1 container statuses recorded) Jan 21 17:49:28.985: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 21 17:49:28.985: INFO: Container cilium-agent ready: true, restart count 1 Jan 21 17:49:28.985: INFO: ebs-csi-node-j7jjl started at 2023-01-21 17:21:19 +0000 UTC (0+3 container statuses recorded) Jan 21 17:49:28.985: INFO: Container ebs-plugin ready: true, restart count 0 Jan 21 17:49:28.985: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:49:28.986: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 21 17:49:28.986: INFO: ebs-csi-controller-779575c67d-scjvt started at 2023-01-21 17:21:19 +0000 UTC (0+5 container statuses recorded) Jan 21 17:49:28.986: INFO: Container csi-attacher ready: true, restart count 0 Jan 21 17:49:28.986: INFO: Container csi-provisioner ready: true, restart count 0 Jan 21 17:49:28.986: INFO: Container csi-resizer ready: true, restart count 0 Jan 21 17:49:28.986: INFO: Container ebs-plugin ready: true, restart count 0 Jan 21 17:49:28.986: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:49:28.986: INFO: kube-controller-manager-i-089df1bd1599c9fac started at 2023-01-21 17:20:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:28.986: INFO: Container kube-controller-manager ready: true, restart count 3 Jan 21 17:49:28.986: INFO: etcd-manager-events-i-089df1bd1599c9fac started at 2023-01-21 17:20:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:28.986: INFO: Container etcd-manager ready: true, restart count 0 Jan 21 17:49:28.986: INFO: etcd-manager-main-i-089df1bd1599c9fac started at 2023-01-21 17:20:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:28.986: INFO: Container etcd-manager ready: true, restart count 0 Jan 21 17:49:28.986: INFO: kops-controller-7fpkx started at 2023-01-21 17:21:18 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:28.986: INFO: Container kops-controller ready: true, restart count 0 Jan 21 17:49:29.673: INFO: Latency metrics for node i-089df1bd1599c9fac Jan 21 17:49:29.673: INFO: Logging node info for node i-0c9a59753149775ab Jan 21 17:49:29.887: INFO: Node Info: &Node{ObjectMeta:{i-0c9a59753149775ab 5c157934-21a3-4b7b-9fa3-5c66b5b25ec5 33220 0 2023-01-21 17:22:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-southeast-1 failure-domain.beta.kubernetes.io/zone:ap-southeast-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0c9a59753149775ab kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-southeast-1a topology.hostpath.csi/node:i-0c9a59753149775ab topology.kubernetes.io/region:ap-southeast-1 topology.kubernetes.io/zone:ap-southeast-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.34.240 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0c9a59753149775ab"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-21 17:37:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-21 17:47:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-southeast-1a/i-0c9a59753149775ab,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 17:47:38 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 17:47:38 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 17:47:38 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 17:47:38 +0000 UTC,LastTransitionTime:2023-01-21 17:23:06 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.34.240,},NodeAddress{Type:ExternalIP,Address:13.212.2.160,},NodeAddress{Type:InternalDNS,Address:i-0c9a59753149775ab.ap-southeast-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0c9a59753149775ab.ap-southeast-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-212-2-160.ap-southeast-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2610052ce207b4f84f50e9ba8d53ab,SystemUUID:ec261005-2ce2-07b4-f84f-50e9ba8d53ab,BootID:ff39a0e3-8cb1-4190-8b6d-8912e2826f9a,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.24.10,KubeProxyVersion:v1.24.10,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.24.10],SizeBytes:112211511,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa k8s.gcr.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb k8s.gcr.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 k8s.gcr.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a k8s.gcr.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 k8s.gcr.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 k8s.gcr.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f k8s.gcr.io/e2e-test-images/nginx:1.15-2],SizeBytes:7000509,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7],SizeBytes:311278,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 21 17:49:29.890: INFO: Logging kubelet events for node i-0c9a59753149775ab Jan 21 17:49:30.106: INFO: Logging pods the kubelet thinks is on node i-0c9a59753149775ab Jan 21 17:49:30.329: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-6hvtr started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:30.330: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:30.330: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-g9wzw started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:30.330: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:30.330: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-z9h5n started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:30.330: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:30.330: INFO: netserver-1 started at 2023-01-21 17:44:45 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:30.330: INFO: Container webserver ready: false, restart count 0 Jan 21 17:49:30.330: INFO: pod-handle-http-request started at 2023-01-21 17:39:27 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:30.330: INFO: Container agnhost-container ready: true, restart count 0 Jan 21 17:49:30.330: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-lwrkc started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:30.330: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:30.330: INFO: rs-mkvfg started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:30.330: INFO: Container donothing ready: false, restart count 0 Jan 21 17:49:30.330: INFO: pod-subpath-test-inlinevolume-gkbp started at 2023-01-21 17:45:21 +0000 UTC (1+1 container statuses recorded) Jan 21 17:49:30.330: INFO: Init container init-volume-inlinevolume-gkbp ready: false, restart count 0 Jan 21 17:49:30.330: INFO: Container test-container-subpath-inlinevolume-gkbp ready: false, restart count 0 Jan 21 17:49:30.330: INFO: ss2-0 started at 2023-01-21 17:47:15 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:30.330: INFO: Container webserver ready: false, restart count 0 Jan 21 17:49:30.330: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-s4jct started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:30.330: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:30.330: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-lhl2j started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:30.330: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:30.330: INFO: cilium-7h9rt started at 2023-01-21 17:22:46 +0000 UTC (1+1 container statuses recorded) Jan 21 17:49:30.330: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 21 17:49:30.330: INFO: Container cilium-agent ready: true, restart count 0 Jan 21 17:49:30.330: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-rvh9t started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:30.330: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:30.330: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-b7bsr started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:30.330: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:30.330: INFO: pod-init-15c5b058-f29b-4a6e-bb36-6f1eb27d04a1 started at 2023-01-21 17:48:47 +0000 UTC (2+1 container statuses recorded) Jan 21 17:49:30.330: INFO: Init container init1 ready: false, restart count 0 Jan 21 17:49:30.330: INFO: Init container init2 ready: false, restart count 0 Jan 21 17:49:30.330: INFO: Container run1 ready: false, restart count 0 Jan 21 17:49:30.330: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-w47qr started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:30.330: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:30.330: INFO: rs-fjjf2 started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:30.330: INFO: Container donothing ready: false, restart count 0 Jan 21 17:49:30.330: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-drmzt started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:30.330: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:30.330: INFO: netserver-1 started at 2023-01-21 17:45:12 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:30.330: INFO: Container webserver ready: false, restart count 0 Jan 21 17:49:30.330: INFO: pfpod started at 2023-01-21 17:47:14 +0000 UTC (0+2 container statuses recorded) Jan 21 17:49:30.330: INFO: Container portforwardtester ready: false, restart count 0 Jan 21 17:49:30.330: INFO: Container readiness ready: false, restart count 0 Jan 21 17:49:30.330: INFO: ebs-csi-node-vzcrc started at 2023-01-21 17:22:46 +0000 UTC (0+3 container statuses recorded) Jan 21 17:49:30.330: INFO: Container ebs-plugin ready: true, restart count 0 Jan 21 17:49:30.330: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:49:30.330: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 21 17:49:31.073: INFO: Latency metrics for node i-0c9a59753149775ab Jan 21 17:49:31.073: INFO: Logging node info for node i-0d64fae545fa8bf3f Jan 21 17:49:31.288: INFO: Node Info: &Node{ObjectMeta:{i-0d64fae545fa8bf3f 77fc61e9-438c-4f3e-98aa-2b457c1202a0 31733 0 2023-01-21 17:22:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-southeast-1 failure-domain.beta.kubernetes.io/zone:ap-southeast-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0d64fae545fa8bf3f kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-southeast-1a topology.hostpath.csi/node:i-0d64fae545fa8bf3f topology.kubernetes.io/region:ap-southeast-1 topology.kubernetes.io/zone:ap-southeast-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.53.147 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-volume-expand-9636":"i-0d64fae545fa8bf3f","ebs.csi.aws.com":"i-0d64fae545fa8bf3f"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-21 17:37:47 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-21 17:44:29 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-21 17:44:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-southeast-1a/i-0d64fae545fa8bf3f,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 17:44:32 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 17:44:32 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 17:44:32 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 17:44:32 +0000 UTC,LastTransitionTime:2023-01-21 17:23:05 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.53.147,},NodeAddress{Type:ExternalIP,Address:13.229.75.189,},NodeAddress{Type:InternalDNS,Address:i-0d64fae545fa8bf3f.ap-southeast-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0d64fae545fa8bf3f.ap-southeast-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-229-75-189.ap-southeast-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2dfae26c309b0dd5a9ccb311cb6042,SystemUUID:ec2dfae2-6c30-9b0d-d5a9-ccb311cb6042,BootID:6e6cce59-de74-4521-b0ec-ab95e71b1046,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.24.10,KubeProxyVersion:v1.24.10,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.24.10],SizeBytes:112211511,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c k8s.gcr.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/sample-apiserver@sha256:f9c93b92b6ff750b41a93c4e4fe0bfe384597aeb841e2539d5444815c55b2d8f k8s.gcr.io/e2e-test-images/sample-apiserver:1.17.5],SizeBytes:24316368,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa k8s.gcr.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb k8s.gcr.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 k8s.gcr.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a k8s.gcr.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 k8s.gcr.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7],SizeBytes:311278,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-volume-expand-9636^40436064-99b3-11ed-aefe-f2f9c54a4473],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-volume-expand-9636^40436064-99b3-11ed-aefe-f2f9c54a4473,DevicePath:,},},Config:nil,},} Jan 21 17:49:31.288: INFO: Logging kubelet events for node i-0d64fae545fa8bf3f Jan 21 17:49:31.505: INFO: Logging pods the kubelet thinks is on node i-0d64fae545fa8bf3f Jan 21 17:49:31.730: INFO: csi-hostpathplugin-0 started at 2023-01-21 17:44:10 +0000 UTC (0+7 container statuses recorded) Jan 21 17:49:31.730: INFO: Container csi-attacher ready: true, restart count 0 Jan 21 17:49:31.730: INFO: Container csi-provisioner ready: true, restart count 0 Jan 21 17:49:31.730: INFO: Container csi-resizer ready: true, restart count 0 Jan 21 17:49:31.730: INFO: Container csi-snapshotter ready: true, restart count 0 Jan 21 17:49:31.730: INFO: Container hostpath ready: true, restart count 0 Jan 21 17:49:31.730: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:49:31.730: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 21 17:49:31.730: INFO: netserver-2 started at 2023-01-21 17:44:45 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:31.730: INFO: Container webserver ready: false, restart count 0 Jan 21 17:49:31.730: INFO: csi-hostpathplugin-0 started at 2023-01-21 17:45:35 +0000 UTC (0+7 container statuses recorded) Jan 21 17:49:31.730: INFO: Container csi-attacher ready: false, restart count 0 Jan 21 17:49:31.730: INFO: Container csi-provisioner ready: false, restart count 0 Jan 21 17:49:31.730: INFO: Container csi-resizer ready: false, restart count 0 Jan 21 17:49:31.730: INFO: Container csi-snapshotter ready: false, restart count 0 Jan 21 17:49:31.730: INFO: Container hostpath ready: false, restart count 0 Jan 21 17:49:31.730: INFO: Container liveness-probe ready: false, restart count 0 Jan 21 17:49:31.730: INFO: Container node-driver-registrar ready: false, restart count 0 Jan 21 17:49:31.730: INFO: coredns-6dd78b7459-44jzj started at 2023-01-21 17:23:22 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:31.730: INFO: Container coredns ready: true, restart count 0 Jan 21 17:49:31.730: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-gj9hg started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:31.730: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:31.730: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-dhzrx started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:31.730: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:31.730: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-k5qhx started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:31.730: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:31.730: INFO: rs-rvl99 started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:31.730: INFO: Container donothing ready: false, restart count 0 Jan 21 17:49:31.731: INFO: externalname-service-nz5lf started at 2023-01-21 17:44:17 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:31.731: INFO: Container externalname-service ready: false, restart count 0 Jan 21 17:49:31.731: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-fbjxh started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:31.731: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:31.731: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-zjvp4 started at 2023-01-21 17:37:50 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:31.731: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:31.731: INFO: rs-cgktj started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:31.731: INFO: Container donothing ready: true, restart count 0 Jan 21 17:49:31.731: INFO: ebs-csi-node-k2jhx started at 2023-01-21 17:22:46 +0000 UTC (0+3 container statuses recorded) Jan 21 17:49:31.731: INFO: Container ebs-plugin ready: true, restart count 0 Jan 21 17:49:31.731: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:49:31.731: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 21 17:49:31.731: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-kprqk started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:31.731: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:31.731: INFO: netserver-2 started at 2023-01-21 17:45:12 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:31.731: INFO: Container webserver ready: false, restart count 0 Jan 21 17:49:31.731: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-gplfc started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:31.731: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:31.731: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-857g9 started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:31.731: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:31.731: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-hrf6g started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:31.731: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:31.731: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-nkjzz started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:31.731: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: false, restart count 0 Jan 21 17:49:31.731: INFO: csi-mockplugin-0 started at 2023-01-21 17:47:26 +0000 UTC (0+3 container statuses recorded) Jan 21 17:49:31.731: INFO: Container csi-provisioner ready: false, restart count 0 Jan 21 17:49:31.731: INFO: Container driver-registrar ready: false, restart count 0 Jan 21 17:49:31.731: INFO: Container mock ready: false, restart count 0 Jan 21 17:49:31.731: INFO: csi-mockplugin-attacher-0 started at 2023-01-21 17:47:26 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:31.731: INFO: Container csi-attacher ready: false, restart count 0 Jan 21 17:49:31.731: INFO: cilium-gv5dw started at 2023-01-21 17:22:46 +0000 UTC (1+1 container statuses recorded) Jan 21 17:49:31.731: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 21 17:49:31.731: INFO: Container cilium-agent ready: true, restart count 0 Jan 21 17:49:32.611: INFO: Latency metrics for node i-0d64fae545fa8bf3f Jan 21 17:49:32.612: INFO: Logging node info for node i-0e989f541e95bf4a9 Jan 21 17:49:32.826: INFO: Node Info: &Node{ObjectMeta:{i-0e989f541e95bf4a9 bf125f17-fba9-4a1f-bf10-621d29cd68aa 33425 0 2023-01-21 17:22:44 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-southeast-1 failure-domain.beta.kubernetes.io/zone:ap-southeast-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0e989f541e95bf4a9 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-southeast-1a topology.hostpath.csi/node:i-0e989f541e95bf4a9 topology.kubernetes.io/region:ap-southeast-1 topology.kubernetes.io/zone:ap-southeast-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.55.136 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0e989f541e95bf4a9"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-21 17:22:44 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:22:44 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 17:22:44 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-21 17:22:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-21 17:22:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-21 17:37:47 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-21 17:38:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-southeast-1a/i-0e989f541e95bf4a9,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078206976 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973349376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 17:48:37 +0000 UTC,LastTransitionTime:2023-01-21 17:22:44 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 17:48:37 +0000 UTC,LastTransitionTime:2023-01-21 17:22:44 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 17:48:37 +0000 UTC,LastTransitionTime:2023-01-21 17:22:44 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 17:48:37 +0000 UTC,LastTransitionTime:2023-01-21 17:23:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.55.136,},NodeAddress{Type:ExternalIP,Address:13.212.153.84,},NodeAddress{Type:InternalDNS,Address:i-0e989f541e95bf4a9.ap-southeast-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0e989f541e95bf4a9.ap-southeast-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-212-153-84.ap-southeast-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec253ae18d864ba53e81f21cc4edca85,SystemUUID:ec253ae1-8d86-4ba5-3e81-f21cc4edca85,BootID:4abbb0c1-a455-4297-b376-571ca9fcdc78,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.24.10,KubeProxyVersion:v1.24.10,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.24.10],SizeBytes:112211511,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c k8s.gcr.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa k8s.gcr.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb k8s.gcr.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 k8s.gcr.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a k8s.gcr.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf k8s.gcr.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 k8s.gcr.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7],SizeBytes:311278,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 21 17:49:32.826: INFO: Logging kubelet events for node i-0e989f541e95bf4a9 Jan 21 17:49:33.043: INFO: Logging pods the kubelet thinks is on node i-0e989f541e95bf4a9 Jan 21 17:49:33.267: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-h9gs9 started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:33.267: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:33.267: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-59wkt started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:33.267: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:33.267: INFO: cilium-8cmqj started at 2023-01-21 17:22:45 +0000 UTC (1+1 container statuses recorded) Jan 21 17:49:33.267: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 21 17:49:33.267: INFO: Container cilium-agent ready: true, restart count 0 Jan 21 17:49:33.267: INFO: rs-r8h6b started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:33.267: INFO: Container donothing ready: false, restart count 0 Jan 21 17:49:33.267: INFO: hostexec-i-0e989f541e95bf4a9-l5vnf started at 2023-01-21 17:44:08 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:33.267: INFO: Container agnhost-container ready: true, restart count 0 Jan 21 17:49:33.267: INFO: service-proxy-disabled-ljqb5 started at 2023-01-21 17:49:31 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:33.267: INFO: Container service-proxy-disabled ready: false, restart count 0 Jan 21 17:49:33.267: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-xtpv2 started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:33.267: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:33.267: INFO: coredns-6dd78b7459-m68gs started at 2023-01-21 17:23:04 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:33.267: INFO: Container coredns ready: true, restart count 0 Jan 21 17:49:33.267: INFO: pod-ca7f77c6-03f7-48db-ac18-47b4f6e40077 started at 2023-01-21 17:44:15 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:33.267: INFO: Container write-pod ready: false, restart count 0 Jan 21 17:49:33.267: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-ztjxc started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:33.267: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:33.267: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-nhfcv started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:33.267: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:33.267: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-ndn5x started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:33.267: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:33.267: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-zrrqp started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:33.267: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:33.267: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-vj75s started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:33.267: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:33.267: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-s2hll started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:33.267: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:33.267: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-tz4hj started at 2023-01-21 17:37:50 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:33.267: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:33.267: INFO: coredns-autoscaler-5f76bf6c7b-lkrtx started at 2023-01-21 17:23:04 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:33.267: INFO: Container autoscaler ready: true, restart count 0 Jan 21 17:49:33.267: INFO: netserver-3 started at 2023-01-21 17:45:13 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:33.267: INFO: Container webserver ready: false, restart count 0 Jan 21 17:49:33.267: INFO: netserver-3 started at 2023-01-21 17:44:45 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:33.267: INFO: Container webserver ready: false, restart count 0 Jan 21 17:49:33.267: INFO: ebs-csi-node-b9gk6 started at 2023-01-21 17:22:45 +0000 UTC (0+3 container statuses recorded) Jan 21 17:49:33.267: INFO: Container ebs-plugin ready: true, restart count 0 Jan 21 17:49:33.267: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:49:33.267: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 21 17:49:33.267: INFO: rs-vk2fw started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:33.267: INFO: Container donothing ready: false, restart count 0 Jan 21 17:49:33.267: INFO: hostexec-i-0e989f541e95bf4a9-g7jqg started at 2023-01-21 17:44:18 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:33.267: INFO: Container agnhost-container ready: true, restart count 0 Jan 21 17:49:33.267: INFO: rs-d9mjn started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:33.267: INFO: Container donothing ready: false, restart count 0 Jan 21 17:49:33.988: INFO: Latency metrics for node i-0e989f541e95bf4a9 Jan 21 17:49:33.988: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "webhook-7976" for this suite. �[1mSTEP�[0m: Destroying namespace "webhook-7976-markers" for this suite. [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/apimachinery/webhook.go:104
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-apps\]\sStatefulSet\sBasic\sStatefulSet\sfunctionality\s\[StatefulSetBasic\]\sShould\srecreate\sevicted\sstatefulset\s\[Conformance\]$'
test/e2e/framework/framework.go:652 Jan 21 17:45:12.584: Pod test-pod did not start running: timed out waiting for the condition vendor/github.com/onsi/ginkgo/internal/leafnodes/runner.go:113from junit_21.xml
{"msg":"PASSED [sig-cli] Kubectl client Simple pod should return command exit codes execing into a container with a successful command","total":-1,"completed":15,"skipped":156,"failed":0} [BeforeEach] [sig-apps] StatefulSet test/e2e/framework/framework.go:187 �[1mSTEP�[0m: Creating a kubernetes client Jan 21 17:40:09.781: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename statefulset �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace [BeforeEach] [sig-apps] StatefulSet test/e2e/apps/statefulset.go:96 [BeforeEach] Basic StatefulSet functionality [StatefulSetBasic] test/e2e/apps/statefulset.go:111 �[1mSTEP�[0m: Creating service test in namespace statefulset-8899 [It] Should recreate evicted statefulset [Conformance] test/e2e/framework/framework.go:652 �[1mSTEP�[0m: Looking for a node to schedule stateful set and pod �[1mSTEP�[0m: Creating pod with conflicting port in namespace statefulset-8899 �[1mSTEP�[0m: Waiting until pod test-pod will start running in namespace statefulset-8899 Jan 21 17:45:12.584: FAIL: Pod test-pod did not start running: timed out waiting for the condition Full Stack Trace k8s.io/kubernetes/test/e2e.RunE2ETests(0x25761d7?) test/e2e/e2e.go:130 +0x6bb k8s.io/kubernetes/test/e2e.TestE2E(0x24e52d9?) test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc00021d1e0, 0x741f9a8) /usr/local/go/src/testing/testing.go:1446 +0x10b created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1493 +0x35f [AfterEach] Basic StatefulSet functionality [StatefulSetBasic] test/e2e/apps/statefulset.go:122 Jan 21 17:45:12.799: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/4462d38c-99af-11ed-a697-56ea552f9d82/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-deb10-k24-ko26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=statefulset-8899 describe po test-pod' Jan 21 17:45:13.983: INFO: stderr: "" Jan 21 17:45:13.983: INFO: stdout: "Name: test-pod\nNamespace: statefulset-8899\nPriority: 0\nNode: i-0c9a59753149775ab/172.20.34.240\nStart Time: Sat, 21 Jan 2023 17:40:11 +0000\nLabels: <none>\nAnnotations: <none>\nStatus: Pending\nIP: \nIPs: <none>\nContainers:\n webserver:\n Container ID: \n Image: k8s.gcr.io/e2e-test-images/httpd:2.4.38-2\n Image ID: \n Port: 21017/TCP\n Host Port: 21017/TCP\n State: Waiting\n Reason: ContainerCreating\n Ready: False\n Restart Count: 0\n Environment: <none>\n Mounts:\n /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-zdmkg (ro)\nConditions:\n Type Status\n Initialized True \n Ready False \n ContainersReady False \n PodScheduled True \nVolumes:\n kube-api-access-zdmkg:\n Type: Projected (a volume that contains injected data from multiple sources)\n TokenExpirationSeconds: 3607\n ConfigMapName: kube-root-ca.crt\n ConfigMapOptional: <nil>\n DownwardAPI: true\nQoS Class: BestEffort\nNode-Selectors: <none>\nTolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s\n node.kubernetes.io/unreachable:NoExecute op=Exists for 300s\nEvents:\n Type Reason Age From Message\n ---- ------ ---- ---- -------\n Warning FailedCreatePodSandBox 5m1s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"0317473ee7cb6cfee6f2817a8bfec01c040d15ff3e1b5b0729a314c0d43d097d\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available\n Warning FailedCreatePodSandBox 4m50s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"aa84bc569abdd15c7930b2acb7df0e4302ebc83fd4c86bf56e803d640fc7cf53\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available\n Warning FailedCreatePodSandBox 4m35s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"ae6bc79c7fb137e18d7a705cae9494e2cd69d29693da818ad8a52aa5a8b79489\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available\n Warning FailedCreatePodSandBox 4m22s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"0bc5a6d70db7f2667b6ae514549b9970fb7857e9252472ae7303313eaad41229\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available\n Warning FailedCreatePodSandBox 4m11s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"0cd53f86f4466505a56bebde97049dfe58477fc837c1af11bb6ca0f2c00571b4\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available\n Warning FailedCreatePodSandBox 3m59s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"f912afa3e0d22b1141dd54344a8cdb3cc9c284b2f1adf94a819dc25ab4383c14\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available\n Warning FailedCreatePodSandBox 3m48s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"fff7812836b46b8966adfa28f6ccbc8fb6943d037e8933f4ac338925313f9426\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available\n Warning FailedCreatePodSandBox 3m37s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"688452d37c7378a191a60b2cfe18f8983f1d394902d27dc6f881dba82ed34347\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available\n Warning FailedCreatePodSandBox 3m25s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"2baabe7ea8f50184a32947ac09a1986f6f127a8c0c8669a57b7f01147e85aa02\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available\n Warning FailedCreatePodSandBox 11s (x15 over 3m13s) kubelet (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"89cb62a8b3c89fe4d30bb78bd3d698a27b24ebe6bf301a0973ecb6de00a9cdae\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available\n" Jan 21 17:45:13.983: INFO: Output of kubectl describe test-pod: Name: test-pod Namespace: statefulset-8899 Priority: 0 Node: i-0c9a59753149775ab/172.20.34.240 Start Time: Sat, 21 Jan 2023 17:40:11 +0000 Labels: <none> Annotations: <none> Status: Pending IP: IPs: <none> Containers: webserver: Container ID: Image: k8s.gcr.io/e2e-test-images/httpd:2.4.38-2 Image ID: Port: 21017/TCP Host Port: 21017/TCP State: Waiting Reason: ContainerCreating Ready: False Restart Count: 0 Environment: <none> Mounts: /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-zdmkg (ro) Conditions: Type Status Initialized True Ready False ContainersReady False PodScheduled True Volumes: kube-api-access-zdmkg: Type: Projected (a volume that contains injected data from multiple sources) TokenExpirationSeconds: 3607 ConfigMapName: kube-root-ca.crt ConfigMapOptional: <nil> DownwardAPI: true QoS Class: BestEffort Node-Selectors: <none> Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s node.kubernetes.io/unreachable:NoExecute op=Exists for 300s Events: Type Reason Age From Message ---- ------ ---- ---- ------- Warning FailedCreatePodSandBox 5m1s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "0317473ee7cb6cfee6f2817a8bfec01c040d15ff3e1b5b0729a314c0d43d097d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Warning FailedCreatePodSandBox 4m50s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "aa84bc569abdd15c7930b2acb7df0e4302ebc83fd4c86bf56e803d640fc7cf53": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Warning FailedCreatePodSandBox 4m35s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ae6bc79c7fb137e18d7a705cae9494e2cd69d29693da818ad8a52aa5a8b79489": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Warning FailedCreatePodSandBox 4m22s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "0bc5a6d70db7f2667b6ae514549b9970fb7857e9252472ae7303313eaad41229": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Warning FailedCreatePodSandBox 4m11s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "0cd53f86f4466505a56bebde97049dfe58477fc837c1af11bb6ca0f2c00571b4": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Warning FailedCreatePodSandBox 3m59s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "f912afa3e0d22b1141dd54344a8cdb3cc9c284b2f1adf94a819dc25ab4383c14": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Warning FailedCreatePodSandBox 3m48s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "fff7812836b46b8966adfa28f6ccbc8fb6943d037e8933f4ac338925313f9426": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Warning FailedCreatePodSandBox 3m37s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "688452d37c7378a191a60b2cfe18f8983f1d394902d27dc6f881dba82ed34347": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Warning FailedCreatePodSandBox 3m25s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "2baabe7ea8f50184a32947ac09a1986f6f127a8c0c8669a57b7f01147e85aa02": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Warning FailedCreatePodSandBox 11s (x15 over 3m13s) kubelet (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "89cb62a8b3c89fe4d30bb78bd3d698a27b24ebe6bf301a0973ecb6de00a9cdae": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:45:13.983: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/4462d38c-99af-11ed-a697-56ea552f9d82/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-deb10-k24-ko26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=statefulset-8899 logs test-pod --tail=100' Jan 21 17:45:14.947: INFO: rc: 1 Jan 21 17:45:14.948: INFO: Last 100 log lines of test-pod: Jan 21 17:45:14.948: INFO: Deleting all statefulset in ns statefulset-8899 [AfterEach] [sig-apps] StatefulSet test/e2e/framework/framework.go:188 �[1mSTEP�[0m: Collecting events from namespace "statefulset-8899". �[1mSTEP�[0m: Found 10 events. Jan 21 17:45:15.809: INFO: At 2023-01-21 17:40:12 +0000 UTC - event for test-pod: {kubelet i-0c9a59753149775ab} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "0317473ee7cb6cfee6f2817a8bfec01c040d15ff3e1b5b0729a314c0d43d097d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:45:15.809: INFO: At 2023-01-21 17:40:23 +0000 UTC - event for test-pod: {kubelet i-0c9a59753149775ab} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "aa84bc569abdd15c7930b2acb7df0e4302ebc83fd4c86bf56e803d640fc7cf53": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:45:15.809: INFO: At 2023-01-21 17:40:38 +0000 UTC - event for test-pod: {kubelet i-0c9a59753149775ab} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ae6bc79c7fb137e18d7a705cae9494e2cd69d29693da818ad8a52aa5a8b79489": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:45:15.809: INFO: At 2023-01-21 17:40:51 +0000 UTC - event for test-pod: {kubelet i-0c9a59753149775ab} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "0bc5a6d70db7f2667b6ae514549b9970fb7857e9252472ae7303313eaad41229": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:45:15.809: INFO: At 2023-01-21 17:41:02 +0000 UTC - event for test-pod: {kubelet i-0c9a59753149775ab} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "0cd53f86f4466505a56bebde97049dfe58477fc837c1af11bb6ca0f2c00571b4": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:45:15.809: INFO: At 2023-01-21 17:41:14 +0000 UTC - event for test-pod: {kubelet i-0c9a59753149775ab} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "f912afa3e0d22b1141dd54344a8cdb3cc9c284b2f1adf94a819dc25ab4383c14": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:45:15.810: INFO: At 2023-01-21 17:41:25 +0000 UTC - event for test-pod: {kubelet i-0c9a59753149775ab} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "fff7812836b46b8966adfa28f6ccbc8fb6943d037e8933f4ac338925313f9426": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:45:15.810: INFO: At 2023-01-21 17:41:36 +0000 UTC - event for test-pod: {kubelet i-0c9a59753149775ab} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "688452d37c7378a191a60b2cfe18f8983f1d394902d27dc6f881dba82ed34347": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:45:15.810: INFO: At 2023-01-21 17:41:48 +0000 UTC - event for test-pod: {kubelet i-0c9a59753149775ab} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "2baabe7ea8f50184a32947ac09a1986f6f127a8c0c8669a57b7f01147e85aa02": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:45:15.810: INFO: At 2023-01-21 17:42:00 +0000 UTC - event for test-pod: {kubelet i-0c9a59753149775ab} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "89cb62a8b3c89fe4d30bb78bd3d698a27b24ebe6bf301a0973ecb6de00a9cdae": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:45:16.024: INFO: POD NODE PHASE GRACE CONDITIONS Jan 21 17:45:16.024: INFO: test-pod i-0c9a59753149775ab Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:40:11 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:40:11 +0000 UTC ContainersNotReady containers with unready status: [webserver]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:40:11 +0000 UTC ContainersNotReady containers with unready status: [webserver]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:40:11 +0000 UTC }] Jan 21 17:45:16.024: INFO: Jan 21 17:45:16.241: INFO: Unable to fetch statefulset-8899/test-pod/webserver logs: the server rejected our request for an unknown reason (get pods test-pod) Jan 21 17:45:16.457: INFO: Logging node info for node i-03775830c60663d32 Jan 21 17:45:16.673: INFO: Node Info: &Node{ObjectMeta:{i-03775830c60663d32 7e863bb0-bd92-4fd6-abc2-40d9e11317f1 30913 0 2023-01-21 17:22:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-southeast-1 failure-domain.beta.kubernetes.io/zone:ap-southeast-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-03775830c60663d32 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-southeast-1a topology.hostpath.csi/node:i-03775830c60663d32 topology.kubernetes.io/region:ap-southeast-1 topology.kubernetes.io/zone:ap-southeast-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.55.172 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-03775830c60663d32"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-21 17:37:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-21 17:43:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-southeast-1a/i-03775830c60663d32,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078252032 0} {<nil>} 3982668Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973394432 0} {<nil>} 3880268Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 17:43:21 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 17:43:21 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 17:43:21 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 17:43:21 +0000 UTC,LastTransitionTime:2023-01-21 17:23:06 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.55.172,},NodeAddress{Type:ExternalIP,Address:13.229.107.111,},NodeAddress{Type:InternalDNS,Address:i-03775830c60663d32.ap-southeast-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-03775830c60663d32.ap-southeast-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-229-107-111.ap-southeast-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec283bf7e7ad98bfb3e8e233a27b8209,SystemUUID:ec283bf7-e7ad-98bf-b3e8-e233a27b8209,BootID:a0bdbc5b-a9a7-47cf-88a5-9de3c7f8b2ce,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.24.10,KubeProxyVersion:v1.24.10,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.24.10],SizeBytes:112211511,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa k8s.gcr.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb k8s.gcr.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 k8s.gcr.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a k8s.gcr.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 k8s.gcr.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 k8s.gcr.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f k8s.gcr.io/e2e-test-images/nginx:1.15-2],SizeBytes:7000509,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7],SizeBytes:311278,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 21 17:45:16.673: INFO: Logging kubelet events for node i-03775830c60663d32 Jan 21 17:45:16.890: INFO: Logging pods the kubelet thinks is on node i-03775830c60663d32 Jan 21 17:45:17.118: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-m9bgz started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:17.118: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:45:17.118: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-vjvht started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:17.118: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:45:17.118: INFO: pod-projected-secrets-0da06512-5c21-4d72-a2c9-3392bd5c6e89 started at 2023-01-21 17:44:29 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:17.118: INFO: Container secret-volume-test ready: false, restart count 0 Jan 21 17:45:17.118: INFO: pod-a138f362-77a8-42b7-be7c-81ec30a1b470 started at 2023-01-21 17:45:08 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:17.118: INFO: Container write-pod ready: false, restart count 0 Jan 21 17:45:17.118: INFO: netserver-0 started at 2023-01-21 17:44:45 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:17.118: INFO: Container webserver ready: false, restart count 0 Jan 21 17:45:17.118: INFO: netserver-0 started at 2023-01-21 17:44:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:17.118: INFO: Container webserver ready: false, restart count 0 Jan 21 17:45:17.118: INFO: termination-message-containerf7a29c43-fda8-453c-8178-763ce83a42aa started at 2023-01-21 17:45:05 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:17.118: INFO: Container termination-message-container ready: false, restart count 0 Jan 21 17:45:17.118: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-f7vgb started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:17.118: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:45:17.118: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-8vz56 started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:17.118: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:45:17.118: INFO: rs-gqcsw started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:17.118: INFO: Container donothing ready: false, restart count 0 Jan 21 17:45:17.118: INFO: security-context-438aba9f-ab6c-4a18-8b67-6b803986e06f started at 2023-01-21 17:44:07 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:17.118: INFO: Container test-container ready: false, restart count 0 Jan 21 17:45:17.118: INFO: externalname-service-2dzs9 started at 2023-01-21 17:44:17 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:17.118: INFO: Container externalname-service ready: false, restart count 0 Jan 21 17:45:17.118: INFO: rs-6zfxj started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:17.118: INFO: Container donothing ready: false, restart count 0 Jan 21 17:45:17.118: INFO: netserver-0 started at 2023-01-21 17:40:01 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:17.118: INFO: Container webserver ready: true, restart count 0 Jan 21 17:45:17.118: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-nwcqs started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:17.118: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:45:17.118: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-g72gd started at 2023-01-21 17:37:50 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:17.118: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:45:17.118: INFO: sample-webhook-deployment-68c7bd4684-gmll7 started at 2023-01-21 17:44:17 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:17.118: INFO: Container sample-webhook ready: false, restart count 0 Jan 21 17:45:17.118: INFO: rs-8t6wd started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:17.118: INFO: Container donothing ready: true, restart count 0 Jan 21 17:45:17.118: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-k4jpx started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:17.118: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:45:17.118: INFO: pod-with-prestop-exec-hook started at 2023-01-21 17:44:21 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:17.118: INFO: Container pod-with-prestop-exec-hook ready: false, restart count 0 Jan 21 17:45:17.118: INFO: termination-message-containerc3566fe9-0af4-4730-b56f-b8798d88d529 started at 2023-01-21 17:44:38 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:17.118: INFO: Container termination-message-container ready: false, restart count 0 Jan 21 17:45:17.118: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-8b9jt started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:17.118: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:45:17.118: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-49cq9 started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:17.118: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:45:17.118: INFO: ebs-csi-node-lsgbl started at 2023-01-21 17:22:46 +0000 UTC (0+3 container statuses recorded) Jan 21 17:45:17.118: INFO: Container ebs-plugin ready: true, restart count 0 Jan 21 17:45:17.118: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:45:17.118: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 21 17:45:17.118: INFO: cilium-2tq4w started at 2023-01-21 17:22:46 +0000 UTC (1+1 container statuses recorded) Jan 21 17:45:17.118: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 21 17:45:17.118: INFO: Container cilium-agent ready: true, restart count 0 Jan 21 17:45:17.118: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-tfbvc started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:17.118: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:45:17.118: INFO: hostexec-i-03775830c60663d32-h4jm4 started at 2023-01-21 17:45:03 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:17.118: INFO: Container agnhost-container ready: true, restart count 0 Jan 21 17:45:17.118: INFO: netserver-0 started at 2023-01-21 17:45:12 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:17.118: INFO: Container webserver ready: false, restart count 0 Jan 21 17:45:18.068: INFO: Latency metrics for node i-03775830c60663d32 Jan 21 17:45:18.068: INFO: Logging node info for node i-089df1bd1599c9fac Jan 21 17:45:18.283: INFO: Node Info: &Node{ObjectMeta:{i-089df1bd1599c9fac 5933bf32-55e4-4bc6-811a-9ebde5df5619 31031 0 2023-01-21 17:20:48 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-southeast-1 failure-domain.beta.kubernetes.io/zone:ap-southeast-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-089df1bd1599c9fac kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:ap-southeast-1a topology.kubernetes.io/region:ap-southeast-1 topology.kubernetes.io/zone:ap-southeast-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.40.1 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-089df1bd1599c9fac"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-21 17:20:48 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-21 17:21:14 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:21:23 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:21:23 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 17:21:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-21 17:23:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-southeast-1a/i-089df1bd1599c9fac,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3889451008 0} {<nil>} 3798292Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3784593408 0} {<nil>} 3695892Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 17:43:38 +0000 UTC,LastTransitionTime:2023-01-21 17:20:46 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 17:43:38 +0000 UTC,LastTransitionTime:2023-01-21 17:20:46 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 17:43:38 +0000 UTC,LastTransitionTime:2023-01-21 17:20:46 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 17:43:38 +0000 UTC,LastTransitionTime:2023-01-21 17:21:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.40.1,},NodeAddress{Type:ExternalIP,Address:13.212.76.186,},NodeAddress{Type:InternalDNS,Address:i-089df1bd1599c9fac.ap-southeast-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-089df1bd1599c9fac.ap-southeast-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-212-76-186.ap-southeast-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec28683bad10cfdec8fa4bd6c22408b7,SystemUUID:ec28683b-ad10-cfde-c8fa-4bd6c22408b7,BootID:a32c6813-ffd6-4923-a901-e3a8658adebd,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.24.10,KubeProxyVersion:v1.24.10,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64@sha256:6db2761074bae8385aa601d4b45ab065893cfdc258d8b2593fc56698c44dbee5 k8s.gcr.io/kube-apiserver-amd64:v1.24.10 registry.k8s.io/kube-apiserver-amd64:v1.24.10],SizeBytes:131733971,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64@sha256:8867df47c332bae8dfd061b4d4230cd0febcc5a8a427ecb2e8f70b33ffc6d732 k8s.gcr.io/kube-controller-manager-amd64:v1.24.10 registry.k8s.io/kube-controller-manager-amd64:v1.24.10],SizeBytes:121342265,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.24.10],SizeBytes:112211511,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64@sha256:a589f10748fa227ea6ebf0730126f3f192cbdbb2c7f96a9d4685cabb86eb1cbc k8s.gcr.io/kube-scheduler-amd64:v1.24.10 registry.k8s.io/kube-scheduler-amd64:v1.24.10],SizeBytes:52751160,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-beta.2],SizeBytes:43191763,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-beta.2],SizeBytes:42821714,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:245e81c2ed53b5508a6f687f3ab0c724b9ab31e6a5fa5e6d2f814981ab6ce55f registry.k8s.io/provider-aws/cloud-controller-manager:v1.24.3],SizeBytes:18282737,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-beta.2],SizeBytes:4965793,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 21 17:45:18.284: INFO: Logging kubelet events for node i-089df1bd1599c9fac Jan 21 17:45:18.501: INFO: Logging pods the kubelet thinks is on node i-089df1bd1599c9fac Jan 21 17:45:18.725: INFO: kube-scheduler-i-089df1bd1599c9fac started at 2023-01-21 17:20:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:18.725: INFO: Container kube-scheduler ready: true, restart count 0 Jan 21 17:45:18.725: INFO: kube-apiserver-i-089df1bd1599c9fac started at 2023-01-21 17:20:10 +0000 UTC (0+2 container statuses recorded) Jan 21 17:45:18.725: INFO: Container healthcheck ready: true, restart count 0 Jan 21 17:45:18.725: INFO: Container kube-apiserver ready: true, restart count 1 Jan 21 17:45:18.725: INFO: aws-cloud-controller-manager-lt9wb started at 2023-01-21 17:21:18 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:18.725: INFO: Container aws-cloud-controller-manager ready: true, restart count 0 Jan 21 17:45:18.725: INFO: cilium-nj7m8 started at 2023-01-21 17:21:19 +0000 UTC (1+1 container statuses recorded) Jan 21 17:45:18.725: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 21 17:45:18.725: INFO: Container cilium-agent ready: true, restart count 1 Jan 21 17:45:18.725: INFO: cilium-operator-8d8478c74-hpl2l started at 2023-01-21 17:21:19 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:18.725: INFO: Container cilium-operator ready: true, restart count 0 Jan 21 17:45:18.725: INFO: dns-controller-7d4957564c-rk48f started at 2023-01-21 17:21:19 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:18.725: INFO: Container dns-controller ready: true, restart count 0 Jan 21 17:45:18.725: INFO: kube-controller-manager-i-089df1bd1599c9fac started at 2023-01-21 17:20:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:18.725: INFO: Container kube-controller-manager ready: true, restart count 3 Jan 21 17:45:18.725: INFO: etcd-manager-events-i-089df1bd1599c9fac started at 2023-01-21 17:20:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:18.725: INFO: Container etcd-manager ready: true, restart count 0 Jan 21 17:45:18.725: INFO: etcd-manager-main-i-089df1bd1599c9fac started at 2023-01-21 17:20:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:18.725: INFO: Container etcd-manager ready: true, restart count 0 Jan 21 17:45:18.725: INFO: kops-controller-7fpkx started at 2023-01-21 17:21:18 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:18.725: INFO: Container kops-controller ready: true, restart count 0 Jan 21 17:45:18.725: INFO: ebs-csi-node-j7jjl started at 2023-01-21 17:21:19 +0000 UTC (0+3 container statuses recorded) Jan 21 17:45:18.725: INFO: Container ebs-plugin ready: true, restart count 0 Jan 21 17:45:18.725: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:45:18.725: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 21 17:45:18.725: INFO: ebs-csi-controller-779575c67d-scjvt started at 2023-01-21 17:21:19 +0000 UTC (0+5 container statuses recorded) Jan 21 17:45:18.725: INFO: Container csi-attacher ready: true, restart count 0 Jan 21 17:45:18.725: INFO: Container csi-provisioner ready: true, restart count 0 Jan 21 17:45:18.725: INFO: Container csi-resizer ready: true, restart count 0 Jan 21 17:45:18.725: INFO: Container ebs-plugin ready: true, restart count 0 Jan 21 17:45:18.725: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:45:19.415: INFO: Latency metrics for node i-089df1bd1599c9fac Jan 21 17:45:19.415: INFO: Logging node info for node i-0c9a59753149775ab Jan 21 17:45:19.630: INFO: Node Info: &Node{ObjectMeta:{i-0c9a59753149775ab 5c157934-21a3-4b7b-9fa3-5c66b5b25ec5 31621 0 2023-01-21 17:22:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-southeast-1 failure-domain.beta.kubernetes.io/zone:ap-southeast-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0c9a59753149775ab kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-southeast-1a topology.hostpath.csi/node:i-0c9a59753149775ab topology.kubernetes.io/region:ap-southeast-1 topology.kubernetes.io/zone:ap-southeast-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.34.240 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-2289":"i-0c9a59753149775ab","ebs.csi.aws.com":"i-0c9a59753149775ab"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-21 17:37:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-21 17:39:09 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-21 17:39:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-southeast-1a/i-0c9a59753149775ab,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 17:44:24 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 17:44:24 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 17:44:24 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 17:44:24 +0000 UTC,LastTransitionTime:2023-01-21 17:23:06 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.34.240,},NodeAddress{Type:ExternalIP,Address:13.212.2.160,},NodeAddress{Type:InternalDNS,Address:i-0c9a59753149775ab.ap-southeast-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0c9a59753149775ab.ap-southeast-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-212-2-160.ap-southeast-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2610052ce207b4f84f50e9ba8d53ab,SystemUUID:ec261005-2ce2-07b4-f84f-50e9ba8d53ab,BootID:ff39a0e3-8cb1-4190-8b6d-8912e2826f9a,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.24.10,KubeProxyVersion:v1.24.10,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.24.10],SizeBytes:112211511,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa k8s.gcr.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb k8s.gcr.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 k8s.gcr.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a k8s.gcr.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 k8s.gcr.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 k8s.gcr.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f k8s.gcr.io/e2e-test-images/nginx:1.15-2],SizeBytes:7000509,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7],SizeBytes:311278,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-2289^c0d62f16-99b2-11ed-8b7e-4a565f54742c kubernetes.io/csi/ebs.csi.aws.com^vol-08c4c6da9de04f66c],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-08c4c6da9de04f66c,DevicePath:,},},Config:nil,},} Jan 21 17:45:19.631: INFO: Logging kubelet events for node i-0c9a59753149775ab Jan 21 17:45:19.848: INFO: Logging pods the kubelet thinks is on node i-0c9a59753149775ab Jan 21 17:45:20.075: INFO: ebs-csi-node-vzcrc started at 2023-01-21 17:22:46 +0000 UTC (0+3 container statuses recorded) Jan 21 17:45:20.075: INFO: Container ebs-plugin ready: true, restart count 0 Jan 21 17:45:20.075: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:45:20.075: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 21 17:45:20.075: INFO: rs-fjjf2 started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:20.075: INFO: Container donothing ready: false, restart count 0 Jan 21 17:45:20.075: INFO: csi-mockplugin-0 started at 2023-01-21 17:38:20 +0000 UTC (0+3 container statuses recorded) Jan 21 17:45:20.075: INFO: Container csi-provisioner ready: true, restart count 0 Jan 21 17:45:20.075: INFO: Container driver-registrar ready: true, restart count 0 Jan 21 17:45:20.075: INFO: Container mock ready: true, restart count 0 Jan 21 17:45:20.075: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-drmzt started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:20.075: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:45:20.075: INFO: local-injector started at 2023-01-21 17:43:51 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:20.075: INFO: Container local-injector ready: false, restart count 0 Jan 21 17:45:20.075: INFO: netserver-1 started at 2023-01-21 17:45:12 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:20.075: INFO: Container webserver ready: false, restart count 0 Jan 21 17:45:20.075: INFO: netserver-1 started at 2023-01-21 17:40:02 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:20.075: INFO: Container webserver ready: true, restart count 0 Jan 21 17:45:20.075: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-6hvtr started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:20.075: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:45:20.075: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-g9wzw started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:20.075: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:45:20.075: INFO: pod-fe7c6a63-1f80-4b91-ac3a-2dfe1958668a started at 2023-01-21 17:39:07 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:20.075: INFO: Container write-pod ready: false, restart count 0 Jan 21 17:45:20.075: INFO: csi-mockplugin-attacher-0 started at 2023-01-21 17:38:21 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:20.075: INFO: Container csi-attacher ready: false, restart count 0 Jan 21 17:45:20.075: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-z9h5n started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:20.075: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:45:20.075: INFO: netserver-1 started at 2023-01-21 17:44:45 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:20.075: INFO: Container webserver ready: false, restart count 0 Jan 21 17:45:20.075: INFO: pod-handle-http-request started at 2023-01-21 17:39:27 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:20.075: INFO: Container agnhost-container ready: true, restart count 0 Jan 21 17:45:20.075: INFO: hostexec-i-0c9a59753149775ab-rxv2t started at 2023-01-21 17:43:28 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:20.075: INFO: Container agnhost-container ready: true, restart count 0 Jan 21 17:45:20.075: INFO: pvc-volume-tester-n795w started at 2023-01-21 17:40:54 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:20.075: INFO: Container volume-tester ready: false, restart count 0 Jan 21 17:45:20.075: INFO: downwardapi-volume-95fcbaab-e363-4f31-9911-b03b2af3661d started at 2023-01-21 17:43:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:20.075: INFO: Container client-container ready: false, restart count 0 Jan 21 17:45:20.075: INFO: rs-mkvfg started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:20.075: INFO: Container donothing ready: false, restart count 0 Jan 21 17:45:20.075: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-lwrkc started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:20.075: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:45:20.075: INFO: cilium-7h9rt started at 2023-01-21 17:22:46 +0000 UTC (1+1 container statuses recorded) Jan 21 17:45:20.075: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 21 17:45:20.075: INFO: Container cilium-agent ready: true, restart count 0 Jan 21 17:45:20.075: INFO: test-pod started at 2023-01-21 17:40:11 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:20.076: INFO: Container webserver ready: false, restart count 0 Jan 21 17:45:20.076: INFO: csi-hostpathplugin-0 started at 2023-01-21 17:40:35 +0000 UTC (0+7 container statuses recorded) Jan 21 17:45:20.076: INFO: Container csi-attacher ready: false, restart count 0 Jan 21 17:45:20.076: INFO: Container csi-provisioner ready: false, restart count 0 Jan 21 17:45:20.076: INFO: Container csi-resizer ready: false, restart count 0 Jan 21 17:45:20.076: INFO: Container csi-snapshotter ready: false, restart count 0 Jan 21 17:45:20.076: INFO: Container hostpath ready: false, restart count 0 Jan 21 17:45:20.076: INFO: Container liveness-probe ready: false, restart count 0 Jan 21 17:45:20.076: INFO: Container node-driver-registrar ready: false, restart count 0 Jan 21 17:45:20.076: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-s4jct started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:20.076: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:45:20.076: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-lhl2j started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:20.076: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:45:20.076: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-w47qr started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:20.076: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:45:20.076: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-rvh9t started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:20.076: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: false, restart count 0 Jan 21 17:45:20.076: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-b7bsr started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:20.076: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:45:20.076: INFO: netserver-1 started at 2023-01-21 17:44:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:20.076: INFO: Container webserver ready: false, restart count 0 Jan 21 17:45:20.930: INFO: Latency metrics for node i-0c9a59753149775ab Jan 21 17:45:20.930: INFO: Logging node info for node i-0d64fae545fa8bf3f Jan 21 17:45:21.145: INFO: Node Info: &Node{ObjectMeta:{i-0d64fae545fa8bf3f 77fc61e9-438c-4f3e-98aa-2b457c1202a0 31733 0 2023-01-21 17:22:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-southeast-1 failure-domain.beta.kubernetes.io/zone:ap-southeast-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0d64fae545fa8bf3f kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-southeast-1a topology.hostpath.csi/node:i-0d64fae545fa8bf3f topology.kubernetes.io/region:ap-southeast-1 topology.kubernetes.io/zone:ap-southeast-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.53.147 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-volume-expand-9636":"i-0d64fae545fa8bf3f","ebs.csi.aws.com":"i-0d64fae545fa8bf3f"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-21 17:37:47 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-21 17:44:29 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-21 17:44:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-southeast-1a/i-0d64fae545fa8bf3f,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 17:44:32 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 17:44:32 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 17:44:32 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 17:44:32 +0000 UTC,LastTransitionTime:2023-01-21 17:23:05 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.53.147,},NodeAddress{Type:ExternalIP,Address:13.229.75.189,},NodeAddress{Type:InternalDNS,Address:i-0d64fae545fa8bf3f.ap-southeast-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0d64fae545fa8bf3f.ap-southeast-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-229-75-189.ap-southeast-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2dfae26c309b0dd5a9ccb311cb6042,SystemUUID:ec2dfae2-6c30-9b0d-d5a9-ccb311cb6042,BootID:6e6cce59-de74-4521-b0ec-ab95e71b1046,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.24.10,KubeProxyVersion:v1.24.10,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.24.10],SizeBytes:112211511,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c k8s.gcr.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/sample-apiserver@sha256:f9c93b92b6ff750b41a93c4e4fe0bfe384597aeb841e2539d5444815c55b2d8f k8s.gcr.io/e2e-test-images/sample-apiserver:1.17.5],SizeBytes:24316368,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa k8s.gcr.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb k8s.gcr.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 k8s.gcr.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a k8s.gcr.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 k8s.gcr.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7],SizeBytes:311278,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-volume-expand-9636^40436064-99b3-11ed-aefe-f2f9c54a4473],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-volume-expand-9636^40436064-99b3-11ed-aefe-f2f9c54a4473,DevicePath:,},},Config:nil,},} Jan 21 17:45:21.146: INFO: Logging kubelet events for node i-0d64fae545fa8bf3f Jan 21 17:45:21.363: INFO: Logging pods the kubelet thinks is on node i-0d64fae545fa8bf3f Jan 21 17:45:21.588: INFO: netserver-2 started at 2023-01-21 17:40:02 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:21.588: INFO: Container webserver ready: true, restart count 0 Jan 21 17:45:21.588: INFO: coredns-6dd78b7459-44jzj started at 2023-01-21 17:23:22 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:21.588: INFO: Container coredns ready: true, restart count 0 Jan 21 17:45:21.588: INFO: csi-hostpathplugin-0 started at 2023-01-21 17:44:10 +0000 UTC (0+7 container statuses recorded) Jan 21 17:45:21.588: INFO: Container csi-attacher ready: true, restart count 0 Jan 21 17:45:21.588: INFO: Container csi-provisioner ready: true, restart count 0 Jan 21 17:45:21.588: INFO: Container csi-resizer ready: true, restart count 0 Jan 21 17:45:21.588: INFO: Container csi-snapshotter ready: true, restart count 0 Jan 21 17:45:21.588: INFO: Container hostpath ready: true, restart count 0 Jan 21 17:45:21.588: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:45:21.588: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 21 17:45:21.588: INFO: netserver-2 started at 2023-01-21 17:44:45 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:21.588: INFO: Container webserver ready: false, restart count 0 Jan 21 17:45:21.588: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-k5qhx started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:21.588: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:45:21.588: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-gj9hg started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:21.588: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:45:21.588: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-dhzrx started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:21.588: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:45:21.588: INFO: rs-rvl99 started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:21.588: INFO: Container donothing ready: false, restart count 0 Jan 21 17:45:21.588: INFO: pod-c4a96c13-73b3-4bb4-b100-d87d572fe413 started at 2023-01-21 17:44:29 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:21.588: INFO: Container write-pod ready: false, restart count 0 Jan 21 17:45:21.588: INFO: ebs-csi-node-k2jhx started at 2023-01-21 17:22:46 +0000 UTC (0+3 container statuses recorded) Jan 21 17:45:21.588: INFO: Container ebs-plugin ready: true, restart count 0 Jan 21 17:45:21.588: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:45:21.589: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 21 17:45:21.589: INFO: externalname-service-nz5lf started at 2023-01-21 17:44:17 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:21.589: INFO: Container externalname-service ready: false, restart count 0 Jan 21 17:45:21.589: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-fbjxh started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:21.589: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:45:21.589: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-zjvp4 started at 2023-01-21 17:37:50 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:21.589: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:45:21.589: INFO: rs-cgktj started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:21.589: INFO: Container donothing ready: false, restart count 0 Jan 21 17:45:21.589: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-gplfc started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:21.589: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:45:21.589: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-kprqk started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:21.589: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:45:21.589: INFO: netserver-2 started at 2023-01-21 17:45:12 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:21.589: INFO: Container webserver ready: false, restart count 0 Jan 21 17:45:21.589: INFO: netserver-2 started at 2023-01-21 17:44:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:21.589: INFO: Container webserver ready: false, restart count 0 Jan 21 17:45:21.589: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-nkjzz started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:21.589: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: false, restart count 0 Jan 21 17:45:21.589: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-857g9 started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:21.589: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:45:21.589: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-hrf6g started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:21.589: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:45:21.589: INFO: cilium-gv5dw started at 2023-01-21 17:22:46 +0000 UTC (1+1 container statuses recorded) Jan 21 17:45:21.589: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 21 17:45:21.589: INFO: Container cilium-agent ready: true, restart count 0 Jan 21 17:45:22.318: INFO: Latency metrics for node i-0d64fae545fa8bf3f Jan 21 17:45:22.318: INFO: Logging node info for node i-0e989f541e95bf4a9 Jan 21 17:45:22.534: INFO: Node Info: &Node{ObjectMeta:{i-0e989f541e95bf4a9 bf125f17-fba9-4a1f-bf10-621d29cd68aa 30967 0 2023-01-21 17:22:44 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-southeast-1 failure-domain.beta.kubernetes.io/zone:ap-southeast-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0e989f541e95bf4a9 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-southeast-1a topology.hostpath.csi/node:i-0e989f541e95bf4a9 topology.kubernetes.io/region:ap-southeast-1 topology.kubernetes.io/zone:ap-southeast-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.55.136 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0e989f541e95bf4a9"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-21 17:22:44 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:22:44 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 17:22:44 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-21 17:22:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-21 17:22:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-21 17:37:47 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-21 17:38:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-southeast-1a/i-0e989f541e95bf4a9,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078206976 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973349376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 17:43:29 +0000 UTC,LastTransitionTime:2023-01-21 17:22:44 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 17:43:29 +0000 UTC,LastTransitionTime:2023-01-21 17:22:44 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 17:43:29 +0000 UTC,LastTransitionTime:2023-01-21 17:22:44 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 17:43:29 +0000 UTC,LastTransitionTime:2023-01-21 17:23:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.55.136,},NodeAddress{Type:ExternalIP,Address:13.212.153.84,},NodeAddress{Type:InternalDNS,Address:i-0e989f541e95bf4a9.ap-southeast-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0e989f541e95bf4a9.ap-southeast-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-212-153-84.ap-southeast-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec253ae18d864ba53e81f21cc4edca85,SystemUUID:ec253ae1-8d86-4ba5-3e81-f21cc4edca85,BootID:4abbb0c1-a455-4297-b376-571ca9fcdc78,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.24.10,KubeProxyVersion:v1.24.10,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.24.10],SizeBytes:112211511,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c k8s.gcr.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa k8s.gcr.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb k8s.gcr.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 k8s.gcr.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a k8s.gcr.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf k8s.gcr.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 k8s.gcr.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7],SizeBytes:311278,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 21 17:45:22.534: INFO: Logging kubelet events for node i-0e989f541e95bf4a9 Jan 21 17:45:22.751: INFO: Logging pods the kubelet thinks is on node i-0e989f541e95bf4a9 Jan 21 17:45:22.977: INFO: netserver-3 started at 2023-01-21 17:44:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:22.977: INFO: Container webserver ready: false, restart count 0 Jan 21 17:45:22.977: INFO: netserver-3 started at 2023-01-21 17:44:45 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:22.977: INFO: Container webserver ready: false, restart count 0 Jan 21 17:45:22.977: INFO: ebs-csi-node-b9gk6 started at 2023-01-21 17:22:45 +0000 UTC (0+3 container statuses recorded) Jan 21 17:45:22.977: INFO: Container ebs-plugin ready: true, restart count 0 Jan 21 17:45:22.977: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:45:22.977: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 21 17:45:22.977: INFO: netserver-3 started at 2023-01-21 17:40:02 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:22.977: INFO: Container webserver ready: false, restart count 0 Jan 21 17:45:22.977: INFO: rs-d9mjn started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:22.977: INFO: Container donothing ready: false, restart count 0 Jan 21 17:45:22.977: INFO: rs-vk2fw started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:22.977: INFO: Container donothing ready: false, restart count 0 Jan 21 17:45:22.977: INFO: hostexec-i-0e989f541e95bf4a9-g7jqg started at 2023-01-21 17:44:18 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:22.977: INFO: Container agnhost-container ready: true, restart count 0 Jan 21 17:45:22.977: INFO: pod-49325389-814c-4807-8002-37e9e3cc1f79 started at 2023-01-21 17:44:23 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:22.977: INFO: Container write-pod ready: false, restart count 0 Jan 21 17:45:22.977: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-h9gs9 started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:22.977: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:45:22.977: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-59wkt started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:22.977: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:45:22.977: INFO: cilium-8cmqj started at 2023-01-21 17:22:45 +0000 UTC (1+1 container statuses recorded) Jan 21 17:45:22.977: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 21 17:45:22.977: INFO: Container cilium-agent ready: true, restart count 0 Jan 21 17:45:22.977: INFO: rs-r8h6b started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:22.977: INFO: Container donothing ready: false, restart count 0 Jan 21 17:45:22.977: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-xtpv2 started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:22.977: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:45:22.977: INFO: hostexec-i-0e989f541e95bf4a9-l5vnf started at 2023-01-21 17:44:08 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:22.977: INFO: Container agnhost-container ready: true, restart count 0 Jan 21 17:45:22.977: INFO: coredns-6dd78b7459-m68gs started at 2023-01-21 17:23:04 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:22.977: INFO: Container coredns ready: true, restart count 0 Jan 21 17:45:22.977: INFO: pod-ca7f77c6-03f7-48db-ac18-47b4f6e40077 started at 2023-01-21 17:44:15 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:22.977: INFO: Container write-pod ready: false, restart count 0 Jan 21 17:45:22.977: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-ztjxc started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:22.977: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:45:22.977: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-nhfcv started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:22.977: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:45:22.977: INFO: pod-subpath-test-inlinevolume-mrgk started at 2023-01-21 17:40:33 +0000 UTC (2+1 container statuses recorded) Jan 21 17:45:22.977: INFO: Init container init-volume-inlinevolume-mrgk ready: false, restart count 0 Jan 21 17:45:22.977: INFO: Init container test-init-volume-inlinevolume-mrgk ready: false, restart count 0 Jan 21 17:45:22.977: INFO: Container test-container-subpath-inlinevolume-mrgk ready: false, restart count 0 Jan 21 17:45:22.977: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-ndn5x started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:22.977: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:45:22.977: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-zrrqp started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:22.977: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:45:22.977: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-vj75s started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:22.977: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:45:22.977: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-s2hll started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:22.977: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:45:22.977: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-tz4hj started at 2023-01-21 17:37:50 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:22.977: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:45:22.977: INFO: coredns-autoscaler-5f76bf6c7b-lkrtx started at 2023-01-21 17:23:04 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:22.977: INFO: Container autoscaler ready: true, restart count 0 Jan 21 17:45:22.977: INFO: netserver-3 started at 2023-01-21 17:45:13 +0000 UTC (0+1 container statuses recorded) Jan 21 17:45:22.977: INFO: Container webserver ready: false, restart count 0 Jan 21 17:45:23.701: INFO: Latency metrics for node i-0e989f541e95bf4a9 Jan 21 17:45:23.701: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "statefulset-8899" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-network\]\sNetworking\sGranular\sChecks\:\sServices\sshould\sbe\sable\sto\shandle\slarge\srequests\:\sudp$'
test/e2e/network/networking.go:461 Jan 21 17:46:44.995: Unexpected error: <*errors.errorString | 0xc00021c1e0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred test/e2e/framework/network/utils.go:864from junit_10.xml
[BeforeEach] [sig-network] Networking test/e2e/framework/framework.go:187 �[1mSTEP�[0m: Creating a kubernetes client Jan 21 17:39:59.830: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename nettest �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace [It] should be able to handle large requests: udp test/e2e/network/networking.go:461 �[1mSTEP�[0m: Performing setup for networking test in namespace nettest-9480 �[1mSTEP�[0m: creating a selector �[1mSTEP�[0m: Creating the service pods in kubernetes Jan 21 17:40:01.332: INFO: Waiting up to 10m0s for all (but 0) nodes to be schedulable Jan 21 17:40:02.848: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:40:05.065: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:40:07.066: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:40:09.063: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:40:11.064: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:40:13.063: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:40:15.067: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:40:17.063: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:40:19.064: INFO: The status of Pod netserver-0 is Running (Ready = false) Jan 21 17:40:21.063: INFO: The status of Pod netserver-0 is Running (Ready = false) Jan 21 17:40:23.065: INFO: The status of Pod netserver-0 is Running (Ready = false) Jan 21 17:40:25.066: INFO: The status of Pod netserver-0 is Running (Ready = false) Jan 21 17:40:27.064: INFO: The status of Pod netserver-0 is Running (Ready = false) Jan 21 17:40:29.066: INFO: The status of Pod netserver-0 is Running (Ready = false) Jan 21 17:40:31.064: INFO: The status of Pod netserver-0 is Running (Ready = false) Jan 21 17:40:33.063: INFO: The status of Pod netserver-0 is Running (Ready = true) Jan 21 17:40:33.493: INFO: The status of Pod netserver-1 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:40:35.709: INFO: The status of Pod netserver-1 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:40:37.709: INFO: The status of Pod netserver-1 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:40:39.710: INFO: The status of Pod netserver-1 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:40:41.710: INFO: The status of Pod netserver-1 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:40:43.708: INFO: The status of Pod netserver-1 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:40:45.708: INFO: The status of Pod netserver-1 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:40:47.708: INFO: The status of Pod netserver-1 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:40:49.709: INFO: The status of Pod netserver-1 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:40:51.709: INFO: The status of Pod netserver-1 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:40:53.709: INFO: The status of Pod netserver-1 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:40:55.708: INFO: The status of Pod netserver-1 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:40:57.708: INFO: The status of Pod netserver-1 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:40:59.708: INFO: The status of Pod netserver-1 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:41:01.710: INFO: The status of Pod netserver-1 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:41:03.709: INFO: The status of Pod netserver-1 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:41:05.709: INFO: The status of Pod netserver-1 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:41:07.708: INFO: The status of Pod netserver-1 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:41:09.708: INFO: The status of Pod netserver-1 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:41:11.710: INFO: The status of Pod netserver-1 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:41:13.710: INFO: The status of Pod netserver-1 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:41:15.709: INFO: The status of Pod netserver-1 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:41:17.708: INFO: The status of Pod netserver-1 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:41:19.710: INFO: The status of Pod netserver-1 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:41:21.710: INFO: The status of Pod netserver-1 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:41:23.710: INFO: The status of Pod netserver-1 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:41:25.710: INFO: The status of Pod netserver-1 is Running (Ready = false) Jan 21 17:41:27.709: INFO: The status of Pod netserver-1 is Running (Ready = false) Jan 21 17:41:29.708: INFO: The status of Pod netserver-1 is Running (Ready = false) Jan 21 17:41:31.709: INFO: The status of Pod netserver-1 is Running (Ready = false) Jan 21 17:41:33.709: INFO: The status of Pod netserver-1 is Running (Ready = false) Jan 21 17:41:35.710: INFO: The status of Pod netserver-1 is Running (Ready = false) Jan 21 17:41:37.708: INFO: The status of Pod netserver-1 is Running (Ready = false) Jan 21 17:41:39.709: INFO: The status of Pod netserver-1 is Running (Ready = false) Jan 21 17:41:41.709: INFO: The status of Pod netserver-1 is Running (Ready = false) Jan 21 17:41:43.709: INFO: The status of Pod netserver-1 is Running (Ready = true) Jan 21 17:41:44.138: INFO: The status of Pod netserver-2 is Running (Ready = true) Jan 21 17:41:44.567: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:41:46.783: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:41:48.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:41:50.783: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:41:52.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:41:54.783: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:41:56.783: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:41:58.783: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:42:00.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:42:02.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:42:04.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:42:06.783: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:42:08.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:42:10.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:42:12.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:42:14.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:42:16.783: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:42:18.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:42:20.784: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:42:22.783: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:42:24.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:42:26.784: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:42:28.784: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:42:30.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:42:32.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:42:34.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:42:36.783: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:42:38.783: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:42:40.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:42:42.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:42:44.784: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:42:46.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:42:48.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:42:50.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:42:52.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:42:54.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:42:56.784: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:42:58.783: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:43:00.783: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:43:02.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:43:04.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:43:06.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:43:08.783: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:43:10.783: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:43:12.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:43:14.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:43:16.784: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:43:18.783: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:43:20.785: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:43:22.784: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:43:24.783: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:43:26.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:43:28.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:43:30.783: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:43:32.783: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:43:34.783: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:43:36.785: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:43:38.783: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:43:40.784: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:43:42.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:43:44.783: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:43:46.783: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:43:48.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:43:50.783: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:43:52.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:43:54.783: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:43:56.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:43:58.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:44:00.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:44:02.781: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:44:04.784: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:44:06.781: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:44:08.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:44:10.785: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:44:12.781: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:44:14.781: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:44:16.783: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:44:18.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:44:20.781: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:44:22.781: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:44:24.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:44:26.783: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:44:28.781: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:44:30.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:44:32.781: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:44:34.781: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:44:36.781: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:44:38.781: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:44:40.781: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:44:42.781: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:44:44.783: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:44:46.781: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:44:48.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:44:50.781: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:44:52.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:44:54.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:44:56.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:44:58.783: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:00.781: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:02.781: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:04.783: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:06.781: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:08.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:10.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:12.781: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:14.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:16.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:18.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:20.781: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:22.781: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:24.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:26.781: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:28.781: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:30.781: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:32.781: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:34.781: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:36.781: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:38.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:40.783: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:42.781: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:44.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:46.781: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:48.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:50.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:52.781: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:54.781: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:56.784: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:58.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:00.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:02.781: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:04.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:06.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:08.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:10.783: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:12.781: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:14.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:16.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:18.781: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:20.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:22.781: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:24.781: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:26.781: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:28.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:30.783: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:32.781: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:34.781: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:36.781: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:38.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:40.782: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:42.781: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:44.781: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:44.995: INFO: The status of Pod netserver-3 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:44.995: FAIL: Unexpected error: <*errors.errorString | 0xc00021c1e0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework/network.(*NetworkingTestConfig).createNetProxyPods(0xc000cee620, {0x717ecc6, 0x9}, 0xc0032e8930) test/e2e/framework/network/utils.go:864 +0x1d0 k8s.io/kubernetes/test/e2e/framework/network.(*NetworkingTestConfig).setupCore(0xc000cee620, 0x203000?) test/e2e/framework/network/utils.go:761 +0x55 k8s.io/kubernetes/test/e2e/framework/network.(*NetworkingTestConfig).setup(0xc000cee620, 0x34?) test/e2e/framework/network/utils.go:776 +0x3b k8s.io/kubernetes/test/e2e/framework/network.NewNetworkingTestConfig(0xc001483c80, {0x0, 0x0, 0x0?}) test/e2e/framework/network/utils.go:129 +0x125 k8s.io/kubernetes/test/e2e/network.glob..func21.6.19() test/e2e/network/networking.go:462 +0x36 k8s.io/kubernetes/test/e2e.RunE2ETests(0x25761d7?) test/e2e/e2e.go:130 +0x6bb k8s.io/kubernetes/test/e2e.TestE2E(0x24e52d9?) test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc000a2fba0, 0x741f9a8) /usr/local/go/src/testing/testing.go:1446 +0x10b created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1493 +0x35f [AfterEach] [sig-network] Networking test/e2e/framework/framework.go:188 �[1mSTEP�[0m: Collecting events from namespace "nettest-9480". �[1mSTEP�[0m: Found 30 events. Jan 21 17:46:45.211: INFO: At 2023-01-21 17:40:01 +0000 UTC - event for netserver-0: {default-scheduler } Scheduled: Successfully assigned nettest-9480/netserver-0 to i-03775830c60663d32 Jan 21 17:46:45.211: INFO: At 2023-01-21 17:40:02 +0000 UTC - event for netserver-0: {kubelet i-03775830c60663d32} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "605f1f5bc4ec92d84caf1e2ea5ff44b946599cf3af0eb8cb07364b93847ead8f": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:46:45.211: INFO: At 2023-01-21 17:40:02 +0000 UTC - event for netserver-1: {default-scheduler } Scheduled: Successfully assigned nettest-9480/netserver-1 to i-0c9a59753149775ab Jan 21 17:46:45.211: INFO: At 2023-01-21 17:40:02 +0000 UTC - event for netserver-1: {kubelet i-0c9a59753149775ab} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "c61527b9e4029bcb96c5925c252c7137194188c72409327616c99455cf6349a2": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:46:45.211: INFO: At 2023-01-21 17:40:02 +0000 UTC - event for netserver-2: {default-scheduler } Scheduled: Successfully assigned nettest-9480/netserver-2 to i-0d64fae545fa8bf3f Jan 21 17:46:45.211: INFO: At 2023-01-21 17:40:02 +0000 UTC - event for netserver-3: {kubelet i-0e989f541e95bf4a9} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b9918bf5d5b35669616309dbd52f55af37e4e3e291fc8230f7b26669468595fc": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:46:45.211: INFO: At 2023-01-21 17:40:02 +0000 UTC - event for netserver-3: {default-scheduler } Scheduled: Successfully assigned nettest-9480/netserver-3 to i-0e989f541e95bf4a9 Jan 21 17:46:45.211: INFO: At 2023-01-21 17:40:04 +0000 UTC - event for netserver-2: {kubelet i-0d64fae545fa8bf3f} Started: Started container webserver Jan 21 17:46:45.211: INFO: At 2023-01-21 17:40:04 +0000 UTC - event for netserver-2: {kubelet i-0d64fae545fa8bf3f} Created: Created container webserver Jan 21 17:46:45.211: INFO: At 2023-01-21 17:40:04 +0000 UTC - event for netserver-2: {kubelet i-0d64fae545fa8bf3f} Pulled: Container image "k8s.gcr.io/e2e-test-images/agnhost:2.39" already present on machine Jan 21 17:46:45.211: INFO: At 2023-01-21 17:40:15 +0000 UTC - event for netserver-1: {kubelet i-0c9a59753149775ab} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "f47c720d3762018d3f286c9998dea08f960318116b5cb3ab364968e03a1d1b40": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:46:45.211: INFO: At 2023-01-21 17:40:16 +0000 UTC - event for netserver-0: {kubelet i-03775830c60663d32} Started: Started container webserver Jan 21 17:46:45.211: INFO: At 2023-01-21 17:40:16 +0000 UTC - event for netserver-0: {kubelet i-03775830c60663d32} Created: Created container webserver Jan 21 17:46:45.211: INFO: At 2023-01-21 17:40:16 +0000 UTC - event for netserver-0: {kubelet i-03775830c60663d32} Pulled: Container image "k8s.gcr.io/e2e-test-images/agnhost:2.39" already present on machine Jan 21 17:46:45.211: INFO: At 2023-01-21 17:40:17 +0000 UTC - event for netserver-3: {kubelet i-0e989f541e95bf4a9} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "1d7f58addfb1c3e6d2fe52e71003468b936e29c6a114802aed071b5c73051b73": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:46:45.211: INFO: At 2023-01-21 17:40:29 +0000 UTC - event for netserver-1: {kubelet i-0c9a59753149775ab} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "31050dc6c9ec773ccd0bd28cfa0313887aad0f1f0092524c111ae7949a2cf661": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:46:45.211: INFO: At 2023-01-21 17:40:31 +0000 UTC - event for netserver-3: {kubelet i-0e989f541e95bf4a9} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e9f06bfb5ee6f92dd896669872c70607ba21981311015aa098a405e83fc00d65": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:46:45.211: INFO: At 2023-01-21 17:40:41 +0000 UTC - event for netserver-1: {kubelet i-0c9a59753149775ab} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "72bcce3a39a5f59809eed0b52c053bb669e6a98724e82b9b9abf0d5af4664630": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:46:45.211: INFO: At 2023-01-21 17:40:42 +0000 UTC - event for netserver-3: {kubelet i-0e989f541e95bf4a9} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a24866113171aa41fd90475173a84e4fe1a9c153bb212162763ba0bfb3a0682e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:46:45.211: INFO: At 2023-01-21 17:40:52 +0000 UTC - event for netserver-1: {kubelet i-0c9a59753149775ab} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "5d2a4c356f4d4a8ee4a373380c263e790a5d78ef36294f06d2a23c6fda712aac": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:46:45.211: INFO: At 2023-01-21 17:40:56 +0000 UTC - event for netserver-3: {kubelet i-0e989f541e95bf4a9} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "3ad6366ded8a796fcb9a7f7026110f4e95d8234adadce022602fd6f745d3f394": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:46:45.211: INFO: At 2023-01-21 17:41:07 +0000 UTC - event for netserver-1: {kubelet i-0c9a59753149775ab} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "9c2034e0c89858dfa484a2d795066c35e3c9faa4d1b94b4b26158bc6a2838841": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:46:45.211: INFO: At 2023-01-21 17:41:11 +0000 UTC - event for netserver-3: {kubelet i-0e989f541e95bf4a9} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e1ea216c3345eed2f33f7be3f8f4f818de041942de65d1cad426054ab11c550d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:46:45.211: INFO: At 2023-01-21 17:41:23 +0000 UTC - event for netserver-1: {kubelet i-0c9a59753149775ab} Pulled: Container image "k8s.gcr.io/e2e-test-images/agnhost:2.39" already present on machine Jan 21 17:46:45.211: INFO: At 2023-01-21 17:41:23 +0000 UTC - event for netserver-1: {kubelet i-0c9a59753149775ab} Created: Created container webserver Jan 21 17:46:45.211: INFO: At 2023-01-21 17:41:23 +0000 UTC - event for netserver-1: {kubelet i-0c9a59753149775ab} Started: Started container webserver Jan 21 17:46:45.211: INFO: At 2023-01-21 17:41:25 +0000 UTC - event for netserver-3: {kubelet i-0e989f541e95bf4a9} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a979e5da665d9c88704be763a9f02e83838206cb8acb8cfa13aaad9a5a071a69": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:46:45.211: INFO: At 2023-01-21 17:41:38 +0000 UTC - event for netserver-3: {kubelet i-0e989f541e95bf4a9} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b3c436bdfc259eb917fecb91a2f31814f81a9873e0c8ef0fcfac3f977f912602": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:46:45.211: INFO: At 2023-01-21 17:41:53 +0000 UTC - event for netserver-3: {kubelet i-0e989f541e95bf4a9} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "348334508e71a3566054e085c9821fe56a90deaf934ef4fb1fa66c74b6a53fdd": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:46:45.211: INFO: At 2023-01-21 17:42:06 +0000 UTC - event for netserver-3: {kubelet i-0e989f541e95bf4a9} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e465e88f3ce335dfcecc312095a4d95a901730a9290261b90bfd0957492bd765": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:46:45.425: INFO: POD NODE PHASE GRACE CONDITIONS Jan 21 17:46:45.425: INFO: netserver-0 i-03775830c60663d32 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:40:01 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:40:32 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:40:32 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:40:01 +0000 UTC }] Jan 21 17:46:45.425: INFO: netserver-1 i-0c9a59753149775ab Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:40:02 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:41:42 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:41:42 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:40:02 +0000 UTC }] Jan 21 17:46:45.425: INFO: netserver-2 i-0d64fae545fa8bf3f Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:40:02 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:40:22 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:40:22 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:40:02 +0000 UTC }] Jan 21 17:46:45.425: INFO: netserver-3 i-0e989f541e95bf4a9 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:40:02 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:40:02 +0000 UTC ContainersNotReady containers with unready status: [webserver]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:40:02 +0000 UTC ContainersNotReady containers with unready status: [webserver]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:40:02 +0000 UTC }] Jan 21 17:46:45.425: INFO: Jan 21 17:46:46.293: INFO: Unable to fetch nettest-9480/netserver-3/webserver logs: the server rejected our request for an unknown reason (get pods netserver-3) Jan 21 17:46:46.509: INFO: Logging node info for node i-03775830c60663d32 Jan 21 17:46:46.723: INFO: Node Info: &Node{ObjectMeta:{i-03775830c60663d32 7e863bb0-bd92-4fd6-abc2-40d9e11317f1 30913 0 2023-01-21 17:22:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-southeast-1 failure-domain.beta.kubernetes.io/zone:ap-southeast-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-03775830c60663d32 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-southeast-1a topology.hostpath.csi/node:i-03775830c60663d32 topology.kubernetes.io/region:ap-southeast-1 topology.kubernetes.io/zone:ap-southeast-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.55.172 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-03775830c60663d32"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-21 17:37:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-21 17:43:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-southeast-1a/i-03775830c60663d32,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078252032 0} {<nil>} 3982668Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973394432 0} {<nil>} 3880268Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 17:43:21 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 17:43:21 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 17:43:21 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 17:43:21 +0000 UTC,LastTransitionTime:2023-01-21 17:23:06 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.55.172,},NodeAddress{Type:ExternalIP,Address:13.229.107.111,},NodeAddress{Type:InternalDNS,Address:i-03775830c60663d32.ap-southeast-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-03775830c60663d32.ap-southeast-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-229-107-111.ap-southeast-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec283bf7e7ad98bfb3e8e233a27b8209,SystemUUID:ec283bf7-e7ad-98bf-b3e8-e233a27b8209,BootID:a0bdbc5b-a9a7-47cf-88a5-9de3c7f8b2ce,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.24.10,KubeProxyVersion:v1.24.10,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.24.10],SizeBytes:112211511,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa k8s.gcr.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb k8s.gcr.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 k8s.gcr.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a k8s.gcr.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 k8s.gcr.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 k8s.gcr.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f k8s.gcr.io/e2e-test-images/nginx:1.15-2],SizeBytes:7000509,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7],SizeBytes:311278,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 21 17:46:46.723: INFO: Logging kubelet events for node i-03775830c60663d32 Jan 21 17:46:46.939: INFO: Logging pods the kubelet thinks is on node i-03775830c60663d32 Jan 21 17:46:47.164: INFO: netserver-0 started at 2023-01-21 17:44:45 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:47.164: INFO: Container webserver ready: false, restart count 0 Jan 21 17:46:47.164: INFO: netserver-0 started at 2023-01-21 17:44:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:47.164: INFO: Container webserver ready: false, restart count 0 Jan 21 17:46:47.164: INFO: termination-message-containerf7a29c43-fda8-453c-8178-763ce83a42aa started at 2023-01-21 17:45:05 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:47.164: INFO: Container termination-message-container ready: false, restart count 0 Jan 21 17:46:47.164: INFO: pod-a138f362-77a8-42b7-be7c-81ec30a1b470 started at 2023-01-21 17:45:08 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:47.164: INFO: Container write-pod ready: false, restart count 0 Jan 21 17:46:47.164: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-f7vgb started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:47.164: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:46:47.164: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-8vz56 started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:47.164: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:46:47.164: INFO: rs-gqcsw started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:47.164: INFO: Container donothing ready: false, restart count 0 Jan 21 17:46:47.164: INFO: security-context-438aba9f-ab6c-4a18-8b67-6b803986e06f started at 2023-01-21 17:44:07 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:47.164: INFO: Container test-container ready: false, restart count 0 Jan 21 17:46:47.164: INFO: externalname-service-2dzs9 started at 2023-01-21 17:44:17 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:47.164: INFO: Container externalname-service ready: false, restart count 0 Jan 21 17:46:47.164: INFO: netserver-0 started at 2023-01-21 17:40:01 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:47.164: INFO: Container webserver ready: true, restart count 0 Jan 21 17:46:47.164: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-nwcqs started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:47.164: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:46:47.164: INFO: pod1 started at 2023-01-21 17:46:06 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:47.164: INFO: Container agnhost-container ready: false, restart count 0 Jan 21 17:46:47.164: INFO: rs-6zfxj started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:47.165: INFO: Container donothing ready: false, restart count 0 Jan 21 17:46:47.165: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-g72gd started at 2023-01-21 17:37:50 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:47.165: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:46:47.165: INFO: sample-webhook-deployment-68c7bd4684-gmll7 started at 2023-01-21 17:44:17 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:47.165: INFO: Container sample-webhook ready: false, restart count 0 Jan 21 17:46:47.165: INFO: rs-8t6wd started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:47.165: INFO: Container donothing ready: true, restart count 0 Jan 21 17:46:47.165: INFO: pod-with-prestop-exec-hook started at 2023-01-21 17:44:21 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:47.165: INFO: Container pod-with-prestop-exec-hook ready: false, restart count 0 Jan 21 17:46:47.165: INFO: termination-message-containerc3566fe9-0af4-4730-b56f-b8798d88d529 started at 2023-01-21 17:44:38 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:47.165: INFO: Container termination-message-container ready: false, restart count 0 Jan 21 17:46:47.165: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-8b9jt started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:47.165: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:46:47.165: INFO: pod-projected-configmaps-4a3b7bfa-4656-4473-85e4-36e0b966a7cc started at 2023-01-21 17:45:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:47.165: INFO: Container agnhost-container ready: false, restart count 0 Jan 21 17:46:47.165: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-k4jpx started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:47.165: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:46:47.165: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-49cq9 started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:47.165: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:46:47.165: INFO: ebs-csi-node-lsgbl started at 2023-01-21 17:22:46 +0000 UTC (0+3 container statuses recorded) Jan 21 17:46:47.165: INFO: Container ebs-plugin ready: true, restart count 0 Jan 21 17:46:47.165: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:46:47.165: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 21 17:46:47.165: INFO: cilium-2tq4w started at 2023-01-21 17:22:46 +0000 UTC (1+1 container statuses recorded) Jan 21 17:46:47.165: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 21 17:46:47.165: INFO: Container cilium-agent ready: true, restart count 0 Jan 21 17:46:47.165: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-tfbvc started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:47.165: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:46:47.165: INFO: hostexec-i-03775830c60663d32-h4jm4 started at 2023-01-21 17:45:03 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:47.165: INFO: Container agnhost-container ready: true, restart count 0 Jan 21 17:46:47.165: INFO: netserver-0 started at 2023-01-21 17:45:12 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:47.165: INFO: Container webserver ready: false, restart count 0 Jan 21 17:46:47.165: INFO: pod-projected-secrets-0da06512-5c21-4d72-a2c9-3392bd5c6e89 started at 2023-01-21 17:44:29 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:47.165: INFO: Container secret-volume-test ready: false, restart count 0 Jan 21 17:46:47.165: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-m9bgz started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:47.165: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:46:47.165: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-vjvht started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:47.165: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:46:48.084: INFO: Latency metrics for node i-03775830c60663d32 Jan 21 17:46:48.084: INFO: Logging node info for node i-089df1bd1599c9fac Jan 21 17:46:48.298: INFO: Node Info: &Node{ObjectMeta:{i-089df1bd1599c9fac 5933bf32-55e4-4bc6-811a-9ebde5df5619 31031 0 2023-01-21 17:20:48 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-southeast-1 failure-domain.beta.kubernetes.io/zone:ap-southeast-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-089df1bd1599c9fac kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:ap-southeast-1a topology.kubernetes.io/region:ap-southeast-1 topology.kubernetes.io/zone:ap-southeast-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.40.1 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-089df1bd1599c9fac"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-21 17:20:48 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-21 17:21:14 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:21:23 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:21:23 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 17:21:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-21 17:23:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-southeast-1a/i-089df1bd1599c9fac,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3889451008 0} {<nil>} 3798292Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3784593408 0} {<nil>} 3695892Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 17:43:38 +0000 UTC,LastTransitionTime:2023-01-21 17:20:46 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 17:43:38 +0000 UTC,LastTransitionTime:2023-01-21 17:20:46 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 17:43:38 +0000 UTC,LastTransitionTime:2023-01-21 17:20:46 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 17:43:38 +0000 UTC,LastTransitionTime:2023-01-21 17:21:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.40.1,},NodeAddress{Type:ExternalIP,Address:13.212.76.186,},NodeAddress{Type:InternalDNS,Address:i-089df1bd1599c9fac.ap-southeast-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-089df1bd1599c9fac.ap-southeast-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-212-76-186.ap-southeast-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec28683bad10cfdec8fa4bd6c22408b7,SystemUUID:ec28683b-ad10-cfde-c8fa-4bd6c22408b7,BootID:a32c6813-ffd6-4923-a901-e3a8658adebd,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.24.10,KubeProxyVersion:v1.24.10,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64@sha256:6db2761074bae8385aa601d4b45ab065893cfdc258d8b2593fc56698c44dbee5 k8s.gcr.io/kube-apiserver-amd64:v1.24.10 registry.k8s.io/kube-apiserver-amd64:v1.24.10],SizeBytes:131733971,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64@sha256:8867df47c332bae8dfd061b4d4230cd0febcc5a8a427ecb2e8f70b33ffc6d732 k8s.gcr.io/kube-controller-manager-amd64:v1.24.10 registry.k8s.io/kube-controller-manager-amd64:v1.24.10],SizeBytes:121342265,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.24.10],SizeBytes:112211511,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64@sha256:a589f10748fa227ea6ebf0730126f3f192cbdbb2c7f96a9d4685cabb86eb1cbc k8s.gcr.io/kube-scheduler-amd64:v1.24.10 registry.k8s.io/kube-scheduler-amd64:v1.24.10],SizeBytes:52751160,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-beta.2],SizeBytes:43191763,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-beta.2],SizeBytes:42821714,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:245e81c2ed53b5508a6f687f3ab0c724b9ab31e6a5fa5e6d2f814981ab6ce55f registry.k8s.io/provider-aws/cloud-controller-manager:v1.24.3],SizeBytes:18282737,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-beta.2],SizeBytes:4965793,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 21 17:46:48.299: INFO: Logging kubelet events for node i-089df1bd1599c9fac Jan 21 17:46:48.514: INFO: Logging pods the kubelet thinks is on node i-089df1bd1599c9fac Jan 21 17:46:48.736: INFO: ebs-csi-node-j7jjl started at 2023-01-21 17:21:19 +0000 UTC (0+3 container statuses recorded) Jan 21 17:46:48.736: INFO: Container ebs-plugin ready: true, restart count 0 Jan 21 17:46:48.736: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:46:48.736: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 21 17:46:48.736: INFO: ebs-csi-controller-779575c67d-scjvt started at 2023-01-21 17:21:19 +0000 UTC (0+5 container statuses recorded) Jan 21 17:46:48.736: INFO: Container csi-attacher ready: true, restart count 0 Jan 21 17:46:48.736: INFO: Container csi-provisioner ready: true, restart count 0 Jan 21 17:46:48.736: INFO: Container csi-resizer ready: true, restart count 0 Jan 21 17:46:48.736: INFO: Container ebs-plugin ready: true, restart count 0 Jan 21 17:46:48.736: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:46:48.736: INFO: kube-controller-manager-i-089df1bd1599c9fac started at 2023-01-21 17:20:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:48.736: INFO: Container kube-controller-manager ready: true, restart count 3 Jan 21 17:46:48.736: INFO: etcd-manager-events-i-089df1bd1599c9fac started at 2023-01-21 17:20:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:48.736: INFO: Container etcd-manager ready: true, restart count 0 Jan 21 17:46:48.736: INFO: etcd-manager-main-i-089df1bd1599c9fac started at 2023-01-21 17:20:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:48.736: INFO: Container etcd-manager ready: true, restart count 0 Jan 21 17:46:48.736: INFO: kops-controller-7fpkx started at 2023-01-21 17:21:18 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:48.736: INFO: Container kops-controller ready: true, restart count 0 Jan 21 17:46:48.736: INFO: cilium-operator-8d8478c74-hpl2l started at 2023-01-21 17:21:19 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:48.736: INFO: Container cilium-operator ready: true, restart count 0 Jan 21 17:46:48.736: INFO: dns-controller-7d4957564c-rk48f started at 2023-01-21 17:21:19 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:48.736: INFO: Container dns-controller ready: true, restart count 0 Jan 21 17:46:48.736: INFO: kube-scheduler-i-089df1bd1599c9fac started at 2023-01-21 17:20:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:48.736: INFO: Container kube-scheduler ready: true, restart count 0 Jan 21 17:46:48.736: INFO: kube-apiserver-i-089df1bd1599c9fac started at 2023-01-21 17:20:10 +0000 UTC (0+2 container statuses recorded) Jan 21 17:46:48.736: INFO: Container healthcheck ready: true, restart count 0 Jan 21 17:46:48.736: INFO: Container kube-apiserver ready: true, restart count 1 Jan 21 17:46:48.736: INFO: aws-cloud-controller-manager-lt9wb started at 2023-01-21 17:21:18 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:48.736: INFO: Container aws-cloud-controller-manager ready: true, restart count 0 Jan 21 17:46:48.736: INFO: cilium-nj7m8 started at 2023-01-21 17:21:19 +0000 UTC (1+1 container statuses recorded) Jan 21 17:46:48.736: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 21 17:46:48.736: INFO: Container cilium-agent ready: true, restart count 1 Jan 21 17:46:49.428: INFO: Latency metrics for node i-089df1bd1599c9fac Jan 21 17:46:49.428: INFO: Logging node info for node i-0c9a59753149775ab Jan 21 17:46:49.642: INFO: Node Info: &Node{ObjectMeta:{i-0c9a59753149775ab 5c157934-21a3-4b7b-9fa3-5c66b5b25ec5 31621 0 2023-01-21 17:22:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-southeast-1 failure-domain.beta.kubernetes.io/zone:ap-southeast-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0c9a59753149775ab kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-southeast-1a topology.hostpath.csi/node:i-0c9a59753149775ab topology.kubernetes.io/region:ap-southeast-1 topology.kubernetes.io/zone:ap-southeast-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.34.240 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-2289":"i-0c9a59753149775ab","ebs.csi.aws.com":"i-0c9a59753149775ab"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-21 17:37:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-21 17:39:09 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-21 17:39:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-southeast-1a/i-0c9a59753149775ab,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 17:44:24 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 17:44:24 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 17:44:24 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 17:44:24 +0000 UTC,LastTransitionTime:2023-01-21 17:23:06 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.34.240,},NodeAddress{Type:ExternalIP,Address:13.212.2.160,},NodeAddress{Type:InternalDNS,Address:i-0c9a59753149775ab.ap-southeast-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0c9a59753149775ab.ap-southeast-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-212-2-160.ap-southeast-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2610052ce207b4f84f50e9ba8d53ab,SystemUUID:ec261005-2ce2-07b4-f84f-50e9ba8d53ab,BootID:ff39a0e3-8cb1-4190-8b6d-8912e2826f9a,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.24.10,KubeProxyVersion:v1.24.10,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.24.10],SizeBytes:112211511,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa k8s.gcr.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb k8s.gcr.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 k8s.gcr.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a k8s.gcr.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 k8s.gcr.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 k8s.gcr.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f k8s.gcr.io/e2e-test-images/nginx:1.15-2],SizeBytes:7000509,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7],SizeBytes:311278,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-2289^c0d62f16-99b2-11ed-8b7e-4a565f54742c kubernetes.io/csi/ebs.csi.aws.com^vol-08c4c6da9de04f66c],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-08c4c6da9de04f66c,DevicePath:,},},Config:nil,},} Jan 21 17:46:49.643: INFO: Logging kubelet events for node i-0c9a59753149775ab Jan 21 17:46:49.860: INFO: Logging pods the kubelet thinks is on node i-0c9a59753149775ab Jan 21 17:46:50.085: INFO: pvc-volume-tester-n795w started at 2023-01-21 17:40:54 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:50.085: INFO: Container volume-tester ready: false, restart count 0 Jan 21 17:46:50.085: INFO: downwardapi-volume-95fcbaab-e363-4f31-9911-b03b2af3661d started at 2023-01-21 17:43:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:50.085: INFO: Container client-container ready: false, restart count 0 Jan 21 17:46:50.085: INFO: rs-mkvfg started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:50.085: INFO: Container donothing ready: false, restart count 0 Jan 21 17:46:50.085: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-lwrkc started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:50.085: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:46:50.085: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-lhl2j started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:50.085: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:46:50.085: INFO: cilium-7h9rt started at 2023-01-21 17:22:46 +0000 UTC (1+1 container statuses recorded) Jan 21 17:46:50.085: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 21 17:46:50.085: INFO: Container cilium-agent ready: true, restart count 0 Jan 21 17:46:50.085: INFO: pod-subpath-test-inlinevolume-gkbp started at 2023-01-21 17:45:21 +0000 UTC (1+1 container statuses recorded) Jan 21 17:46:50.085: INFO: Init container init-volume-inlinevolume-gkbp ready: false, restart count 0 Jan 21 17:46:50.085: INFO: Container test-container-subpath-inlinevolume-gkbp ready: false, restart count 0 Jan 21 17:46:50.085: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-s4jct started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:50.085: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:46:50.085: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-w47qr started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:50.085: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:46:50.085: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-rvh9t started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:50.085: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: false, restart count 0 Jan 21 17:46:50.085: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-b7bsr started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:50.085: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:46:50.085: INFO: netserver-1 started at 2023-01-21 17:44:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:50.085: INFO: Container webserver ready: false, restart count 0 Jan 21 17:46:50.085: INFO: ebs-csi-node-vzcrc started at 2023-01-21 17:22:46 +0000 UTC (0+3 container statuses recorded) Jan 21 17:46:50.085: INFO: Container ebs-plugin ready: true, restart count 0 Jan 21 17:46:50.085: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:46:50.085: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 21 17:46:50.085: INFO: rs-fjjf2 started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:50.085: INFO: Container donothing ready: false, restart count 0 Jan 21 17:46:50.085: INFO: csi-mockplugin-0 started at 2023-01-21 17:38:20 +0000 UTC (0+3 container statuses recorded) Jan 21 17:46:50.085: INFO: Container csi-provisioner ready: true, restart count 0 Jan 21 17:46:50.085: INFO: Container driver-registrar ready: true, restart count 0 Jan 21 17:46:50.085: INFO: Container mock ready: true, restart count 0 Jan 21 17:46:50.085: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-drmzt started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:50.085: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:46:50.085: INFO: local-injector started at 2023-01-21 17:43:51 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:50.085: INFO: Container local-injector ready: false, restart count 0 Jan 21 17:46:50.085: INFO: netserver-1 started at 2023-01-21 17:45:12 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:50.085: INFO: Container webserver ready: false, restart count 0 Jan 21 17:46:50.085: INFO: netserver-1 started at 2023-01-21 17:40:02 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:50.085: INFO: Container webserver ready: true, restart count 0 Jan 21 17:46:50.085: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-6hvtr started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:50.085: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:46:50.085: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-g9wzw started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:50.085: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:46:50.085: INFO: pod-fe7c6a63-1f80-4b91-ac3a-2dfe1958668a started at 2023-01-21 17:39:07 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:50.085: INFO: Container write-pod ready: false, restart count 0 Jan 21 17:46:50.085: INFO: csi-mockplugin-attacher-0 started at 2023-01-21 17:38:21 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:50.085: INFO: Container csi-attacher ready: false, restart count 0 Jan 21 17:46:50.085: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-z9h5n started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:50.085: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:46:50.085: INFO: netserver-1 started at 2023-01-21 17:44:45 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:50.085: INFO: Container webserver ready: false, restart count 0 Jan 21 17:46:50.085: INFO: pod-handle-http-request started at 2023-01-21 17:39:27 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:50.085: INFO: Container agnhost-container ready: true, restart count 0 Jan 21 17:46:50.085: INFO: hostexec-i-0c9a59753149775ab-rxv2t started at 2023-01-21 17:43:28 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:50.085: INFO: Container agnhost-container ready: true, restart count 0 Jan 21 17:46:50.814: INFO: Latency metrics for node i-0c9a59753149775ab Jan 21 17:46:50.815: INFO: Logging node info for node i-0d64fae545fa8bf3f Jan 21 17:46:51.029: INFO: Node Info: &Node{ObjectMeta:{i-0d64fae545fa8bf3f 77fc61e9-438c-4f3e-98aa-2b457c1202a0 31733 0 2023-01-21 17:22:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-southeast-1 failure-domain.beta.kubernetes.io/zone:ap-southeast-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0d64fae545fa8bf3f kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-southeast-1a topology.hostpath.csi/node:i-0d64fae545fa8bf3f topology.kubernetes.io/region:ap-southeast-1 topology.kubernetes.io/zone:ap-southeast-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.53.147 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-volume-expand-9636":"i-0d64fae545fa8bf3f","ebs.csi.aws.com":"i-0d64fae545fa8bf3f"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-21 17:37:47 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-21 17:44:29 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-21 17:44:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-southeast-1a/i-0d64fae545fa8bf3f,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 17:44:32 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 17:44:32 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 17:44:32 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 17:44:32 +0000 UTC,LastTransitionTime:2023-01-21 17:23:05 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.53.147,},NodeAddress{Type:ExternalIP,Address:13.229.75.189,},NodeAddress{Type:InternalDNS,Address:i-0d64fae545fa8bf3f.ap-southeast-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0d64fae545fa8bf3f.ap-southeast-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-229-75-189.ap-southeast-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2dfae26c309b0dd5a9ccb311cb6042,SystemUUID:ec2dfae2-6c30-9b0d-d5a9-ccb311cb6042,BootID:6e6cce59-de74-4521-b0ec-ab95e71b1046,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.24.10,KubeProxyVersion:v1.24.10,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.24.10],SizeBytes:112211511,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c k8s.gcr.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/sample-apiserver@sha256:f9c93b92b6ff750b41a93c4e4fe0bfe384597aeb841e2539d5444815c55b2d8f k8s.gcr.io/e2e-test-images/sample-apiserver:1.17.5],SizeBytes:24316368,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa k8s.gcr.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb k8s.gcr.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 k8s.gcr.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a k8s.gcr.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 k8s.gcr.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7],SizeBytes:311278,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-volume-expand-9636^40436064-99b3-11ed-aefe-f2f9c54a4473],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-volume-expand-9636^40436064-99b3-11ed-aefe-f2f9c54a4473,DevicePath:,},},Config:nil,},} Jan 21 17:46:51.029: INFO: Logging kubelet events for node i-0d64fae545fa8bf3f Jan 21 17:46:51.245: INFO: Logging pods the kubelet thinks is on node i-0d64fae545fa8bf3f Jan 21 17:46:51.470: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-zjvp4 started at 2023-01-21 17:37:50 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:51.471: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:46:51.471: INFO: rs-cgktj started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:51.471: INFO: Container donothing ready: false, restart count 0 Jan 21 17:46:51.471: INFO: ebs-csi-node-k2jhx started at 2023-01-21 17:22:46 +0000 UTC (0+3 container statuses recorded) Jan 21 17:46:51.471: INFO: Container ebs-plugin ready: true, restart count 0 Jan 21 17:46:51.471: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:46:51.471: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 21 17:46:51.471: INFO: externalname-service-nz5lf started at 2023-01-21 17:44:17 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:51.471: INFO: Container externalname-service ready: false, restart count 0 Jan 21 17:46:51.471: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-fbjxh started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:51.471: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:46:51.471: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-gplfc started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:51.471: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:46:51.471: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-kprqk started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:51.471: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:46:51.471: INFO: netserver-2 started at 2023-01-21 17:45:12 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:51.471: INFO: Container webserver ready: false, restart count 0 Jan 21 17:46:51.471: INFO: netserver-2 started at 2023-01-21 17:44:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:51.471: INFO: Container webserver ready: false, restart count 0 Jan 21 17:46:51.471: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-hrf6g started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:51.471: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:46:51.471: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-nkjzz started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:51.471: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: false, restart count 0 Jan 21 17:46:51.471: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-857g9 started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:51.471: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:46:51.471: INFO: cilium-gv5dw started at 2023-01-21 17:22:46 +0000 UTC (1+1 container statuses recorded) Jan 21 17:46:51.471: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 21 17:46:51.471: INFO: Container cilium-agent ready: true, restart count 0 Jan 21 17:46:51.471: INFO: netserver-2 started at 2023-01-21 17:40:02 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:51.471: INFO: Container webserver ready: true, restart count 0 Jan 21 17:46:51.471: INFO: csi-hostpathplugin-0 started at 2023-01-21 17:45:35 +0000 UTC (0+7 container statuses recorded) Jan 21 17:46:51.471: INFO: Container csi-attacher ready: false, restart count 0 Jan 21 17:46:51.471: INFO: Container csi-provisioner ready: false, restart count 0 Jan 21 17:46:51.471: INFO: Container csi-resizer ready: false, restart count 0 Jan 21 17:46:51.471: INFO: Container csi-snapshotter ready: false, restart count 0 Jan 21 17:46:51.471: INFO: Container hostpath ready: false, restart count 0 Jan 21 17:46:51.471: INFO: Container liveness-probe ready: false, restart count 0 Jan 21 17:46:51.471: INFO: Container node-driver-registrar ready: false, restart count 0 Jan 21 17:46:51.471: INFO: coredns-6dd78b7459-44jzj started at 2023-01-21 17:23:22 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:51.471: INFO: Container coredns ready: true, restart count 0 Jan 21 17:46:51.471: INFO: csi-hostpathplugin-0 started at 2023-01-21 17:44:10 +0000 UTC (0+7 container statuses recorded) Jan 21 17:46:51.471: INFO: Container csi-attacher ready: true, restart count 0 Jan 21 17:46:51.471: INFO: Container csi-provisioner ready: true, restart count 0 Jan 21 17:46:51.471: INFO: Container csi-resizer ready: true, restart count 0 Jan 21 17:46:51.471: INFO: Container csi-snapshotter ready: true, restart count 0 Jan 21 17:46:51.471: INFO: Container hostpath ready: true, restart count 0 Jan 21 17:46:51.471: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:46:51.471: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 21 17:46:51.471: INFO: netserver-2 started at 2023-01-21 17:44:45 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:51.471: INFO: Container webserver ready: false, restart count 0 Jan 21 17:46:51.471: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-k5qhx started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:51.471: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:46:51.471: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-gj9hg started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:51.471: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:46:51.471: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-dhzrx started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:51.471: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:46:51.471: INFO: rs-rvl99 started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:51.471: INFO: Container donothing ready: false, restart count 0 Jan 21 17:46:51.471: INFO: pod-c4a96c13-73b3-4bb4-b100-d87d572fe413 started at 2023-01-21 17:44:29 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:51.471: INFO: Container write-pod ready: false, restart count 0 Jan 21 17:46:52.221: INFO: Latency metrics for node i-0d64fae545fa8bf3f Jan 21 17:46:52.221: INFO: Logging node info for node i-0e989f541e95bf4a9 Jan 21 17:46:52.435: INFO: Node Info: &Node{ObjectMeta:{i-0e989f541e95bf4a9 bf125f17-fba9-4a1f-bf10-621d29cd68aa 30967 0 2023-01-21 17:22:44 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-southeast-1 failure-domain.beta.kubernetes.io/zone:ap-southeast-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0e989f541e95bf4a9 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-southeast-1a topology.hostpath.csi/node:i-0e989f541e95bf4a9 topology.kubernetes.io/region:ap-southeast-1 topology.kubernetes.io/zone:ap-southeast-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.55.136 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0e989f541e95bf4a9"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-21 17:22:44 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:22:44 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 17:22:44 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-21 17:22:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-21 17:22:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-21 17:37:47 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-21 17:38:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-southeast-1a/i-0e989f541e95bf4a9,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078206976 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973349376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 17:43:29 +0000 UTC,LastTransitionTime:2023-01-21 17:22:44 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 17:43:29 +0000 UTC,LastTransitionTime:2023-01-21 17:22:44 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 17:43:29 +0000 UTC,LastTransitionTime:2023-01-21 17:22:44 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 17:43:29 +0000 UTC,LastTransitionTime:2023-01-21 17:23:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.55.136,},NodeAddress{Type:ExternalIP,Address:13.212.153.84,},NodeAddress{Type:InternalDNS,Address:i-0e989f541e95bf4a9.ap-southeast-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0e989f541e95bf4a9.ap-southeast-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-212-153-84.ap-southeast-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec253ae18d864ba53e81f21cc4edca85,SystemUUID:ec253ae1-8d86-4ba5-3e81-f21cc4edca85,BootID:4abbb0c1-a455-4297-b376-571ca9fcdc78,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.24.10,KubeProxyVersion:v1.24.10,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.24.10],SizeBytes:112211511,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c k8s.gcr.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa k8s.gcr.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb k8s.gcr.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 k8s.gcr.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a k8s.gcr.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf k8s.gcr.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 k8s.gcr.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7],SizeBytes:311278,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 21 17:46:52.435: INFO: Logging kubelet events for node i-0e989f541e95bf4a9 Jan 21 17:46:52.651: INFO: Logging pods the kubelet thinks is on node i-0e989f541e95bf4a9 Jan 21 17:46:52.877: INFO: hostexec-i-0e989f541e95bf4a9-l5vnf started at 2023-01-21 17:44:08 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:52.877: INFO: Container agnhost-container ready: true, restart count 0 Jan 21 17:46:52.877: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-xtpv2 started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:52.877: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:46:52.877: INFO: coredns-6dd78b7459-m68gs started at 2023-01-21 17:23:04 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:52.877: INFO: Container coredns ready: true, restart count 0 Jan 21 17:46:52.877: INFO: pod-ca7f77c6-03f7-48db-ac18-47b4f6e40077 started at 2023-01-21 17:44:15 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:52.877: INFO: Container write-pod ready: false, restart count 0 Jan 21 17:46:52.877: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-ztjxc started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:52.877: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:46:52.877: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-nhfcv started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:52.877: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:46:52.877: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-vj75s started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:52.877: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:46:52.877: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-s2hll started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:52.877: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:46:52.877: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-tz4hj started at 2023-01-21 17:37:50 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:52.877: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:46:52.877: INFO: coredns-autoscaler-5f76bf6c7b-lkrtx started at 2023-01-21 17:23:04 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:52.877: INFO: Container autoscaler ready: true, restart count 0 Jan 21 17:46:52.877: INFO: netserver-3 started at 2023-01-21 17:45:13 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:52.877: INFO: Container webserver ready: false, restart count 0 Jan 21 17:46:52.877: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-ndn5x started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:52.877: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:46:52.877: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-zrrqp started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:52.877: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:46:52.877: INFO: ebs-csi-node-b9gk6 started at 2023-01-21 17:22:45 +0000 UTC (0+3 container statuses recorded) Jan 21 17:46:52.877: INFO: Container ebs-plugin ready: true, restart count 0 Jan 21 17:46:52.877: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:46:52.877: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 21 17:46:52.877: INFO: netserver-3 started at 2023-01-21 17:40:02 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:52.877: INFO: Container webserver ready: false, restart count 0 Jan 21 17:46:52.877: INFO: netserver-3 started at 2023-01-21 17:44:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:52.877: INFO: Container webserver ready: false, restart count 0 Jan 21 17:46:52.877: INFO: netserver-3 started at 2023-01-21 17:44:45 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:52.877: INFO: Container webserver ready: false, restart count 0 Jan 21 17:46:52.877: INFO: hostexec-i-0e989f541e95bf4a9-g7jqg started at 2023-01-21 17:44:18 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:52.877: INFO: Container agnhost-container ready: true, restart count 0 Jan 21 17:46:52.877: INFO: pod-49325389-814c-4807-8002-37e9e3cc1f79 started at 2023-01-21 17:44:23 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:52.877: INFO: Container write-pod ready: false, restart count 0 Jan 21 17:46:52.877: INFO: rs-d9mjn started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:52.877: INFO: Container donothing ready: false, restart count 0 Jan 21 17:46:52.877: INFO: rs-vk2fw started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:52.877: INFO: Container donothing ready: false, restart count 0 Jan 21 17:46:52.877: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-59wkt started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:52.877: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:46:52.877: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-h9gs9 started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:52.877: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:46:52.877: INFO: cilium-8cmqj started at 2023-01-21 17:22:45 +0000 UTC (1+1 container statuses recorded) Jan 21 17:46:52.877: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 21 17:46:52.877: INFO: Container cilium-agent ready: true, restart count 0 Jan 21 17:46:52.877: INFO: rs-r8h6b started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:46:52.877: INFO: Container donothing ready: false, restart count 0 Jan 21 17:46:53.586: INFO: Latency metrics for node i-0e989f541e95bf4a9 Jan 21 17:46:53.586: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "nettest-9480" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-network\]\sNetworking\sGranular\sChecks\:\sServices\sshould\sfunction\sfor\spod\-Service\:\shttp$'
test/e2e/network/networking.go:147 Jan 21 17:50:13.813: Unexpected error: <*errors.errorString | 0xc00021c1e0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred test/e2e/framework/network/utils.go:864from junit_07.xml
[BeforeEach] [sig-network] Networking test/e2e/framework/framework.go:187 �[1mSTEP�[0m: Creating a kubernetes client Jan 21 17:45:10.374: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename nettest �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace [It] should function for pod-Service: http test/e2e/network/networking.go:147 �[1mSTEP�[0m: Performing setup for networking test in namespace nettest-5257 �[1mSTEP�[0m: creating a selector �[1mSTEP�[0m: Creating the service pods in kubernetes Jan 21 17:45:11.872: INFO: Waiting up to 10m0s for all (but 0) nodes to be schedulable Jan 21 17:45:13.385: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:15.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:17.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:19.601: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:21.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:23.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:25.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:27.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:29.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:31.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:33.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:35.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:37.601: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:39.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:41.601: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:43.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:45.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:47.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:49.599: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:51.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:53.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:55.601: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:57.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:59.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:01.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:03.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:05.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:07.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:09.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:11.601: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:13.601: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:15.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:17.601: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:19.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:21.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:23.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:25.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:27.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:29.601: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:31.599: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:33.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:35.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:37.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:39.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:41.601: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:43.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:45.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:47.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:49.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:51.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:53.601: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:55.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:57.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:59.601: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:01.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:03.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:05.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:07.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:09.601: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:11.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:13.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:15.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:17.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:19.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:21.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:23.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:25.601: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:27.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:29.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:31.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:33.601: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:35.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:37.601: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:39.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:41.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:43.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:45.599: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:47.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:49.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:51.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:53.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:55.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:57.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:59.606: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:01.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:03.601: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:05.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:07.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:09.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:11.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:13.601: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:15.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:17.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:19.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:21.601: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:23.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:25.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:27.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:29.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:31.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:33.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:35.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:37.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:39.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:41.599: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:43.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:45.599: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:47.602: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:49.599: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:51.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:53.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:55.601: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:57.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:59.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:49:01.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:49:03.601: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:49:05.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:49:07.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:49:09.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:49:11.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:49:13.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:49:15.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:49:17.601: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:49:19.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:49:21.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:49:23.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:49:25.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:49:27.599: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:49:29.599: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:49:31.599: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:49:33.599: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:49:35.599: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:49:37.599: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:49:39.598: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:49:41.599: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:49:43.598: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:49:45.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:49:47.599: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:49:49.599: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:49:51.599: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:49:53.599: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:49:55.599: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:49:57.599: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:49:59.599: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:50:01.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:50:03.599: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:50:05.600: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:50:07.599: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:50:09.599: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:50:11.599: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:50:13.599: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:50:13.812: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:50:13.813: FAIL: Unexpected error: <*errors.errorString | 0xc00021c1e0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework/network.(*NetworkingTestConfig).createNetProxyPods(0xc00258e620, {0x717ecc6, 0x9}, 0xc002b0fd40) test/e2e/framework/network/utils.go:864 +0x1d0 k8s.io/kubernetes/test/e2e/framework/network.(*NetworkingTestConfig).setupCore(0xc00258e620, 0x203000?) test/e2e/framework/network/utils.go:761 +0x55 k8s.io/kubernetes/test/e2e/framework/network.(*NetworkingTestConfig).setup(0xc00258e620, 0x34?) test/e2e/framework/network/utils.go:776 +0x3b k8s.io/kubernetes/test/e2e/framework/network.NewNetworkingTestConfig(0xc000e23e00, {0x0, 0x0, 0x0?}) test/e2e/framework/network/utils.go:129 +0x125 k8s.io/kubernetes/test/e2e/network.glob..func21.6.1() test/e2e/network/networking.go:148 +0x36 k8s.io/kubernetes/test/e2e.RunE2ETests(0x25761d7?) test/e2e/e2e.go:130 +0x6bb k8s.io/kubernetes/test/e2e.TestE2E(0x0?) test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc0008b2340, 0x741f9a8) /usr/local/go/src/testing/testing.go:1446 +0x10b created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1493 +0x35f [AfterEach] [sig-network] Networking test/e2e/framework/framework.go:188 �[1mSTEP�[0m: Collecting events from namespace "nettest-5257". �[1mSTEP�[0m: Found 53 events. Jan 21 17:50:14.028: INFO: At 2023-01-21 17:45:12 +0000 UTC - event for netserver-0: {kubelet i-03775830c60663d32} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "8378d8cf7400e99423bd2635a4c981fea6a4739b29850a8291af6864e9ab4187": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:50:14.028: INFO: At 2023-01-21 17:45:12 +0000 UTC - event for netserver-0: {default-scheduler } Scheduled: Successfully assigned nettest-5257/netserver-0 to i-03775830c60663d32 Jan 21 17:50:14.028: INFO: At 2023-01-21 17:45:12 +0000 UTC - event for netserver-1: {default-scheduler } Scheduled: Successfully assigned nettest-5257/netserver-1 to i-0c9a59753149775ab Jan 21 17:50:14.028: INFO: At 2023-01-21 17:45:12 +0000 UTC - event for netserver-2: {default-scheduler } Scheduled: Successfully assigned nettest-5257/netserver-2 to i-0d64fae545fa8bf3f Jan 21 17:50:14.028: INFO: At 2023-01-21 17:45:13 +0000 UTC - event for netserver-1: {kubelet i-0c9a59753149775ab} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "00de15b33094565effc15f59e0a6c4a6637b3a9e86f690ac69ac388be7688b00": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:50:14.028: INFO: At 2023-01-21 17:45:13 +0000 UTC - event for netserver-2: {kubelet i-0d64fae545fa8bf3f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "90efd72357e399ae58f293b9a7c3498041f3c50b323052f6ea806f3105d95e72": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:50:14.028: INFO: At 2023-01-21 17:45:13 +0000 UTC - event for netserver-3: {kubelet i-0e989f541e95bf4a9} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d6260102706d3c06b56fb286c0bd7469823639c6c2976d7d27727d3a633bd7ee": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:50:14.028: INFO: At 2023-01-21 17:45:13 +0000 UTC - event for netserver-3: {default-scheduler } Scheduled: Successfully assigned nettest-5257/netserver-3 to i-0e989f541e95bf4a9 Jan 21 17:50:14.028: INFO: At 2023-01-21 17:45:24 +0000 UTC - event for netserver-3: {kubelet i-0e989f541e95bf4a9} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "3dace8db7b53b2ce41b198d73e27548a4cd98469cb4820ee9a2d09b6f32265a5": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:50:14.028: INFO: At 2023-01-21 17:45:27 +0000 UTC - event for netserver-0: {kubelet i-03775830c60663d32} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "3790043fd68616717b683e5f3e187fa528dda2162656de7d017678f2ef1f8319": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:50:14.028: INFO: At 2023-01-21 17:45:27 +0000 UTC - event for netserver-1: {kubelet i-0c9a59753149775ab} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "891b0e5671016afce5b1c5e10bd84696486e98b8ea54c89fbcd989c7da39784b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:50:14.028: INFO: At 2023-01-21 17:45:27 +0000 UTC - event for netserver-2: {kubelet i-0d64fae545fa8bf3f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b50a8a9cce1caee319b3c9a978162c72488dafddc0ca8da3ed019e4912ee8de2": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:50:14.028: INFO: At 2023-01-21 17:45:37 +0000 UTC - event for netserver-3: {kubelet i-0e989f541e95bf4a9} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "9bc3644e358e0fad1f4ce4eba8c21d2bb1dd18ceac38e7d0345ba9c852cde7f2": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:50:14.028: INFO: At 2023-01-21 17:45:38 +0000 UTC - event for netserver-1: {kubelet i-0c9a59753149775ab} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e1f315dd176985888b4d1ebf98a5db4b81b01ad36b6a066fea4ab238a3322dc9": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:50:14.028: INFO: At 2023-01-21 17:45:40 +0000 UTC - event for netserver-0: {kubelet i-03775830c60663d32} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "de26582bf88ab00815ef66742fe2c6cbec228891034a9c6d2ed7b39fc1a0bef3": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:50:14.028: INFO: At 2023-01-21 17:45:42 +0000 UTC - event for netserver-2: {kubelet i-0d64fae545fa8bf3f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e6eebf94cb664e9f740c7ee5a6e7aac254c57c207666beafa956fc8bfedd193f": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:50:14.028: INFO: At 2023-01-21 17:45:50 +0000 UTC - event for netserver-1: {kubelet i-0c9a59753149775ab} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "fc80331cb9cfd1386b62030a49188186c6f6d3ea14361f013519e4c329ad3acf": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:50:14.028: INFO: At 2023-01-21 17:45:52 +0000 UTC - event for netserver-0: {kubelet i-03775830c60663d32} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "5ed2e59d48b4dd951398654a182800a48e154e390001e6bb1e042600b3487747": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:50:14.028: INFO: At 2023-01-21 17:45:52 +0000 UTC - event for netserver-3: {kubelet i-0e989f541e95bf4a9} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "9388cb5b13371946150cebc2ec0a1583a7a18f55cae8bc5cb73a746ae27c87f2": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:50:14.028: INFO: At 2023-01-21 17:45:53 +0000 UTC - event for netserver-2: {kubelet i-0d64fae545fa8bf3f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ddc9480eeb924643ee1e9b2cd1e38590f1938171c3e5662655f3b4307b104aa3": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:50:14.028: INFO: At 2023-01-21 17:46:02 +0000 UTC - event for netserver-1: {kubelet i-0c9a59753149775ab} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "0b2a3c15a6a1b37514c19f87fae2a906adb7e668e0b6b6d7389896dc86a8820d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:50:14.028: INFO: At 2023-01-21 17:46:05 +0000 UTC - event for netserver-2: {kubelet i-0d64fae545fa8bf3f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d161c19a9716df9aa96d55291f59bee938c66610f69254bccdf9e7f525975c15": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:50:14.028: INFO: At 2023-01-21 17:46:05 +0000 UTC - event for netserver-3: {kubelet i-0e989f541e95bf4a9} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "db053a09b2ba88b31ed6b340a2840609d2d598a32157d39ffed71ef2bc7f8d34": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:50:14.028: INFO: At 2023-01-21 17:46:06 +0000 UTC - event for netserver-0: {kubelet i-03775830c60663d32} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "9966cb713ae61a81e0c636a7992a91b71b9c526557212454a260fd3a29bbdf0d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:50:14.028: INFO: At 2023-01-21 17:46:14 +0000 UTC - event for netserver-1: {kubelet i-0c9a59753149775ab} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "bf550eb0a3d7f33870bdea218edc69b20d383199d63414bb3a97a2164a973553": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:50:14.028: INFO: At 2023-01-21 17:46:18 +0000 UTC - event for netserver-2: {kubelet i-0d64fae545fa8bf3f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "01fc8a168118610d80d332535b0932e4c28cdc2363b498266f708305d1abfcbf": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:50:14.028: INFO: At 2023-01-21 17:46:19 +0000 UTC - event for netserver-3: {kubelet i-0e989f541e95bf4a9} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "aadb81118938458540fdd4919aa0ba92927013f2053be364c6919fd37f4baa40": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:50:14.028: INFO: At 2023-01-21 17:46:20 +0000 UTC - event for netserver-0: {kubelet i-03775830c60663d32} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d080b34333eac88c219a82b7026dc5b9144992bead9e081953719561df90ebe1": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:50:14.028: INFO: At 2023-01-21 17:46:27 +0000 UTC - event for netserver-1: {kubelet i-0c9a59753149775ab} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "77b3848db458801c67ac9c81f7926ecb40e8c06a35fef8d338a2638ee7eac9b3": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:50:14.028: INFO: At 2023-01-21 17:46:29 +0000 UTC - event for netserver-2: {kubelet i-0d64fae545fa8bf3f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "328fc5cd96bb0bf95b30c69d0023db19a893f204fa7244a252f2c87c2aa7591a": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:50:14.028: INFO: At 2023-01-21 17:46:31 +0000 UTC - event for netserver-3: {kubelet i-0e989f541e95bf4a9} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "5a941b9a1aa40c1786732c0ce5f8150cac7f01f98966e3262fce4632eb31901c": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:50:14.028: INFO: At 2023-01-21 17:46:34 +0000 UTC - event for netserver-0: {kubelet i-03775830c60663d32} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "0fc23d2bed1f6f2912ed3dfed8aaf81cff8fbd35f08ee2d6bd424621b7712b3a": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:50:14.028: INFO: At 2023-01-21 17:46:38 +0000 UTC - event for netserver-1: {kubelet i-0c9a59753149775ab} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "5164d1a7b5018e3ff01eb664c03742b1e3e2b89d92c32f8f73e03e9af3458f65": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:50:14.028: INFO: At 2023-01-21 17:46:43 +0000 UTC - event for netserver-2: {kubelet i-0d64fae545fa8bf3f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "2f30a5aac9ed8e2846d403c05f484c2655513654081bd10de392e5d0e19b49ef": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:50:14.028: INFO: At 2023-01-21 17:46:44 +0000 UTC - event for netserver-3: {kubelet i-0e989f541e95bf4a9} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "8709750a142d61d088b33c17eda6a274782e1cf495a7661aa2173b861ba006ed": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:50:14.028: INFO: At 2023-01-21 17:46:49 +0000 UTC - event for netserver-0: {kubelet i-03775830c60663d32} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "af11c3941f5d478d502ea2d0d83b1b727367b0d143f2c05eb13e34b848ec7be1": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:50:14.028: INFO: At 2023-01-21 17:46:53 +0000 UTC - event for netserver-1: {kubelet i-0c9a59753149775ab} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a7d6c1dd4cadd2808f11a6be8a4dae61d07247253c182522ae29192505f6f618": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:50:14.028: INFO: At 2023-01-21 17:46:58 +0000 UTC - event for netserver-2: {kubelet i-0d64fae545fa8bf3f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "962914d2c9b6b24de3c7373119774af656bf2e3941f63f6dc9bb61db2ed47d22": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:50:14.028: INFO: At 2023-01-21 17:46:58 +0000 UTC - event for netserver-3: {kubelet i-0e989f541e95bf4a9} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "2172e915a1220c4f0a66c0a695e93226a42df29c95e81cd1ea24aa74bf766187": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:50:14.028: INFO: At 2023-01-21 17:47:04 +0000 UTC - event for netserver-0: {kubelet i-03775830c60663d32} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "3937c67160634ec13b064d9d59f7bf06179c9a854da3a0372037a25400165bd2": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:50:14.028: INFO: At 2023-01-21 17:47:08 +0000 UTC - event for netserver-1: {kubelet i-0c9a59753149775ab} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6660f7bafbe6aa631e2710d36584fff3b99ff2d35bb6e7bf8aea9219fc4040a0": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:50:14.028: INFO: At 2023-01-21 17:47:09 +0000 UTC - event for netserver-2: {kubelet i-0d64fae545fa8bf3f} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "0906e77f89493ad22b4e21911d378eec2678df0fda6445b74e142ad49fc064f6": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:50:14.028: INFO: At 2023-01-21 17:47:12 +0000 UTC - event for netserver-3: {kubelet i-0e989f541e95bf4a9} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "4384fbd5290ca106df6a1881894ccc6c3afc25f87dab57a319eeed1d4c00d8d5": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:50:14.028: INFO: At 2023-01-21 17:47:16 +0000 UTC - event for netserver-0: {kubelet i-03775830c60663d32} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "f6ab30c27fba0a45c87504bcbb21362ad842c3bb029f0b9dfa7003b5fa335310": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:50:14.028: INFO: At 2023-01-21 17:50:04 +0000 UTC - event for netserver-1: {kubelet i-0c9a59753149775ab} Created: Created container webserver Jan 21 17:50:14.028: INFO: At 2023-01-21 17:50:04 +0000 UTC - event for netserver-1: {kubelet i-0c9a59753149775ab} Started: Started container webserver Jan 21 17:50:14.028: INFO: At 2023-01-21 17:50:04 +0000 UTC - event for netserver-1: {kubelet i-0c9a59753149775ab} Pulled: Container image "k8s.gcr.io/e2e-test-images/agnhost:2.39" already present on machine Jan 21 17:50:14.028: INFO: At 2023-01-21 17:50:04 +0000 UTC - event for netserver-2: {kubelet i-0d64fae545fa8bf3f} Pulled: Container image "k8s.gcr.io/e2e-test-images/agnhost:2.39" already present on machine Jan 21 17:50:14.028: INFO: At 2023-01-21 17:50:04 +0000 UTC - event for netserver-2: {kubelet i-0d64fae545fa8bf3f} Created: Created container webserver Jan 21 17:50:14.028: INFO: At 2023-01-21 17:50:05 +0000 UTC - event for netserver-2: {kubelet i-0d64fae545fa8bf3f} Started: Started container webserver Jan 21 17:50:14.028: INFO: At 2023-01-21 17:50:05 +0000 UTC - event for netserver-3: {kubelet i-0e989f541e95bf4a9} Started: Started container webserver Jan 21 17:50:14.028: INFO: At 2023-01-21 17:50:05 +0000 UTC - event for netserver-3: {kubelet i-0e989f541e95bf4a9} Pulled: Container image "k8s.gcr.io/e2e-test-images/agnhost:2.39" already present on machine Jan 21 17:50:14.028: INFO: At 2023-01-21 17:50:05 +0000 UTC - event for netserver-3: {kubelet i-0e989f541e95bf4a9} Created: Created container webserver Jan 21 17:50:14.242: INFO: POD NODE PHASE GRACE CONDITIONS Jan 21 17:50:14.242: INFO: netserver-0 i-03775830c60663d32 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:45:12 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:45:12 +0000 UTC ContainersNotReady containers with unready status: [webserver]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:45:12 +0000 UTC ContainersNotReady containers with unready status: [webserver]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:45:12 +0000 UTC }] Jan 21 17:50:14.242: INFO: netserver-1 i-0c9a59753149775ab Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:45:12 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:45:12 +0000 UTC ContainersNotReady containers with unready status: [webserver]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:45:12 +0000 UTC ContainersNotReady containers with unready status: [webserver]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:45:12 +0000 UTC }] Jan 21 17:50:14.242: INFO: netserver-2 i-0d64fae545fa8bf3f Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:45:12 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:45:12 +0000 UTC ContainersNotReady containers with unready status: [webserver]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:45:12 +0000 UTC ContainersNotReady containers with unready status: [webserver]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:45:12 +0000 UTC }] Jan 21 17:50:14.242: INFO: netserver-3 i-0e989f541e95bf4a9 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:45:13 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:45:13 +0000 UTC ContainersNotReady containers with unready status: [webserver]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:45:13 +0000 UTC ContainersNotReady containers with unready status: [webserver]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:45:13 +0000 UTC }] Jan 21 17:50:14.242: INFO: Jan 21 17:50:14.456: INFO: Unable to fetch nettest-5257/netserver-0/webserver logs: the server rejected our request for an unknown reason (get pods netserver-0) Jan 21 17:50:15.348: INFO: Logging node info for node i-03775830c60663d32 Jan 21 17:50:15.561: INFO: Node Info: &Node{ObjectMeta:{i-03775830c60663d32 7e863bb0-bd92-4fd6-abc2-40d9e11317f1 34543 0 2023-01-21 17:22:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-southeast-1 failure-domain.beta.kubernetes.io/zone:ap-southeast-1a kubernetes.io/arch:amd64 kubernetes.io/hostname:i-03775830c60663d32 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-southeast-1a topology.hostpath.csi/node:i-03775830c60663d32 topology.kubernetes.io/region:ap-southeast-1 topology.kubernetes.io/zone:ap-southeast-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.55.172 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-03775830c60663d32"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-21 17:47:21 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-21 17:47:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-southeast-1a/i-03775830c60663d32,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078252032 0} {<nil>} 3982668Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973394432 0} {<nil>} 3880268Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 17:49:49 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 17:49:49 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 17:49:49 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 17:49:49 +0000 UTC,LastTransitionTime:2023-01-21 17:23:06 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.55.172,},NodeAddress{Type:ExternalIP,Address:13.229.107.111,},NodeAddress{Type:InternalDNS,Address:i-03775830c60663d32.ap-southeast-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-03775830c60663d32.ap-southeast-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-229-107-111.ap-southeast-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec283bf7e7ad98bfb3e8e233a27b8209,SystemUUID:ec283bf7-e7ad-98bf-b3e8-e233a27b8209,BootID:a0bdbc5b-a9a7-47cf-88a5-9de3c7f8b2ce,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.24.10,KubeProxyVersion:v1.24.10,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.24.10],SizeBytes:112211511,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa k8s.gcr.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb k8s.gcr.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 k8s.gcr.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a k8s.gcr.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 k8s.gcr.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 k8s.gcr.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f k8s.gcr.io/e2e-test-images/nginx:1.15-2],SizeBytes:7000509,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7],SizeBytes:311278,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-005994c9d5b9e6248 kubernetes.io/csi/ebs.csi.aws.com^vol-05ce4ba3795a29b88 kubernetes.io/csi/ebs.csi.aws.com^vol-0e5df4d0d451e0952],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-05ce4ba3795a29b88,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-005994c9d5b9e6248,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0e5df4d0d451e0952,DevicePath:,},},Config:nil,},} Jan 21 17:50:15.562: INFO: Logging kubelet events for node i-03775830c60663d32 Jan 21 17:50:15.776: INFO: Logging pods the kubelet thinks is on node i-03775830c60663d32 Jan 21 17:50:16.002: INFO: ephemeral-containers-target-pod started at 2023-01-21 17:49:40 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:16.002: INFO: Container test-container-1 ready: true, restart count 0 Jan 21 17:50:16.002: INFO: netserver-0 started at 2023-01-21 17:44:45 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:16.002: INFO: Container webserver ready: true, restart count 0 Jan 21 17:50:16.002: INFO: pod-a138f362-77a8-42b7-be7c-81ec30a1b470 started at 2023-01-21 17:45:08 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:16.002: INFO: Container write-pod ready: false, restart count 0 Jan 21 17:50:16.002: INFO: rs-gqcsw started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:16.002: INFO: Container donothing ready: true, restart count 0 Jan 21 17:50:16.002: INFO: all-succeed-zndrk started at 2023-01-21 17:49:44 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:16.002: INFO: Container c ready: false, restart count 0 Jan 21 17:50:16.002: INFO: successful-jobs-history-limit-27905390-447s7 started at 2023-01-21 17:50:00 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:16.002: INFO: Container c ready: false, restart count 0 Jan 21 17:50:16.002: INFO: pod-5c06b80d-aa28-4f8c-b34f-91a4e97e33ea started at 2023-01-21 17:47:19 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:16.002: INFO: Container write-pod ready: true, restart count 0 Jan 21 17:50:16.002: INFO: all-succeed-jnj8n started at 2023-01-21 17:49:44 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:16.002: INFO: Container c ready: false, restart count 0 Jan 21 17:50:16.002: INFO: rs-6zfxj started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:16.002: INFO: Container donothing ready: true, restart count 0 Jan 21 17:50:16.002: INFO: ss2-2 started at <nil> (0+0 container statuses recorded) Jan 21 17:50:16.002: INFO: netserver-0 started at 2023-01-21 17:49:37 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:16.002: INFO: Container webserver ready: false, restart count 0 Jan 21 17:50:16.002: INFO: rs-8t6wd started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:16.002: INFO: Container donothing ready: true, restart count 0 Jan 21 17:50:16.002: INFO: foo-v2vd7 started at 2023-01-21 17:49:26 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:16.002: INFO: Container c ready: false, restart count 0 Jan 21 17:50:16.002: INFO: pod-size-memory-volume-0fe04c39-fb01-4cb0-9d7d-56e68f17d710 started at 2023-01-21 17:49:32 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:16.002: INFO: Container busybox-main-container ready: false, restart count 0 Jan 21 17:50:16.002: INFO: inline-volume-tester-rp27h started at 2023-01-21 17:49:41 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:16.002: INFO: Container csi-volume-tester ready: false, restart count 0 Jan 21 17:50:16.002: INFO: suspend-true-to-false-ctf95 started at 2023-01-21 17:48:40 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:16.002: INFO: Container c ready: false, restart count 0 Jan 21 17:50:16.002: INFO: hostexec-i-03775830c60663d32-8wzpb started at 2023-01-21 17:49:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:16.002: INFO: Container agnhost-container ready: true, restart count 0 Jan 21 17:50:16.002: INFO: foo-c5bqp started at 2023-01-21 17:49:26 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:16.002: INFO: Container c ready: false, restart count 0 Jan 21 17:50:16.002: INFO: pod-c859ec73-3aeb-4696-af29-abedffded764 started at 2023-01-21 17:49:27 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:16.002: INFO: Container write-pod ready: false, restart count 0 Jan 21 17:50:16.002: INFO: ebs-csi-node-lsgbl started at 2023-01-21 17:22:46 +0000 UTC (0+3 container statuses recorded) Jan 21 17:50:16.002: INFO: Container ebs-plugin ready: true, restart count 0 Jan 21 17:50:16.002: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:50:16.002: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 21 17:50:16.002: INFO: cilium-2tq4w started at 2023-01-21 17:22:46 +0000 UTC (1+1 container statuses recorded) Jan 21 17:50:16.002: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 21 17:50:16.002: INFO: Container cilium-agent ready: true, restart count 0 Jan 21 17:50:16.002: INFO: suspend-true-to-false-h2lzk started at 2023-01-21 17:48:40 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:16.002: INFO: Container c ready: false, restart count 0 Jan 21 17:50:16.002: INFO: pod-fa8f7974-7a8f-4d0a-a9f4-246237bfa8b6 started at 2023-01-21 17:49:16 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:16.002: INFO: Container write-pod ready: true, restart count 0 Jan 21 17:50:16.002: INFO: service-proxy-disabled-2lhj4 started at 2023-01-21 17:49:31 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:16.002: INFO: Container service-proxy-disabled ready: false, restart count 0 Jan 21 17:50:16.002: INFO: hostexec-i-03775830c60663d32-h4jm4 started at 2023-01-21 17:45:03 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:16.002: INFO: Container agnhost-container ready: true, restart count 0 Jan 21 17:50:16.002: INFO: netserver-0 started at 2023-01-21 17:45:12 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:16.002: INFO: Container webserver ready: false, restart count 0 Jan 21 17:50:16.002: INFO: hairpin started at 2023-01-21 17:47:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:16.002: INFO: Container agnhost-container ready: false, restart count 0 Jan 21 17:50:16.798: INFO: Latency metrics for node i-03775830c60663d32 Jan 21 17:50:16.798: INFO: Logging node info for node i-089df1bd1599c9fac Jan 21 17:50:17.011: INFO: Node Info: &Node{ObjectMeta:{i-089df1bd1599c9fac 5933bf32-55e4-4bc6-811a-9ebde5df5619 33466 0 2023-01-21 17:20:48 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-southeast-1 failure-domain.beta.kubernetes.io/zone:ap-southeast-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-089df1bd1599c9fac kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:ap-southeast-1a topology.kubernetes.io/region:ap-southeast-1 topology.kubernetes.io/zone:ap-southeast-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.40.1 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-089df1bd1599c9fac"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-21 17:20:48 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-21 17:21:14 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:21:23 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:21:23 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 17:21:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-21 17:23:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-southeast-1a/i-089df1bd1599c9fac,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3889451008 0} {<nil>} 3798292Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3784593408 0} {<nil>} 3695892Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 17:48:44 +0000 UTC,LastTransitionTime:2023-01-21 17:20:46 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 17:48:44 +0000 UTC,LastTransitionTime:2023-01-21 17:20:46 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 17:48:44 +0000 UTC,LastTransitionTime:2023-01-21 17:20:46 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 17:48:44 +0000 UTC,LastTransitionTime:2023-01-21 17:21:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.40.1,},NodeAddress{Type:ExternalIP,Address:13.212.76.186,},NodeAddress{Type:InternalDNS,Address:i-089df1bd1599c9fac.ap-southeast-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-089df1bd1599c9fac.ap-southeast-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-212-76-186.ap-southeast-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec28683bad10cfdec8fa4bd6c22408b7,SystemUUID:ec28683b-ad10-cfde-c8fa-4bd6c22408b7,BootID:a32c6813-ffd6-4923-a901-e3a8658adebd,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.24.10,KubeProxyVersion:v1.24.10,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64@sha256:6db2761074bae8385aa601d4b45ab065893cfdc258d8b2593fc56698c44dbee5 k8s.gcr.io/kube-apiserver-amd64:v1.24.10 registry.k8s.io/kube-apiserver-amd64:v1.24.10],SizeBytes:131733971,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64@sha256:8867df47c332bae8dfd061b4d4230cd0febcc5a8a427ecb2e8f70b33ffc6d732 k8s.gcr.io/kube-controller-manager-amd64:v1.24.10 registry.k8s.io/kube-controller-manager-amd64:v1.24.10],SizeBytes:121342265,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.24.10],SizeBytes:112211511,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64@sha256:a589f10748fa227ea6ebf0730126f3f192cbdbb2c7f96a9d4685cabb86eb1cbc k8s.gcr.io/kube-scheduler-amd64:v1.24.10 registry.k8s.io/kube-scheduler-amd64:v1.24.10],SizeBytes:52751160,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-beta.2],SizeBytes:43191763,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-beta.2],SizeBytes:42821714,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:245e81c2ed53b5508a6f687f3ab0c724b9ab31e6a5fa5e6d2f814981ab6ce55f registry.k8s.io/provider-aws/cloud-controller-manager:v1.24.3],SizeBytes:18282737,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-beta.2],SizeBytes:4965793,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 21 17:50:17.012: INFO: Logging kubelet events for node i-089df1bd1599c9fac Jan 21 17:50:17.227: INFO: Logging pods the kubelet thinks is on node i-089df1bd1599c9fac Jan 21 17:50:17.448: INFO: kube-scheduler-i-089df1bd1599c9fac started at 2023-01-21 17:20:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:17.448: INFO: Container kube-scheduler ready: true, restart count 0 Jan 21 17:50:17.448: INFO: kube-apiserver-i-089df1bd1599c9fac started at 2023-01-21 17:20:10 +0000 UTC (0+2 container statuses recorded) Jan 21 17:50:17.448: INFO: Container healthcheck ready: true, restart count 0 Jan 21 17:50:17.448: INFO: Container kube-apiserver ready: true, restart count 1 Jan 21 17:50:17.448: INFO: aws-cloud-controller-manager-lt9wb started at 2023-01-21 17:21:18 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:17.448: INFO: Container aws-cloud-controller-manager ready: true, restart count 0 Jan 21 17:50:17.448: INFO: cilium-nj7m8 started at 2023-01-21 17:21:19 +0000 UTC (1+1 container statuses recorded) Jan 21 17:50:17.448: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 21 17:50:17.448: INFO: Container cilium-agent ready: true, restart count 1 Jan 21 17:50:17.448: INFO: cilium-operator-8d8478c74-hpl2l started at 2023-01-21 17:21:19 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:17.448: INFO: Container cilium-operator ready: true, restart count 0 Jan 21 17:50:17.448: INFO: dns-controller-7d4957564c-rk48f started at 2023-01-21 17:21:19 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:17.448: INFO: Container dns-controller ready: true, restart count 0 Jan 21 17:50:17.448: INFO: kube-controller-manager-i-089df1bd1599c9fac started at 2023-01-21 17:20:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:17.448: INFO: Container kube-controller-manager ready: true, restart count 3 Jan 21 17:50:17.448: INFO: etcd-manager-events-i-089df1bd1599c9fac started at 2023-01-21 17:20:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:17.448: INFO: Container etcd-manager ready: true, restart count 0 Jan 21 17:50:17.448: INFO: etcd-manager-main-i-089df1bd1599c9fac started at 2023-01-21 17:20:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:17.448: INFO: Container etcd-manager ready: true, restart count 0 Jan 21 17:50:17.448: INFO: kops-controller-7fpkx started at 2023-01-21 17:21:18 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:17.448: INFO: Container kops-controller ready: true, restart count 0 Jan 21 17:50:17.448: INFO: ebs-csi-node-j7jjl started at 2023-01-21 17:21:19 +0000 UTC (0+3 container statuses recorded) Jan 21 17:50:17.448: INFO: Container ebs-plugin ready: true, restart count 0 Jan 21 17:50:17.448: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:50:17.448: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 21 17:50:17.448: INFO: ebs-csi-controller-779575c67d-scjvt started at 2023-01-21 17:21:19 +0000 UTC (0+5 container statuses recorded) Jan 21 17:50:17.448: INFO: Container csi-attacher ready: true, restart count 0 Jan 21 17:50:17.448: INFO: Container csi-provisioner ready: true, restart count 0 Jan 21 17:50:17.448: INFO: Container csi-resizer ready: true, restart count 0 Jan 21 17:50:17.448: INFO: Container ebs-plugin ready: true, restart count 0 Jan 21 17:50:17.448: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:50:18.136: INFO: Latency metrics for node i-089df1bd1599c9fac Jan 21 17:50:18.136: INFO: Logging node info for node i-0c9a59753149775ab Jan 21 17:50:18.349: INFO: Node Info: &Node{ObjectMeta:{i-0c9a59753149775ab 5c157934-21a3-4b7b-9fa3-5c66b5b25ec5 34560 0 2023-01-21 17:22:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-southeast-1 failure-domain.beta.kubernetes.io/zone:ap-southeast-1a kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0c9a59753149775ab kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-southeast-1a topology.hostpath.csi/node:i-0c9a59753149775ab topology.kubernetes.io/region:ap-southeast-1 topology.kubernetes.io/zone:ap-southeast-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.34.240 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0c9a59753149775ab"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-21 17:47:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-southeast-1a/i-0c9a59753149775ab,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 17:47:38 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 17:47:38 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 17:47:38 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 17:47:38 +0000 UTC,LastTransitionTime:2023-01-21 17:23:06 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.34.240,},NodeAddress{Type:ExternalIP,Address:13.212.2.160,},NodeAddress{Type:InternalDNS,Address:i-0c9a59753149775ab.ap-southeast-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0c9a59753149775ab.ap-southeast-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-212-2-160.ap-southeast-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2610052ce207b4f84f50e9ba8d53ab,SystemUUID:ec261005-2ce2-07b4-f84f-50e9ba8d53ab,BootID:ff39a0e3-8cb1-4190-8b6d-8912e2826f9a,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.24.10,KubeProxyVersion:v1.24.10,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.24.10],SizeBytes:112211511,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa k8s.gcr.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb k8s.gcr.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 k8s.gcr.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a k8s.gcr.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 k8s.gcr.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 k8s.gcr.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f k8s.gcr.io/e2e-test-images/nginx:1.15-2],SizeBytes:7000509,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7],SizeBytes:311278,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 21 17:50:18.349: INFO: Logging kubelet events for node i-0c9a59753149775ab Jan 21 17:50:18.565: INFO: Logging pods the kubelet thinks is on node i-0c9a59753149775ab Jan 21 17:50:18.787: INFO: netserver-1 started at 2023-01-21 17:44:45 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:18.787: INFO: Container webserver ready: true, restart count 0 Jan 21 17:50:18.787: INFO: pod-subpath-test-inlinevolume-459b started at 2023-01-21 17:50:14 +0000 UTC (2+2 container statuses recorded) Jan 21 17:50:18.787: INFO: Init container init-volume-inlinevolume-459b ready: false, restart count 0 Jan 21 17:50:18.787: INFO: Init container test-init-subpath-inlinevolume-459b ready: false, restart count 0 Jan 21 17:50:18.787: INFO: Container test-container-subpath-inlinevolume-459b ready: false, restart count 0 Jan 21 17:50:18.787: INFO: Container test-container-volume-inlinevolume-459b ready: false, restart count 0 Jan 21 17:50:18.787: INFO: rs-mkvfg started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:18.787: INFO: Container donothing ready: true, restart count 0 Jan 21 17:50:18.787: INFO: cilium-7h9rt started at 2023-01-21 17:22:46 +0000 UTC (1+1 container statuses recorded) Jan 21 17:50:18.787: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 21 17:50:18.787: INFO: Container cilium-agent ready: true, restart count 0 Jan 21 17:50:18.787: INFO: pod-subpath-test-inlinevolume-gkbp started at 2023-01-21 17:45:21 +0000 UTC (1+1 container statuses recorded) Jan 21 17:50:18.787: INFO: Init container init-volume-inlinevolume-gkbp ready: false, restart count 0 Jan 21 17:50:18.787: INFO: Container test-container-subpath-inlinevolume-gkbp ready: false, restart count 0 Jan 21 17:50:18.787: INFO: ss2-0 started at 2023-01-21 17:47:15 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:18.787: INFO: Container webserver ready: true, restart count 0 Jan 21 17:50:18.787: INFO: suspend-true-to-false-ln4zb started at 2023-01-21 17:50:13 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:18.787: INFO: Container c ready: false, restart count 0 Jan 21 17:50:18.787: INFO: rs-l7bvh started at 2023-01-21 17:50:18 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:18.787: INFO: Container donothing ready: false, restart count 0 Jan 21 17:50:18.787: INFO: netserver-1 started at 2023-01-21 17:45:12 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:18.787: INFO: Container webserver ready: false, restart count 0 Jan 21 17:50:18.787: INFO: pfpod started at 2023-01-21 17:47:14 +0000 UTC (0+2 container statuses recorded) Jan 21 17:50:18.787: INFO: Container portforwardtester ready: true, restart count 0 Jan 21 17:50:18.787: INFO: Container readiness ready: false, restart count 0 Jan 21 17:50:18.787: INFO: ebs-csi-node-vzcrc started at 2023-01-21 17:22:46 +0000 UTC (0+3 container statuses recorded) Jan 21 17:50:18.787: INFO: Container ebs-plugin ready: true, restart count 0 Jan 21 17:50:18.787: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:50:18.787: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 21 17:50:18.787: INFO: rs-fjjf2 started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:18.787: INFO: Container donothing ready: true, restart count 0 Jan 21 17:50:18.787: INFO: netserver-1 started at 2023-01-21 17:49:37 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:18.787: INFO: Container webserver ready: true, restart count 0 Jan 21 17:50:19.537: INFO: Latency metrics for node i-0c9a59753149775ab Jan 21 17:50:19.537: INFO: Logging node info for node i-0d64fae545fa8bf3f Jan 21 17:50:19.750: INFO: Node Info: &Node{ObjectMeta:{i-0d64fae545fa8bf3f 77fc61e9-438c-4f3e-98aa-2b457c1202a0 34707 0 2023-01-21 17:22:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-southeast-1 failure-domain.beta.kubernetes.io/zone:ap-southeast-1a kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0d64fae545fa8bf3f kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-southeast-1a topology.hostpath.csi/node:i-0d64fae545fa8bf3f topology.kubernetes.io/region:ap-southeast-1 topology.kubernetes.io/zone:ap-southeast-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.53.147 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-volumemode-2965":"i-0d64fae545fa8bf3f","csi-mock-csi-mock-volumes-7150":"i-0d64fae545fa8bf3f","ebs.csi.aws.com":"i-0d64fae545fa8bf3f"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-21 17:49:40 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {kube-controller-manager Update v1 2023-01-21 17:50:15 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-southeast-1a/i-0d64fae545fa8bf3f,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 17:49:40 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 17:49:40 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 17:49:40 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 17:49:40 +0000 UTC,LastTransitionTime:2023-01-21 17:23:05 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.53.147,},NodeAddress{Type:ExternalIP,Address:13.229.75.189,},NodeAddress{Type:InternalDNS,Address:i-0d64fae545fa8bf3f.ap-southeast-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0d64fae545fa8bf3f.ap-southeast-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-229-75-189.ap-southeast-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2dfae26c309b0dd5a9ccb311cb6042,SystemUUID:ec2dfae2-6c30-9b0d-d5a9-ccb311cb6042,BootID:6e6cce59-de74-4521-b0ec-ab95e71b1046,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.24.10,KubeProxyVersion:v1.24.10,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.24.10],SizeBytes:112211511,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c k8s.gcr.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/sample-apiserver@sha256:f9c93b92b6ff750b41a93c4e4fe0bfe384597aeb841e2539d5444815c55b2d8f k8s.gcr.io/e2e-test-images/sample-apiserver:1.17.5],SizeBytes:24316368,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa k8s.gcr.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb k8s.gcr.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 k8s.gcr.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a k8s.gcr.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 k8s.gcr.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7],SizeBytes:311278,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-volumemode-2965^0e2b5329-99b4-11ed-9ab6-e6d0c9b30dec,DevicePath:,},},Config:nil,},} Jan 21 17:50:19.750: INFO: Logging kubelet events for node i-0d64fae545fa8bf3f Jan 21 17:50:19.965: INFO: Logging pods the kubelet thinks is on node i-0d64fae545fa8bf3f Jan 21 17:50:20.188: INFO: csi-mockplugin-0 started at 2023-01-21 17:47:26 +0000 UTC (0+3 container statuses recorded) Jan 21 17:50:20.188: INFO: Container csi-provisioner ready: true, restart count 0 Jan 21 17:50:20.188: INFO: Container driver-registrar ready: true, restart count 0 Jan 21 17:50:20.188: INFO: Container mock ready: true, restart count 0 Jan 21 17:50:20.188: INFO: csi-mockplugin-attacher-0 started at 2023-01-21 17:47:26 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:20.188: INFO: Container csi-attacher ready: true, restart count 0 Jan 21 17:50:20.188: INFO: cilium-gv5dw started at 2023-01-21 17:22:46 +0000 UTC (1+1 container statuses recorded) Jan 21 17:50:20.188: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 21 17:50:20.188: INFO: Container cilium-agent ready: true, restart count 0 Jan 21 17:50:20.188: INFO: netserver-2 started at 2023-01-21 17:44:45 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:20.188: INFO: Container webserver ready: false, restart count 0 Jan 21 17:50:20.188: INFO: csi-hostpathplugin-0 started at 2023-01-21 17:45:35 +0000 UTC (0+7 container statuses recorded) Jan 21 17:50:20.188: INFO: Container csi-attacher ready: true, restart count 0 Jan 21 17:50:20.188: INFO: Container csi-provisioner ready: true, restart count 0 Jan 21 17:50:20.188: INFO: Container csi-resizer ready: true, restart count 0 Jan 21 17:50:20.188: INFO: Container csi-snapshotter ready: true, restart count 0 Jan 21 17:50:20.188: INFO: Container hostpath ready: true, restart count 0 Jan 21 17:50:20.188: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:50:20.188: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 21 17:50:20.188: INFO: service-proxy-disabled-6vv2v started at 2023-01-21 17:49:31 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:20.188: INFO: Container service-proxy-disabled ready: true, restart count 0 Jan 21 17:50:20.188: INFO: coredns-6dd78b7459-44jzj started at 2023-01-21 17:23:22 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:20.188: INFO: Container coredns ready: true, restart count 0 Jan 21 17:50:20.188: INFO: rs-rvl99 started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:20.188: INFO: Container donothing ready: true, restart count 0 Jan 21 17:50:20.188: INFO: rs-cgktj started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:20.188: INFO: Container donothing ready: true, restart count 0 Jan 21 17:50:20.188: INFO: ebs-csi-node-k2jhx started at 2023-01-21 17:22:46 +0000 UTC (0+3 container statuses recorded) Jan 21 17:50:20.188: INFO: Container ebs-plugin ready: true, restart count 0 Jan 21 17:50:20.188: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:50:20.188: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 21 17:50:20.188: INFO: netserver-2 started at 2023-01-21 17:45:12 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:20.188: INFO: Container webserver ready: false, restart count 0 Jan 21 17:50:20.188: INFO: netserver-2 started at 2023-01-21 17:49:37 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:20.188: INFO: Container webserver ready: true, restart count 0 Jan 21 17:50:20.188: INFO: pod-38f9de00-3d73-4a76-954a-4857a4040549 started at 2023-01-21 17:50:14 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:20.188: INFO: Container write-pod ready: true, restart count 0 Jan 21 17:50:20.931: INFO: Latency metrics for node i-0d64fae545fa8bf3f Jan 21 17:50:20.931: INFO: Logging node info for node i-0e989f541e95bf4a9 Jan 21 17:50:21.144: INFO: Node Info: &Node{ObjectMeta:{i-0e989f541e95bf4a9 bf125f17-fba9-4a1f-bf10-621d29cd68aa 34610 0 2023-01-21 17:22:44 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-southeast-1 failure-domain.beta.kubernetes.io/zone:ap-southeast-1a kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0e989f541e95bf4a9 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-southeast-1a topology.hostpath.csi/node:i-0e989f541e95bf4a9 topology.kubernetes.io/region:ap-southeast-1 topology.kubernetes.io/zone:ap-southeast-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.55.136 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0e989f541e95bf4a9"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-21 17:22:44 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:22:44 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 17:22:44 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-21 17:22:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-21 17:22:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-01-21 17:38:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-southeast-1a/i-0e989f541e95bf4a9,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078206976 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973349376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 17:48:37 +0000 UTC,LastTransitionTime:2023-01-21 17:22:44 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 17:48:37 +0000 UTC,LastTransitionTime:2023-01-21 17:22:44 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 17:48:37 +0000 UTC,LastTransitionTime:2023-01-21 17:22:44 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 17:48:37 +0000 UTC,LastTransitionTime:2023-01-21 17:23:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.55.136,},NodeAddress{Type:ExternalIP,Address:13.212.153.84,},NodeAddress{Type:InternalDNS,Address:i-0e989f541e95bf4a9.ap-southeast-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0e989f541e95bf4a9.ap-southeast-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-212-153-84.ap-southeast-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec253ae18d864ba53e81f21cc4edca85,SystemUUID:ec253ae1-8d86-4ba5-3e81-f21cc4edca85,BootID:4abbb0c1-a455-4297-b376-571ca9fcdc78,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.24.10,KubeProxyVersion:v1.24.10,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.24.10],SizeBytes:112211511,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c k8s.gcr.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa k8s.gcr.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb k8s.gcr.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 k8s.gcr.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a k8s.gcr.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf k8s.gcr.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 k8s.gcr.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7],SizeBytes:311278,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 21 17:50:21.145: INFO: Logging kubelet events for node i-0e989f541e95bf4a9 Jan 21 17:50:21.360: INFO: Logging pods the kubelet thinks is on node i-0e989f541e95bf4a9 Jan 21 17:50:21.583: INFO: busybox-privileged-false-2ffa9e67-4d6d-487e-9d54-4964c02b9051 started at 2023-01-21 17:50:15 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:21.583: INFO: Container busybox-privileged-false-2ffa9e67-4d6d-487e-9d54-4964c02b9051 ready: false, restart count 0 Jan 21 17:50:21.583: INFO: cilium-8cmqj started at 2023-01-21 17:22:45 +0000 UTC (1+1 container statuses recorded) Jan 21 17:50:21.583: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 21 17:50:21.583: INFO: Container cilium-agent ready: true, restart count 0 Jan 21 17:50:21.583: INFO: rs-r8h6b started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:21.583: INFO: Container donothing ready: true, restart count 0 Jan 21 17:50:21.583: INFO: netserver-3 started at 2023-01-21 17:49:37 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:21.583: INFO: Container webserver ready: true, restart count 0 Jan 21 17:50:21.583: INFO: service-proxy-disabled-ljqb5 started at 2023-01-21 17:49:31 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:21.583: INFO: Container service-proxy-disabled ready: true, restart count 0 Jan 21 17:50:21.583: INFO: coredns-6dd78b7459-m68gs started at 2023-01-21 17:23:04 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:21.583: INFO: Container coredns ready: true, restart count 0 Jan 21 17:50:21.583: INFO: ss2-1 started at 2023-01-21 17:50:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:21.583: INFO: Container webserver ready: true, restart count 0 Jan 21 17:50:21.583: INFO: suspend-true-to-false-k5zrb started at 2023-01-21 17:50:13 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:21.583: INFO: Container c ready: false, restart count 0 Jan 21 17:50:21.583: INFO: my-hostname-basic-58521daa-9061-4751-9193-7244fc10e6a5-7kr7j started at 2023-01-21 17:50:20 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:21.583: INFO: Container my-hostname-basic-58521daa-9061-4751-9193-7244fc10e6a5 ready: false, restart count 0 Jan 21 17:50:21.583: INFO: coredns-autoscaler-5f76bf6c7b-lkrtx started at 2023-01-21 17:23:04 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:21.583: INFO: Container autoscaler ready: true, restart count 0 Jan 21 17:50:21.583: INFO: netserver-3 started at 2023-01-21 17:45:13 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:21.583: INFO: Container webserver ready: false, restart count 0 Jan 21 17:50:21.583: INFO: netserver-3 started at 2023-01-21 17:44:45 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:21.583: INFO: Container webserver ready: false, restart count 0 Jan 21 17:50:21.583: INFO: ebs-csi-node-b9gk6 started at 2023-01-21 17:22:45 +0000 UTC (0+3 container statuses recorded) Jan 21 17:50:21.583: INFO: Container ebs-plugin ready: true, restart count 0 Jan 21 17:50:21.583: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:50:21.583: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 21 17:50:21.584: INFO: rs-vk2fw started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:21.584: INFO: Container donothing ready: true, restart count 0 Jan 21 17:50:21.584: INFO: rs-d9mjn started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:50:21.584: INFO: Container donothing ready: true, restart count 0 Jan 21 17:50:22.303: INFO: Latency metrics for node i-0e989f541e95bf4a9 Jan 21 17:50:22.303: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "nettest-5257" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-network\]\sNetworking\sshould\scheck\skube\-proxy\surls$'
test/e2e/network/networking.go:132 Jan 21 17:49:11.678: Unexpected error: <*errors.errorString | 0xc00021c1e0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred test/e2e/framework/network/utils.go:864from junit_20.xml
{"msg":"PASSED [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] patching/updating a validating webhook should work [Conformance]","total":-1,"completed":19,"skipped":217,"failed":1,"failures":["[sig-node] Pods should delete a collection of pods [Conformance]"]} [BeforeEach] [sig-network] Networking test/e2e/framework/framework.go:187 �[1mSTEP�[0m: Creating a kubernetes client Jan 21 17:44:08.210: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename nettest �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace [It] should check kube-proxy urls test/e2e/network/networking.go:132 �[1mSTEP�[0m: Performing setup for networking test in namespace nettest-1851 �[1mSTEP�[0m: creating a selector �[1mSTEP�[0m: Creating the service pods in kubernetes Jan 21 17:44:09.721: INFO: Waiting up to 10m0s for all (but 0) nodes to be schedulable Jan 21 17:44:11.246: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:44:13.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:44:15.464: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:44:17.464: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:44:19.465: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:44:21.464: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:44:23.464: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:44:25.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:44:27.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:44:29.464: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:44:31.464: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:44:33.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:44:35.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:44:37.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:44:39.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:44:41.464: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:44:43.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:44:45.464: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:44:47.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:44:49.464: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:44:51.464: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:44:53.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:44:55.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:44:57.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:44:59.464: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:01.469: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:03.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:05.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:07.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:09.464: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:11.464: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:13.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:15.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:17.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:19.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:21.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:23.464: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:25.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:27.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:29.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:31.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:33.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:35.464: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:37.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:39.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:41.464: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:43.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:45.464: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:47.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:49.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:51.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:53.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:55.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:57.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:45:59.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:01.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:03.464: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:05.465: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:07.464: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:09.464: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:11.464: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:13.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:15.464: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:17.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:19.464: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:21.464: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:23.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:25.464: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:27.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:29.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:31.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:33.464: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:35.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:37.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:39.464: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:41.464: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:43.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:45.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:47.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:49.464: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:51.464: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:53.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:55.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:57.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:46:59.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:01.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:03.464: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:05.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:07.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:09.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:11.464: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:13.465: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:15.464: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:17.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:19.464: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:21.464: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:23.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:25.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:27.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:29.464: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:31.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:33.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:35.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:37.464: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:39.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:41.465: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:43.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:45.464: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:47.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:49.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:51.464: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:53.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:55.466: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:57.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:47:59.464: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:01.466: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:03.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:05.464: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:07.464: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:09.467: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:11.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:13.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:15.464: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:17.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:19.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:21.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:23.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:25.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:27.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:29.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:31.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:33.462: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:35.464: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:37.464: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:39.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:41.464: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:43.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:45.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:47.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:49.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:51.462: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:53.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:55.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:57.462: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:48:59.462: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:49:01.462: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:49:03.462: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:49:05.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:49:07.463: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:49:09.462: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:49:11.462: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:49:11.678: INFO: The status of Pod netserver-0 is Pending, waiting for it to be Running (with Ready = true) Jan 21 17:49:11.678: FAIL: Unexpected error: <*errors.errorString | 0xc00021c1e0>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/framework/network.(*NetworkingTestConfig).createNetProxyPods(0xc0032700e0, {0x717ecc6, 0x9}, 0xc0042b58f0) test/e2e/framework/network/utils.go:864 +0x1d0 k8s.io/kubernetes/test/e2e/framework/network.(*NetworkingTestConfig).setupCore(0xc0032700e0, 0x203001?) test/e2e/framework/network/utils.go:761 +0x55 k8s.io/kubernetes/test/e2e/framework/network.(*NetworkingTestConfig).setup(0xc0032700e0, 0x34?) test/e2e/framework/network/utils.go:776 +0x3b k8s.io/kubernetes/test/e2e/framework/network.NewNetworkingTestConfig(0xc001127680, {0xc00299b1b0, 0x1, 0x0?}) test/e2e/framework/network/utils.go:129 +0x125 k8s.io/kubernetes/test/e2e/network.glob..func21.5() test/e2e/network/networking.go:135 +0x45 k8s.io/kubernetes/test/e2e.RunE2ETests(0x25761d7?) test/e2e/e2e.go:130 +0x6bb k8s.io/kubernetes/test/e2e.TestE2E(0x24e52d9?) test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc000ae8680, 0x741f9a8) /usr/local/go/src/testing/testing.go:1446 +0x10b created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1493 +0x35f [AfterEach] [sig-network] Networking test/e2e/framework/framework.go:188 �[1mSTEP�[0m: Collecting events from namespace "nettest-1851". �[1mSTEP�[0m: Found 47 events. Jan 21 17:49:11.896: INFO: At 2023-01-21 17:44:10 +0000 UTC - event for netserver-0: {kubelet i-03775830c60663d32} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "5e253b4e8c4d50ca8399cbe968407f9698ddadc0e232e3460854a167edf65e78": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:11.896: INFO: At 2023-01-21 17:44:10 +0000 UTC - event for netserver-0: {default-scheduler } Scheduled: Successfully assigned nettest-1851/netserver-0 to i-03775830c60663d32 Jan 21 17:49:11.896: INFO: At 2023-01-21 17:44:10 +0000 UTC - event for netserver-1: {default-scheduler } Scheduled: Successfully assigned nettest-1851/netserver-1 to i-0c9a59753149775ab Jan 21 17:49:11.896: INFO: At 2023-01-21 17:44:10 +0000 UTC - event for netserver-1: {kubelet i-0c9a59753149775ab} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "221f61f87536e2924b0896dc2caf199d49581e9dfb73abd885a138dd974ab02b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:11.896: INFO: At 2023-01-21 17:44:10 +0000 UTC - event for netserver-2: {default-scheduler } Scheduled: Successfully assigned nettest-1851/netserver-2 to i-0d64fae545fa8bf3f Jan 21 17:49:11.896: INFO: At 2023-01-21 17:44:10 +0000 UTC - event for netserver-3: {default-scheduler } Scheduled: Successfully assigned nettest-1851/netserver-3 to i-0e989f541e95bf4a9 Jan 21 17:49:11.896: INFO: At 2023-01-21 17:44:11 +0000 UTC - event for netserver-2: {kubelet i-0d64fae545fa8bf3f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "bb6ce9c48d072410363d032b2033dac4e223be9a4fb024699c283f33cf3510c2": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:11.896: INFO: At 2023-01-21 17:44:11 +0000 UTC - event for netserver-3: {kubelet i-0e989f541e95bf4a9} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "0a8b0b93d4bf0213eee9133d77a14bfc2b02567c31df1073b10970f1d750250e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:11.896: INFO: At 2023-01-21 17:44:22 +0000 UTC - event for netserver-0: {kubelet i-03775830c60663d32} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "bf7c8bfd5a4a5d5f28cf6ae18e1f02c2580e9bad22981e6d65ef68e5efd448e7": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:11.896: INFO: At 2023-01-21 17:44:22 +0000 UTC - event for netserver-3: {kubelet i-0e989f541e95bf4a9} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "c27b4bfeb24715a6a645bb3eb905c0e76be4ba30454a6310019cc0f820734b2f": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:11.896: INFO: At 2023-01-21 17:44:26 +0000 UTC - event for netserver-1: {kubelet i-0c9a59753149775ab} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b289360001905f7e1f463827d083fe6b9772f92c3a1f656469bce688296fb5c1": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:11.896: INFO: At 2023-01-21 17:44:26 +0000 UTC - event for netserver-2: {kubelet i-0d64fae545fa8bf3f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "75e49e306da98cad07bf3179fc3750c4c695d21bddebfff5065e57b3e9ce743e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:11.896: INFO: At 2023-01-21 17:44:35 +0000 UTC - event for netserver-0: {kubelet i-03775830c60663d32} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "28da9f8fc212dec25ed2ae7bec9cad6eb7ffaa4a4e35b44e54778990543636b6": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:11.896: INFO: At 2023-01-21 17:44:35 +0000 UTC - event for netserver-3: {kubelet i-0e989f541e95bf4a9} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "9c0464ed24acf4bdb08c96bc157adf94ea43685bfa55a69c2b0790fa6dbaed07": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:11.896: INFO: At 2023-01-21 17:44:38 +0000 UTC - event for netserver-2: {kubelet i-0d64fae545fa8bf3f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "39658117c4e78b5f0a1f60d3f2da84b970f2fb8a311986e4ddbcc385e33a165d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:11.896: INFO: At 2023-01-21 17:44:41 +0000 UTC - event for netserver-1: {kubelet i-0c9a59753149775ab} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "360f2025538d6df7fee280728535f1fbb1d4714b8610d4a4032bcf8f46210e7e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:11.896: INFO: At 2023-01-21 17:44:46 +0000 UTC - event for netserver-3: {kubelet i-0e989f541e95bf4a9} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "f375447fc57b4f2ec1812a58a5db560603cfa9e87a96b72921de4b81efce9941": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:11.896: INFO: At 2023-01-21 17:44:50 +0000 UTC - event for netserver-0: {kubelet i-03775830c60663d32} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "f7acae97355e82d84dbadc6290e88e077d461a69686cb441cbce2fae7032d37b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:11.896: INFO: At 2023-01-21 17:44:53 +0000 UTC - event for netserver-1: {kubelet i-0c9a59753149775ab} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "87d024f84e3d0be45ba83c64ae5195bb1f93ae04d6ba25d1a893234153b3414d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:11.896: INFO: At 2023-01-21 17:44:53 +0000 UTC - event for netserver-2: {kubelet i-0d64fae545fa8bf3f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "28cff8c53114e937e3a02ab1a60f297f47ba1deaa1d92b7a35790794caad7866": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:11.896: INFO: At 2023-01-21 17:45:02 +0000 UTC - event for netserver-3: {kubelet i-0e989f541e95bf4a9} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "aaaec2282a9f147cfd309373eab9307087db4363a2b9cc07d52f1c796790fa21": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:11.896: INFO: At 2023-01-21 17:45:04 +0000 UTC - event for netserver-0: {kubelet i-03775830c60663d32} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6a3694cc85e8523351bd8cb9238bb7f6b515b65418b9a5b22ad2db2aecfb0f36": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:11.896: INFO: At 2023-01-21 17:45:05 +0000 UTC - event for netserver-1: {kubelet i-0c9a59753149775ab} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6295ae3759ce80b68b5092168caf99a579a4cf5a0b8623832cc526034c4bece5": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:11.896: INFO: At 2023-01-21 17:45:05 +0000 UTC - event for netserver-2: {kubelet i-0d64fae545fa8bf3f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "9c886047d5fa119c0217e6649edaf2da906d7e854a7d5c129cf58497f2dace04": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:11.896: INFO: At 2023-01-21 17:45:13 +0000 UTC - event for netserver-3: {kubelet i-0e989f541e95bf4a9} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "2b98d0c71c6f3b1b4908cb46c9e890cc2ae8a89a35cb28521c65e5411c18f320": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:11.896: INFO: At 2023-01-21 17:45:17 +0000 UTC - event for netserver-0: {kubelet i-03775830c60663d32} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b3a284e8dcee0e72a0650c8e1645ee51b31207263edc96a36bf80a6d032bc351": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:11.896: INFO: At 2023-01-21 17:45:18 +0000 UTC - event for netserver-2: {kubelet i-0d64fae545fa8bf3f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "70662068c14a9c40647d7da6fe50f09ccf394e06c3994be9dbda08922217c157": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:11.896: INFO: At 2023-01-21 17:45:20 +0000 UTC - event for netserver-1: {kubelet i-0c9a59753149775ab} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "bb69f2cf508d69e9a7bc64fdbcb382450f06d492fe711acec776b9dba4a12457": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:11.896: INFO: At 2023-01-21 17:45:25 +0000 UTC - event for netserver-3: {kubelet i-0e989f541e95bf4a9} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "87c7d59ab20d3a8d3eb3f6b51d8046f432075ee32951af376374c6da5d151307": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:11.896: INFO: At 2023-01-21 17:45:28 +0000 UTC - event for netserver-0: {kubelet i-03775830c60663d32} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "4410fe675afdd4372e8b981c09ccf946a51461e2ac59629308f4c54f066e12ca": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:11.896: INFO: At 2023-01-21 17:45:29 +0000 UTC - event for netserver-2: {kubelet i-0d64fae545fa8bf3f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "71ad4294d5b56b1db59317a812c6a65c04912f52f60c88ef4f100b96d3dce436": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:11.896: INFO: At 2023-01-21 17:45:35 +0000 UTC - event for netserver-1: {kubelet i-0c9a59753149775ab} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a8e0a4f87c7c58a3e40b827becdebfb86da2e9441802142a82bc0e38da7a735d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:11.896: INFO: At 2023-01-21 17:45:40 +0000 UTC - event for netserver-3: {kubelet i-0e989f541e95bf4a9} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "628ba60ed8bb0a65c79da2a64e71c963b1d636dc25b6324f108bfbd7024ac654": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:11.896: INFO: At 2023-01-21 17:45:42 +0000 UTC - event for netserver-0: {kubelet i-03775830c60663d32} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "23cc3e95f43ebc2d92581de9f535f6ccae87009593c20155ecec863b06490f35": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:11.896: INFO: At 2023-01-21 17:45:44 +0000 UTC - event for netserver-2: {kubelet i-0d64fae545fa8bf3f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "5406f7e8a498e29b35ad52e241ed139c80b1a3bd44101337078bb5014a5ac720": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:11.896: INFO: At 2023-01-21 17:45:48 +0000 UTC - event for netserver-1: {kubelet i-0c9a59753149775ab} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "bf759ad627cee75abd8b9cbad8cb88e1ba958b9627261ae506fd688a3f1b8ef0": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:11.896: INFO: At 2023-01-21 17:45:55 +0000 UTC - event for netserver-0: {kubelet i-03775830c60663d32} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e78f15dc9ceb2657a8cfc89d87c106d7d5b4bd2ddb4043aa625fb7464c945d66": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:11.896: INFO: At 2023-01-21 17:45:55 +0000 UTC - event for netserver-2: {kubelet i-0d64fae545fa8bf3f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "405c9e7d558656f600b65e8863824457e790d9d2890d4e2735337737cb82b73b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:11.896: INFO: At 2023-01-21 17:45:55 +0000 UTC - event for netserver-3: {kubelet i-0e989f541e95bf4a9} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "45817bf9a83f59d5e50ac3c3bb0e6a6d0834a7fd16b1422c583a432dcf694962": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:11.896: INFO: At 2023-01-21 17:46:00 +0000 UTC - event for netserver-1: {kubelet i-0c9a59753149775ab} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "38b23e9351932a421b15404134f8f0d1aa5f8a909f93f1047a3f172cdbe4db5b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:11.896: INFO: At 2023-01-21 17:46:08 +0000 UTC - event for netserver-0: {kubelet i-03775830c60663d32} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b45001ad00cfef876f113696f5969b71da368b75f406627d4f3fa7ed8e0ac0b2": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:11.896: INFO: At 2023-01-21 17:46:08 +0000 UTC - event for netserver-2: {kubelet i-0d64fae545fa8bf3f} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a0279a22bbadf14fa0a86cf20425e3ffc4d5aa92edb96e36af462f0a2d2b9bba": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:11.896: INFO: At 2023-01-21 17:46:09 +0000 UTC - event for netserver-3: {kubelet i-0e989f541e95bf4a9} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "bba50b70cbdf5c05cb98491fadb048d8f3ff65ad019d484b94069d42444ce6d1": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:11.896: INFO: At 2023-01-21 17:46:12 +0000 UTC - event for netserver-1: {kubelet i-0c9a59753149775ab} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a198fea84b682303638d250dbfc04e6fbc91e8ab4991edb4caa0fadab646af41": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:11.896: INFO: At 2023-01-21 17:47:58 +0000 UTC - event for netserver-1: {kubelet i-0c9a59753149775ab} Started: Started container webserver Jan 21 17:49:11.896: INFO: At 2023-01-21 17:47:58 +0000 UTC - event for netserver-1: {kubelet i-0c9a59753149775ab} Created: Created container webserver Jan 21 17:49:11.896: INFO: At 2023-01-21 17:47:58 +0000 UTC - event for netserver-1: {kubelet i-0c9a59753149775ab} Pulled: Container image "k8s.gcr.io/e2e-test-images/agnhost:2.39" already present on machine Jan 21 17:49:12.112: INFO: POD NODE PHASE GRACE CONDITIONS Jan 21 17:49:12.112: INFO: netserver-0 i-03775830c60663d32 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:44:10 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:44:10 +0000 UTC ContainersNotReady containers with unready status: [webserver]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:44:10 +0000 UTC ContainersNotReady containers with unready status: [webserver]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:44:10 +0000 UTC }] Jan 21 17:49:12.112: INFO: netserver-1 i-0c9a59753149775ab Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:44:10 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:48:10 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:48:10 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:44:10 +0000 UTC }] Jan 21 17:49:12.112: INFO: netserver-2 i-0d64fae545fa8bf3f Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:44:10 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:44:10 +0000 UTC ContainersNotReady containers with unready status: [webserver]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:44:10 +0000 UTC ContainersNotReady containers with unready status: [webserver]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:44:10 +0000 UTC }] Jan 21 17:49:12.112: INFO: netserver-3 i-0e989f541e95bf4a9 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:44:10 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:44:10 +0000 UTC ContainersNotReady containers with unready status: [webserver]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:44:10 +0000 UTC ContainersNotReady containers with unready status: [webserver]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:44:10 +0000 UTC }] Jan 21 17:49:12.112: INFO: Jan 21 17:49:12.329: INFO: Unable to fetch nettest-1851/netserver-0/webserver logs: the server rejected our request for an unknown reason (get pods netserver-0) Jan 21 17:49:12.763: INFO: Unable to fetch nettest-1851/netserver-2/webserver logs: the server rejected our request for an unknown reason (get pods netserver-2) Jan 21 17:49:12.981: INFO: Unable to fetch nettest-1851/netserver-3/webserver logs: the server rejected our request for an unknown reason (get pods netserver-3) Jan 21 17:49:13.198: INFO: Logging node info for node i-03775830c60663d32 Jan 21 17:49:13.414: INFO: Node Info: &Node{ObjectMeta:{i-03775830c60663d32 7e863bb0-bd92-4fd6-abc2-40d9e11317f1 33014 0 2023-01-21 17:22:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-southeast-1 failure-domain.beta.kubernetes.io/zone:ap-southeast-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-03775830c60663d32 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-southeast-1a topology.hostpath.csi/node:i-03775830c60663d32 topology.kubernetes.io/region:ap-southeast-1 topology.kubernetes.io/zone:ap-southeast-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.55.172 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-03775830c60663d32"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-21 17:37:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-21 17:47:21 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-21 17:47:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-southeast-1a/i-03775830c60663d32,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078252032 0} {<nil>} 3982668Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973394432 0} {<nil>} 3880268Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 17:47:26 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 17:47:26 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 17:47:26 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 17:47:26 +0000 UTC,LastTransitionTime:2023-01-21 17:23:06 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.55.172,},NodeAddress{Type:ExternalIP,Address:13.229.107.111,},NodeAddress{Type:InternalDNS,Address:i-03775830c60663d32.ap-southeast-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-03775830c60663d32.ap-southeast-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-229-107-111.ap-southeast-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec283bf7e7ad98bfb3e8e233a27b8209,SystemUUID:ec283bf7-e7ad-98bf-b3e8-e233a27b8209,BootID:a0bdbc5b-a9a7-47cf-88a5-9de3c7f8b2ce,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.24.10,KubeProxyVersion:v1.24.10,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.24.10],SizeBytes:112211511,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa k8s.gcr.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb k8s.gcr.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 k8s.gcr.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a k8s.gcr.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 k8s.gcr.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 k8s.gcr.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f k8s.gcr.io/e2e-test-images/nginx:1.15-2],SizeBytes:7000509,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7],SizeBytes:311278,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-05ce4ba3795a29b88],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-05ce4ba3795a29b88,DevicePath:,},},Config:nil,},} Jan 21 17:49:13.415: INFO: Logging kubelet events for node i-03775830c60663d32 Jan 21 17:49:13.632: INFO: Logging pods the kubelet thinks is on node i-03775830c60663d32 Jan 21 17:49:13.860: INFO: netserver-0 started at 2023-01-21 17:44:45 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:13.860: INFO: Container webserver ready: true, restart count 0 Jan 21 17:49:13.860: INFO: netserver-0 started at 2023-01-21 17:44:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:13.860: INFO: Container webserver ready: false, restart count 0 Jan 21 17:49:13.860: INFO: termination-message-containerf7a29c43-fda8-453c-8178-763ce83a42aa started at 2023-01-21 17:45:05 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:13.860: INFO: Container termination-message-container ready: false, restart count 0 Jan 21 17:49:13.860: INFO: pod-a138f362-77a8-42b7-be7c-81ec30a1b470 started at 2023-01-21 17:45:08 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:13.860: INFO: Container write-pod ready: false, restart count 0 Jan 21 17:49:13.860: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-f7vgb started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:13.860: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:13.860: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-8vz56 started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:13.860: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:13.860: INFO: rs-gqcsw started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:13.860: INFO: Container donothing ready: false, restart count 0 Jan 21 17:49:13.860: INFO: externalname-service-2dzs9 started at 2023-01-21 17:44:17 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:13.860: INFO: Container externalname-service ready: false, restart count 0 Jan 21 17:49:13.860: INFO: pod-5c06b80d-aa28-4f8c-b34f-91a4e97e33ea started at 2023-01-21 17:47:19 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:13.860: INFO: Container write-pod ready: false, restart count 0 Jan 21 17:49:13.860: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-nwcqs started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:13.860: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:13.860: INFO: rs-6zfxj started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:13.860: INFO: Container donothing ready: false, restart count 0 Jan 21 17:49:13.860: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-g72gd started at 2023-01-21 17:37:50 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:13.860: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:13.860: INFO: sample-webhook-deployment-68c7bd4684-gmll7 started at 2023-01-21 17:44:17 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:13.860: INFO: Container sample-webhook ready: false, restart count 0 Jan 21 17:49:13.860: INFO: rs-8t6wd started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:13.860: INFO: Container donothing ready: true, restart count 0 Jan 21 17:49:13.860: INFO: pod-with-prestop-exec-hook started at 2023-01-21 17:44:21 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:13.860: INFO: Container pod-with-prestop-exec-hook ready: false, restart count 0 Jan 21 17:49:13.860: INFO: suspend-true-to-false-ctf95 started at 2023-01-21 17:48:40 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:13.860: INFO: Container c ready: false, restart count 0 Jan 21 17:49:13.860: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-8b9jt started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:13.860: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:13.860: INFO: hostexec-i-03775830c60663d32-8wzpb started at 2023-01-21 17:49:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:13.860: INFO: Container agnhost-container ready: true, restart count 0 Jan 21 17:49:13.860: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-k4jpx started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:13.860: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:13.860: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-49cq9 started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:13.860: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:13.860: INFO: ebs-csi-node-lsgbl started at 2023-01-21 17:22:46 +0000 UTC (0+3 container statuses recorded) Jan 21 17:49:13.860: INFO: Container ebs-plugin ready: true, restart count 0 Jan 21 17:49:13.860: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:49:13.860: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 21 17:49:13.860: INFO: cilium-2tq4w started at 2023-01-21 17:22:46 +0000 UTC (1+1 container statuses recorded) Jan 21 17:49:13.860: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 21 17:49:13.860: INFO: Container cilium-agent ready: true, restart count 0 Jan 21 17:49:13.860: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-tfbvc started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:13.860: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:13.860: INFO: suspend-true-to-false-h2lzk started at 2023-01-21 17:48:40 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:13.860: INFO: Container c ready: false, restart count 0 Jan 21 17:49:13.860: INFO: hostexec-i-03775830c60663d32-h4jm4 started at 2023-01-21 17:45:03 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:13.860: INFO: Container agnhost-container ready: true, restart count 0 Jan 21 17:49:13.860: INFO: netserver-0 started at 2023-01-21 17:45:12 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:13.860: INFO: Container webserver ready: false, restart count 0 Jan 21 17:49:13.860: INFO: hairpin started at 2023-01-21 17:47:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:13.860: INFO: Container agnhost-container ready: false, restart count 0 Jan 21 17:49:13.860: INFO: pod-projected-secrets-0da06512-5c21-4d72-a2c9-3392bd5c6e89 started at 2023-01-21 17:44:29 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:13.860: INFO: Container secret-volume-test ready: false, restart count 0 Jan 21 17:49:13.860: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-m9bgz started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:13.860: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:13.860: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-vjvht started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:13.860: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:14.795: INFO: Latency metrics for node i-03775830c60663d32 Jan 21 17:49:14.795: INFO: Logging node info for node i-089df1bd1599c9fac Jan 21 17:49:15.011: INFO: Node Info: &Node{ObjectMeta:{i-089df1bd1599c9fac 5933bf32-55e4-4bc6-811a-9ebde5df5619 33466 0 2023-01-21 17:20:48 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-southeast-1 failure-domain.beta.kubernetes.io/zone:ap-southeast-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-089df1bd1599c9fac kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:ap-southeast-1a topology.kubernetes.io/region:ap-southeast-1 topology.kubernetes.io/zone:ap-southeast-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.40.1 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-089df1bd1599c9fac"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-21 17:20:48 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-21 17:21:14 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:21:23 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:21:23 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 17:21:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-21 17:23:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-southeast-1a/i-089df1bd1599c9fac,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3889451008 0} {<nil>} 3798292Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3784593408 0} {<nil>} 3695892Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 17:48:44 +0000 UTC,LastTransitionTime:2023-01-21 17:20:46 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 17:48:44 +0000 UTC,LastTransitionTime:2023-01-21 17:20:46 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 17:48:44 +0000 UTC,LastTransitionTime:2023-01-21 17:20:46 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 17:48:44 +0000 UTC,LastTransitionTime:2023-01-21 17:21:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.40.1,},NodeAddress{Type:ExternalIP,Address:13.212.76.186,},NodeAddress{Type:InternalDNS,Address:i-089df1bd1599c9fac.ap-southeast-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-089df1bd1599c9fac.ap-southeast-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-212-76-186.ap-southeast-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec28683bad10cfdec8fa4bd6c22408b7,SystemUUID:ec28683b-ad10-cfde-c8fa-4bd6c22408b7,BootID:a32c6813-ffd6-4923-a901-e3a8658adebd,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.24.10,KubeProxyVersion:v1.24.10,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64@sha256:6db2761074bae8385aa601d4b45ab065893cfdc258d8b2593fc56698c44dbee5 k8s.gcr.io/kube-apiserver-amd64:v1.24.10 registry.k8s.io/kube-apiserver-amd64:v1.24.10],SizeBytes:131733971,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64@sha256:8867df47c332bae8dfd061b4d4230cd0febcc5a8a427ecb2e8f70b33ffc6d732 k8s.gcr.io/kube-controller-manager-amd64:v1.24.10 registry.k8s.io/kube-controller-manager-amd64:v1.24.10],SizeBytes:121342265,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.24.10],SizeBytes:112211511,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64@sha256:a589f10748fa227ea6ebf0730126f3f192cbdbb2c7f96a9d4685cabb86eb1cbc k8s.gcr.io/kube-scheduler-amd64:v1.24.10 registry.k8s.io/kube-scheduler-amd64:v1.24.10],SizeBytes:52751160,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-beta.2],SizeBytes:43191763,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-beta.2],SizeBytes:42821714,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:245e81c2ed53b5508a6f687f3ab0c724b9ab31e6a5fa5e6d2f814981ab6ce55f registry.k8s.io/provider-aws/cloud-controller-manager:v1.24.3],SizeBytes:18282737,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-beta.2],SizeBytes:4965793,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 21 17:49:15.011: INFO: Logging kubelet events for node i-089df1bd1599c9fac Jan 21 17:49:15.229: INFO: Logging pods the kubelet thinks is on node i-089df1bd1599c9fac Jan 21 17:49:15.455: INFO: kube-controller-manager-i-089df1bd1599c9fac started at 2023-01-21 17:20:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:15.455: INFO: Container kube-controller-manager ready: true, restart count 3 Jan 21 17:49:15.455: INFO: etcd-manager-events-i-089df1bd1599c9fac started at 2023-01-21 17:20:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:15.455: INFO: Container etcd-manager ready: true, restart count 0 Jan 21 17:49:15.455: INFO: etcd-manager-main-i-089df1bd1599c9fac started at 2023-01-21 17:20:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:15.455: INFO: Container etcd-manager ready: true, restart count 0 Jan 21 17:49:15.455: INFO: kops-controller-7fpkx started at 2023-01-21 17:21:18 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:15.455: INFO: Container kops-controller ready: true, restart count 0 Jan 21 17:49:15.455: INFO: ebs-csi-node-j7jjl started at 2023-01-21 17:21:19 +0000 UTC (0+3 container statuses recorded) Jan 21 17:49:15.455: INFO: Container ebs-plugin ready: true, restart count 0 Jan 21 17:49:15.455: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:49:15.455: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 21 17:49:15.455: INFO: ebs-csi-controller-779575c67d-scjvt started at 2023-01-21 17:21:19 +0000 UTC (0+5 container statuses recorded) Jan 21 17:49:15.455: INFO: Container csi-attacher ready: true, restart count 0 Jan 21 17:49:15.455: INFO: Container csi-provisioner ready: true, restart count 0 Jan 21 17:49:15.455: INFO: Container csi-resizer ready: true, restart count 0 Jan 21 17:49:15.455: INFO: Container ebs-plugin ready: true, restart count 0 Jan 21 17:49:15.455: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:49:15.455: INFO: kube-scheduler-i-089df1bd1599c9fac started at 2023-01-21 17:20:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:15.455: INFO: Container kube-scheduler ready: true, restart count 0 Jan 21 17:49:15.455: INFO: kube-apiserver-i-089df1bd1599c9fac started at 2023-01-21 17:20:10 +0000 UTC (0+2 container statuses recorded) Jan 21 17:49:15.455: INFO: Container healthcheck ready: true, restart count 0 Jan 21 17:49:15.455: INFO: Container kube-apiserver ready: true, restart count 1 Jan 21 17:49:15.455: INFO: aws-cloud-controller-manager-lt9wb started at 2023-01-21 17:21:18 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:15.455: INFO: Container aws-cloud-controller-manager ready: true, restart count 0 Jan 21 17:49:15.456: INFO: cilium-nj7m8 started at 2023-01-21 17:21:19 +0000 UTC (1+1 container statuses recorded) Jan 21 17:49:15.456: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 21 17:49:15.456: INFO: Container cilium-agent ready: true, restart count 1 Jan 21 17:49:15.456: INFO: cilium-operator-8d8478c74-hpl2l started at 2023-01-21 17:21:19 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:15.456: INFO: Container cilium-operator ready: true, restart count 0 Jan 21 17:49:15.456: INFO: dns-controller-7d4957564c-rk48f started at 2023-01-21 17:21:19 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:15.456: INFO: Container dns-controller ready: true, restart count 0 Jan 21 17:49:16.156: INFO: Latency metrics for node i-089df1bd1599c9fac Jan 21 17:49:16.156: INFO: Logging node info for node i-0c9a59753149775ab Jan 21 17:49:16.372: INFO: Node Info: &Node{ObjectMeta:{i-0c9a59753149775ab 5c157934-21a3-4b7b-9fa3-5c66b5b25ec5 33220 0 2023-01-21 17:22:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-southeast-1 failure-domain.beta.kubernetes.io/zone:ap-southeast-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0c9a59753149775ab kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-southeast-1a topology.hostpath.csi/node:i-0c9a59753149775ab topology.kubernetes.io/region:ap-southeast-1 topology.kubernetes.io/zone:ap-southeast-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.34.240 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0c9a59753149775ab"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-21 17:37:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-21 17:47:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-southeast-1a/i-0c9a59753149775ab,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 17:47:38 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 17:47:38 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 17:47:38 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 17:47:38 +0000 UTC,LastTransitionTime:2023-01-21 17:23:06 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.34.240,},NodeAddress{Type:ExternalIP,Address:13.212.2.160,},NodeAddress{Type:InternalDNS,Address:i-0c9a59753149775ab.ap-southeast-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0c9a59753149775ab.ap-southeast-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-212-2-160.ap-southeast-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2610052ce207b4f84f50e9ba8d53ab,SystemUUID:ec261005-2ce2-07b4-f84f-50e9ba8d53ab,BootID:ff39a0e3-8cb1-4190-8b6d-8912e2826f9a,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.24.10,KubeProxyVersion:v1.24.10,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.24.10],SizeBytes:112211511,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa k8s.gcr.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb k8s.gcr.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 k8s.gcr.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a k8s.gcr.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 k8s.gcr.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 k8s.gcr.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f k8s.gcr.io/e2e-test-images/nginx:1.15-2],SizeBytes:7000509,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7],SizeBytes:311278,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 21 17:49:16.372: INFO: Logging kubelet events for node i-0c9a59753149775ab Jan 21 17:49:16.590: INFO: Logging pods the kubelet thinks is on node i-0c9a59753149775ab Jan 21 17:49:16.821: INFO: pod-init-15c5b058-f29b-4a6e-bb36-6f1eb27d04a1 started at 2023-01-21 17:48:47 +0000 UTC (2+1 container statuses recorded) Jan 21 17:49:16.821: INFO: Init container init1 ready: false, restart count 0 Jan 21 17:49:16.821: INFO: Init container init2 ready: false, restart count 0 Jan 21 17:49:16.821: INFO: Container run1 ready: false, restart count 0 Jan 21 17:49:16.821: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-w47qr started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:16.821: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:16.821: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-rvh9t started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:16.821: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:16.821: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-b7bsr started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:16.821: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:16.821: INFO: netserver-1 started at 2023-01-21 17:44:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:16.821: INFO: Container webserver ready: true, restart count 0 Jan 21 17:49:16.821: INFO: netserver-1 started at 2023-01-21 17:45:12 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:16.821: INFO: Container webserver ready: false, restart count 0 Jan 21 17:49:16.821: INFO: pfpod started at 2023-01-21 17:47:14 +0000 UTC (0+2 container statuses recorded) Jan 21 17:49:16.822: INFO: Container portforwardtester ready: false, restart count 0 Jan 21 17:49:16.822: INFO: Container readiness ready: false, restart count 0 Jan 21 17:49:16.822: INFO: ebs-csi-node-vzcrc started at 2023-01-21 17:22:46 +0000 UTC (0+3 container statuses recorded) Jan 21 17:49:16.822: INFO: Container ebs-plugin ready: true, restart count 0 Jan 21 17:49:16.822: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:49:16.822: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 21 17:49:16.822: INFO: rs-fjjf2 started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:16.822: INFO: Container donothing ready: false, restart count 0 Jan 21 17:49:16.822: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-drmzt started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:16.822: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:16.822: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-6hvtr started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:16.822: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:16.822: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-g9wzw started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:16.822: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:16.822: INFO: pod-handle-http-request started at 2023-01-21 17:39:27 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:16.822: INFO: Container agnhost-container ready: true, restart count 0 Jan 21 17:49:16.822: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-z9h5n started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:16.822: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:16.822: INFO: netserver-1 started at 2023-01-21 17:44:45 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:16.822: INFO: Container webserver ready: false, restart count 0 Jan 21 17:49:16.822: INFO: rs-mkvfg started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:16.822: INFO: Container donothing ready: false, restart count 0 Jan 21 17:49:16.822: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-lwrkc started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:16.822: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:16.822: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-s4jct started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:16.822: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:16.822: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-lhl2j started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:16.822: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:16.822: INFO: cilium-7h9rt started at 2023-01-21 17:22:46 +0000 UTC (1+1 container statuses recorded) Jan 21 17:49:16.822: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 21 17:49:16.822: INFO: Container cilium-agent ready: true, restart count 0 Jan 21 17:49:16.822: INFO: pod-subpath-test-inlinevolume-gkbp started at 2023-01-21 17:45:21 +0000 UTC (1+1 container statuses recorded) Jan 21 17:49:16.822: INFO: Init container init-volume-inlinevolume-gkbp ready: false, restart count 0 Jan 21 17:49:16.822: INFO: Container test-container-subpath-inlinevolume-gkbp ready: false, restart count 0 Jan 21 17:49:16.822: INFO: ss2-0 started at 2023-01-21 17:47:15 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:16.822: INFO: Container webserver ready: false, restart count 0 Jan 21 17:49:17.568: INFO: Latency metrics for node i-0c9a59753149775ab Jan 21 17:49:17.568: INFO: Logging node info for node i-0d64fae545fa8bf3f Jan 21 17:49:17.784: INFO: Node Info: &Node{ObjectMeta:{i-0d64fae545fa8bf3f 77fc61e9-438c-4f3e-98aa-2b457c1202a0 31733 0 2023-01-21 17:22:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-southeast-1 failure-domain.beta.kubernetes.io/zone:ap-southeast-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0d64fae545fa8bf3f kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-southeast-1a topology.hostpath.csi/node:i-0d64fae545fa8bf3f topology.kubernetes.io/region:ap-southeast-1 topology.kubernetes.io/zone:ap-southeast-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.53.147 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-volume-expand-9636":"i-0d64fae545fa8bf3f","ebs.csi.aws.com":"i-0d64fae545fa8bf3f"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-21 17:37:47 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-21 17:44:29 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-21 17:44:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-southeast-1a/i-0d64fae545fa8bf3f,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 17:44:32 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 17:44:32 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 17:44:32 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 17:44:32 +0000 UTC,LastTransitionTime:2023-01-21 17:23:05 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.53.147,},NodeAddress{Type:ExternalIP,Address:13.229.75.189,},NodeAddress{Type:InternalDNS,Address:i-0d64fae545fa8bf3f.ap-southeast-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0d64fae545fa8bf3f.ap-southeast-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-229-75-189.ap-southeast-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2dfae26c309b0dd5a9ccb311cb6042,SystemUUID:ec2dfae2-6c30-9b0d-d5a9-ccb311cb6042,BootID:6e6cce59-de74-4521-b0ec-ab95e71b1046,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.24.10,KubeProxyVersion:v1.24.10,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.24.10],SizeBytes:112211511,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c k8s.gcr.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/sample-apiserver@sha256:f9c93b92b6ff750b41a93c4e4fe0bfe384597aeb841e2539d5444815c55b2d8f k8s.gcr.io/e2e-test-images/sample-apiserver:1.17.5],SizeBytes:24316368,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa k8s.gcr.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb k8s.gcr.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 k8s.gcr.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a k8s.gcr.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 k8s.gcr.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7],SizeBytes:311278,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-volume-expand-9636^40436064-99b3-11ed-aefe-f2f9c54a4473],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-volume-expand-9636^40436064-99b3-11ed-aefe-f2f9c54a4473,DevicePath:,},},Config:nil,},} Jan 21 17:49:17.784: INFO: Logging kubelet events for node i-0d64fae545fa8bf3f Jan 21 17:49:18.002: INFO: Logging pods the kubelet thinks is on node i-0d64fae545fa8bf3f Jan 21 17:49:18.231: INFO: coredns-6dd78b7459-44jzj started at 2023-01-21 17:23:22 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:18.232: INFO: Container coredns ready: true, restart count 0 Jan 21 17:49:18.232: INFO: csi-hostpathplugin-0 started at 2023-01-21 17:44:10 +0000 UTC (0+7 container statuses recorded) Jan 21 17:49:18.232: INFO: Container csi-attacher ready: true, restart count 0 Jan 21 17:49:18.232: INFO: Container csi-provisioner ready: true, restart count 0 Jan 21 17:49:18.232: INFO: Container csi-resizer ready: true, restart count 0 Jan 21 17:49:18.232: INFO: Container csi-snapshotter ready: true, restart count 0 Jan 21 17:49:18.232: INFO: Container hostpath ready: true, restart count 0 Jan 21 17:49:18.232: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:49:18.232: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 21 17:49:18.232: INFO: netserver-2 started at 2023-01-21 17:44:45 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:18.232: INFO: Container webserver ready: false, restart count 0 Jan 21 17:49:18.232: INFO: csi-hostpathplugin-0 started at 2023-01-21 17:45:35 +0000 UTC (0+7 container statuses recorded) Jan 21 17:49:18.232: INFO: Container csi-attacher ready: false, restart count 0 Jan 21 17:49:18.232: INFO: Container csi-provisioner ready: false, restart count 0 Jan 21 17:49:18.232: INFO: Container csi-resizer ready: false, restart count 0 Jan 21 17:49:18.232: INFO: Container csi-snapshotter ready: false, restart count 0 Jan 21 17:49:18.232: INFO: Container hostpath ready: false, restart count 0 Jan 21 17:49:18.232: INFO: Container liveness-probe ready: false, restart count 0 Jan 21 17:49:18.232: INFO: Container node-driver-registrar ready: false, restart count 0 Jan 21 17:49:18.232: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-k5qhx started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:18.232: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:18.232: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-gj9hg started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:18.232: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:18.232: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-dhzrx started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:18.232: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:18.232: INFO: rs-rvl99 started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:18.232: INFO: Container donothing ready: false, restart count 0 Jan 21 17:49:18.232: INFO: pod-c4a96c13-73b3-4bb4-b100-d87d572fe413 started at 2023-01-21 17:44:29 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:18.232: INFO: Container write-pod ready: false, restart count 0 Jan 21 17:49:18.232: INFO: rs-cgktj started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:18.232: INFO: Container donothing ready: true, restart count 0 Jan 21 17:49:18.232: INFO: ebs-csi-node-k2jhx started at 2023-01-21 17:22:46 +0000 UTC (0+3 container statuses recorded) Jan 21 17:49:18.232: INFO: Container ebs-plugin ready: true, restart count 0 Jan 21 17:49:18.232: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:49:18.232: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 21 17:49:18.232: INFO: externalname-service-nz5lf started at 2023-01-21 17:44:17 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:18.232: INFO: Container externalname-service ready: false, restart count 0 Jan 21 17:49:18.232: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-fbjxh started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:18.232: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:18.232: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-zjvp4 started at 2023-01-21 17:37:50 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:18.232: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:18.232: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-gplfc started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:18.232: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:18.232: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-kprqk started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:18.232: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:18.232: INFO: netserver-2 started at 2023-01-21 17:45:12 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:18.232: INFO: Container webserver ready: false, restart count 0 Jan 21 17:49:18.232: INFO: netserver-2 started at 2023-01-21 17:44:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:18.232: INFO: Container webserver ready: false, restart count 0 Jan 21 17:49:18.232: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-hrf6g started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:18.232: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:18.232: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-nkjzz started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:18.232: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: false, restart count 0 Jan 21 17:49:18.232: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-857g9 started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:18.232: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:18.232: INFO: cilium-gv5dw started at 2023-01-21 17:22:46 +0000 UTC (1+1 container statuses recorded) Jan 21 17:49:18.232: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 21 17:49:18.232: INFO: Container cilium-agent ready: true, restart count 0 Jan 21 17:49:18.232: INFO: csi-mockplugin-0 started at 2023-01-21 17:47:26 +0000 UTC (0+3 container statuses recorded) Jan 21 17:49:18.232: INFO: Container csi-provisioner ready: false, restart count 0 Jan 21 17:49:18.232: INFO: Container driver-registrar ready: false, restart count 0 Jan 21 17:49:18.232: INFO: Container mock ready: false, restart count 0 Jan 21 17:49:18.232: INFO: csi-mockplugin-attacher-0 started at 2023-01-21 17:47:26 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:18.232: INFO: Container csi-attacher ready: false, restart count 0 Jan 21 17:49:18.970: INFO: Latency metrics for node i-0d64fae545fa8bf3f Jan 21 17:49:18.970: INFO: Logging node info for node i-0e989f541e95bf4a9 Jan 21 17:49:19.185: INFO: Node Info: &Node{ObjectMeta:{i-0e989f541e95bf4a9 bf125f17-fba9-4a1f-bf10-621d29cd68aa 33425 0 2023-01-21 17:22:44 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-southeast-1 failure-domain.beta.kubernetes.io/zone:ap-southeast-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0e989f541e95bf4a9 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-southeast-1a topology.hostpath.csi/node:i-0e989f541e95bf4a9 topology.kubernetes.io/region:ap-southeast-1 topology.kubernetes.io/zone:ap-southeast-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.55.136 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0e989f541e95bf4a9"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-21 17:22:44 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:22:44 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 17:22:44 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-21 17:22:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-21 17:22:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-21 17:37:47 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-21 17:38:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-southeast-1a/i-0e989f541e95bf4a9,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078206976 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973349376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 17:48:37 +0000 UTC,LastTransitionTime:2023-01-21 17:22:44 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 17:48:37 +0000 UTC,LastTransitionTime:2023-01-21 17:22:44 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 17:48:37 +0000 UTC,LastTransitionTime:2023-01-21 17:22:44 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 17:48:37 +0000 UTC,LastTransitionTime:2023-01-21 17:23:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.55.136,},NodeAddress{Type:ExternalIP,Address:13.212.153.84,},NodeAddress{Type:InternalDNS,Address:i-0e989f541e95bf4a9.ap-southeast-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0e989f541e95bf4a9.ap-southeast-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-212-153-84.ap-southeast-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec253ae18d864ba53e81f21cc4edca85,SystemUUID:ec253ae1-8d86-4ba5-3e81-f21cc4edca85,BootID:4abbb0c1-a455-4297-b376-571ca9fcdc78,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.24.10,KubeProxyVersion:v1.24.10,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.24.10],SizeBytes:112211511,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c k8s.gcr.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa k8s.gcr.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb k8s.gcr.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 k8s.gcr.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a k8s.gcr.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf k8s.gcr.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 k8s.gcr.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7],SizeBytes:311278,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 21 17:49:19.186: INFO: Logging kubelet events for node i-0e989f541e95bf4a9 Jan 21 17:49:19.403: INFO: Logging pods the kubelet thinks is on node i-0e989f541e95bf4a9 Jan 21 17:49:19.642: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-59wkt started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:19.642: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:19.642: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-h9gs9 started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:19.642: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:19.642: INFO: cilium-8cmqj started at 2023-01-21 17:22:45 +0000 UTC (1+1 container statuses recorded) Jan 21 17:49:19.642: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 21 17:49:19.642: INFO: Container cilium-agent ready: true, restart count 0 Jan 21 17:49:19.642: INFO: rs-r8h6b started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:19.642: INFO: Container donothing ready: false, restart count 0 Jan 21 17:49:19.642: INFO: hostexec-i-0e989f541e95bf4a9-l5vnf started at 2023-01-21 17:44:08 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:19.642: INFO: Container agnhost-container ready: true, restart count 0 Jan 21 17:49:19.642: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-xtpv2 started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:19.642: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:19.642: INFO: coredns-6dd78b7459-m68gs started at 2023-01-21 17:23:04 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:19.642: INFO: Container coredns ready: true, restart count 0 Jan 21 17:49:19.642: INFO: pod-ca7f77c6-03f7-48db-ac18-47b4f6e40077 started at 2023-01-21 17:44:15 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:19.642: INFO: Container write-pod ready: false, restart count 0 Jan 21 17:49:19.642: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-ztjxc started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:19.642: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:19.642: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-nhfcv started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:19.642: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:19.642: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-tz4hj started at 2023-01-21 17:37:50 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:19.642: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:19.642: INFO: coredns-autoscaler-5f76bf6c7b-lkrtx started at 2023-01-21 17:23:04 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:19.642: INFO: Container autoscaler ready: true, restart count 0 Jan 21 17:49:19.642: INFO: netserver-3 started at 2023-01-21 17:45:13 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:19.642: INFO: Container webserver ready: false, restart count 0 Jan 21 17:49:19.642: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-ndn5x started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:19.642: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:19.642: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-zrrqp started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:19.642: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:19.642: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-vj75s started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:19.642: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:19.642: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-s2hll started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:19.642: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:19.642: INFO: ebs-csi-node-b9gk6 started at 2023-01-21 17:22:45 +0000 UTC (0+3 container statuses recorded) Jan 21 17:49:19.642: INFO: Container ebs-plugin ready: true, restart count 0 Jan 21 17:49:19.642: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:49:19.642: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 21 17:49:19.642: INFO: netserver-3 started at 2023-01-21 17:44:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:19.642: INFO: Container webserver ready: false, restart count 0 Jan 21 17:49:19.642: INFO: netserver-3 started at 2023-01-21 17:44:45 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:19.642: INFO: Container webserver ready: false, restart count 0 Jan 21 17:49:19.642: INFO: hostexec-i-0e989f541e95bf4a9-g7jqg started at 2023-01-21 17:44:18 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:19.642: INFO: Container agnhost-container ready: true, restart count 0 Jan 21 17:49:19.642: INFO: pod-49325389-814c-4807-8002-37e9e3cc1f79 started at 2023-01-21 17:44:23 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:19.642: INFO: Container write-pod ready: false, restart count 0 Jan 21 17:49:19.642: INFO: rs-d9mjn started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:19.642: INFO: Container donothing ready: false, restart count 0 Jan 21 17:49:19.642: INFO: rs-vk2fw started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:19.642: INFO: Container donothing ready: false, restart count 0 Jan 21 17:49:20.389: INFO: Latency metrics for node i-0e989f541e95bf4a9 Jan 21 17:49:20.389: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "nettest-1851" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-network\]\sServices\sshould\sbe\sable\sto\schange\sthe\stype\sfrom\sExternalName\sto\sClusterIP\s\[Conformance\]$'
test/e2e/framework/framework.go:652 Jan 21 17:49:21.627: Unexpected error: <*errors.errorString | 0xc0025fc3f0>: { s: "only 0 pods started out of 2", } only 0 pods started out of 2 occurred test/e2e/network/service.go:1342
[BeforeEach] [sig-network] Services test/e2e/framework/framework.go:187 �[1mSTEP�[0m: Creating a kubernetes client Jan 21 17:44:15.694: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename services �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace [BeforeEach] [sig-network] Services test/e2e/network/service.go:758 [It] should be able to change the type from ExternalName to ClusterIP [Conformance] test/e2e/framework/framework.go:652 �[1mSTEP�[0m: creating a service externalname-service with the type=ExternalName in namespace services-2440 �[1mSTEP�[0m: changing the ExternalName service to type=ClusterIP �[1mSTEP�[0m: creating replication controller externalname-service in namespace services-2440 I0121 17:44:18.058184 6761 runners.go:193] Created replication controller with name: externalname-service, namespace: services-2440, replica count: 2 I0121 17:44:21.309753 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:44:24.310733 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:44:27.311471 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:44:30.313724 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:44:33.314974 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:44:36.316143 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:44:39.316432 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:44:42.317290 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:44:45.319560 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:44:48.320208 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:44:51.320549 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:44:54.320965 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:44:57.321655 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:45:00.322001 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:45:03.322333 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:45:06.323076 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:45:09.325375 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:45:12.325822 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:45:15.328108 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:45:18.328720 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:45:21.329810 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:45:24.330174 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:45:27.330906 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:45:30.333205 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:45:33.333510 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:45:36.335775 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:45:39.337417 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:45:42.338254 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:45:45.340573 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:45:48.340950 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:45:51.341944 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:45:54.342604 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:45:57.343501 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:46:00.344149 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:46:03.345338 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:46:06.346151 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:46:09.346813 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:46:12.347675 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:46:15.347954 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:46:18.349403 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:46:21.351298 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:46:24.351655 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:46:27.352083 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:46:30.353136 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:46:33.353454 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:46:36.353819 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:46:39.355521 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:46:42.356180 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:46:45.357704 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:46:48.358403 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:46:51.360109 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:46:54.362378 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:46:57.362774 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:47:00.365073 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:47:03.365479 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:47:06.367937 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:47:09.368230 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:47:12.368987 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:47:15.369908 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:47:18.370781 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:47:21.372298 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:47:24.374186 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:47:27.374890 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:47:30.375903 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:47:33.377116 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:47:36.377515 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:47:39.377817 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:47:42.378644 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:47:45.380190 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:47:48.380726 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:47:51.381451 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:47:54.381794 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:47:57.382942 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:48:00.383256 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:48:03.384597 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:48:06.386865 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:48:09.388546 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:48:12.388891 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:48:15.390001 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:48:18.390972 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:48:21.391391 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:48:24.391807 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:48:27.392591 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:48:30.393272 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:48:33.393659 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:48:36.395929 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:48:39.396263 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:48:42.397017 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:48:45.397333 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:48:48.397694 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:48:51.398008 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:48:54.399713 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:48:57.400484 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:49:00.402818 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:49:03.404283 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:49:06.406550 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:49:09.406865 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:49:12.407905 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:49:15.410153 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:49:18.411384 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:49:21.412537 6761 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0121 17:49:21.627045 6761 runners.go:193] Pod externalname-service-2dzs9 i-03775830c60663d32 Pending <nil> I0121 17:49:21.627140 6761 runners.go:193] Pod externalname-service-nz5lf i-0d64fae545fa8bf3f Pending <nil> Jan 21 17:49:21.627: FAIL: Unexpected error: <*errors.errorString | 0xc0025fc3f0>: { s: "only 0 pods started out of 2", } only 0 pods started out of 2 occurred Full Stack Trace k8s.io/kubernetes/test/e2e/network.glob..func25.14() test/e2e/network/service.go:1342 +0x1bd k8s.io/kubernetes/test/e2e.RunE2ETests(0x25761d7?) test/e2e/e2e.go:130 +0x6bb k8s.io/kubernetes/test/e2e.TestE2E(0x24e52d9?) test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc000c04b60, 0x741f9a8) /usr/local/go/src/testing/testing.go:1446 +0x10b created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1493 +0x35f Jan 21 17:49:21.627: INFO: Cleaning up the ExternalName to ClusterIP test service [AfterEach] [sig-network] Services test/e2e/framework/framework.go:188 �[1mSTEP�[0m: Collecting events from namespace "services-2440". �[1mSTEP�[0m: Found 24 events. Jan 21 17:49:22.073: INFO: At 2023-01-21 17:44:17 +0000 UTC - event for externalname-service: {replication-controller } SuccessfulCreate: Created pod: externalname-service-nz5lf Jan 21 17:49:22.073: INFO: At 2023-01-21 17:44:17 +0000 UTC - event for externalname-service: {replication-controller } SuccessfulCreate: Created pod: externalname-service-2dzs9 Jan 21 17:49:22.073: INFO: At 2023-01-21 17:44:17 +0000 UTC - event for externalname-service-2dzs9: {default-scheduler } Scheduled: Successfully assigned services-2440/externalname-service-2dzs9 to i-03775830c60663d32 Jan 21 17:49:22.073: INFO: At 2023-01-21 17:44:17 +0000 UTC - event for externalname-service-nz5lf: {default-scheduler } Scheduled: Successfully assigned services-2440/externalname-service-nz5lf to i-0d64fae545fa8bf3f Jan 21 17:49:22.073: INFO: At 2023-01-21 17:44:18 +0000 UTC - event for externalname-service-2dzs9: {kubelet i-03775830c60663d32} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "11cab80a747463cbc618c4fc249272d9940a64e05711588b55a636b8887b7a72": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:22.073: INFO: At 2023-01-21 17:44:18 +0000 UTC - event for externalname-service-nz5lf: {kubelet i-0d64fae545fa8bf3f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "f3fefb7cfc220dd61cb123577e4e286474f0c20a60c732f82b276b92c895b1b3": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:22.073: INFO: At 2023-01-21 17:44:31 +0000 UTC - event for externalname-service-nz5lf: {kubelet i-0d64fae545fa8bf3f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ed3236af20f60c70e75e8f7942a6a67763fd03880d8b5524262cfb56f027060f": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:22.073: INFO: At 2023-01-21 17:44:32 +0000 UTC - event for externalname-service-2dzs9: {kubelet i-03775830c60663d32} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "3d86c2d15444da0cbdc5ded231c05614d4abd16b99db2b383d6f327eed598f5e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:22.073: INFO: At 2023-01-21 17:44:43 +0000 UTC - event for externalname-service-nz5lf: {kubelet i-0d64fae545fa8bf3f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "06a69d4b5b058314dc04128590cbd69c35db54a43c608a650bedc188db638da3": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:22.073: INFO: At 2023-01-21 17:44:44 +0000 UTC - event for externalname-service-2dzs9: {kubelet i-03775830c60663d32} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d6b5e3cd0714bba1164249b219bdeb20de63d872c0f70001c34b076d6c0b1e94": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:22.073: INFO: At 2023-01-21 17:44:54 +0000 UTC - event for externalname-service-nz5lf: {kubelet i-0d64fae545fa8bf3f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d5d022bbced512b3e3dd2819e2ff42140060d81316fcbe1f9cd588e1972fc064": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:22.074: INFO: At 2023-01-21 17:44:56 +0000 UTC - event for externalname-service-2dzs9: {kubelet i-03775830c60663d32} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "89a14b193547c1c2b48b9feea333a5aca3fafde5ef8badb68ac0312cdcdf4534": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:22.074: INFO: At 2023-01-21 17:45:08 +0000 UTC - event for externalname-service-nz5lf: {kubelet i-0d64fae545fa8bf3f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "db3bb773d00ad3b226bd1c2c3d3ac20ab735a97c6e2ad9374320c3c3913f8941": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:22.074: INFO: At 2023-01-21 17:45:10 +0000 UTC - event for externalname-service-2dzs9: {kubelet i-03775830c60663d32} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "cdc9cc6579bc868e58c142020ca6ded900bc2f0c2621a1df73c926aebfa33087": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:22.074: INFO: At 2023-01-21 17:45:19 +0000 UTC - event for externalname-service-nz5lf: {kubelet i-0d64fae545fa8bf3f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "bd841926f9eb9ee0cbf143fd31c2040106ac4d6daf67f953dd85e5e9849ea0ee": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:22.074: INFO: At 2023-01-21 17:45:21 +0000 UTC - event for externalname-service-2dzs9: {kubelet i-03775830c60663d32} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "16d6395feaff86753fa6e5b788dcdd5d01e8771835d79c942a45664a4d4941e7": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:22.074: INFO: At 2023-01-21 17:45:32 +0000 UTC - event for externalname-service-nz5lf: {kubelet i-0d64fae545fa8bf3f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "852ee9bd9a81318ef6232e5ca131163be7e51fcd69a2990050d4e070769d0891": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:22.074: INFO: At 2023-01-21 17:45:33 +0000 UTC - event for externalname-service-2dzs9: {kubelet i-03775830c60663d32} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "969478e6bc4d397ade2f0c6d545860d6baab4e4c8b4f5b49aa2453dc480bdb7f": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:22.074: INFO: At 2023-01-21 17:45:45 +0000 UTC - event for externalname-service-2dzs9: {kubelet i-03775830c60663d32} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "5d8c7eb32ef29701ef0c901abca30a063e36025cc9c6ddf0b9d0274f3fd0f1ba": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:22.074: INFO: At 2023-01-21 17:45:45 +0000 UTC - event for externalname-service-nz5lf: {kubelet i-0d64fae545fa8bf3f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ba801e4f5a6c9c3c6a81320bd681803efe4a840c2c09b13705e6f4a75f4ccb25": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:22.074: INFO: At 2023-01-21 17:45:57 +0000 UTC - event for externalname-service-nz5lf: {kubelet i-0d64fae545fa8bf3f} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "171cbb9f45ac31d1ad118c9842fb3b2e752870186ddba7d84d1451500e3074ec": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:22.074: INFO: At 2023-01-21 17:46:00 +0000 UTC - event for externalname-service-2dzs9: {kubelet i-03775830c60663d32} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "50c9a74f9189c30f902eaeaff2fca4a0beb030ae2685f685647a63e866ea4083": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:22.074: INFO: At 2023-01-21 17:46:10 +0000 UTC - event for externalname-service-nz5lf: {kubelet i-0d64fae545fa8bf3f} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e948e6822b17314d7b94760b4833950022b19d0295270cc59fc637c7a15023d8": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:22.074: INFO: At 2023-01-21 17:46:14 +0000 UTC - event for externalname-service-2dzs9: {kubelet i-03775830c60663d32} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a2fc8cb819cc28a92c91913eb11b112a7faaed749732b54a9a761fed276589f0": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 21 17:49:22.288: INFO: POD NODE PHASE GRACE CONDITIONS Jan 21 17:49:22.288: INFO: externalname-service-2dzs9 i-03775830c60663d32 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:44:17 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:44:17 +0000 UTC ContainersNotReady containers with unready status: [externalname-service]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:44:17 +0000 UTC ContainersNotReady containers with unready status: [externalname-service]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:44:17 +0000 UTC }] Jan 21 17:49:22.288: INFO: externalname-service-nz5lf i-0d64fae545fa8bf3f Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:44:17 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:44:17 +0000 UTC ContainersNotReady containers with unready status: [externalname-service]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:44:17 +0000 UTC ContainersNotReady containers with unready status: [externalname-service]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 17:44:17 +0000 UTC }] Jan 21 17:49:22.288: INFO: Jan 21 17:49:22.503: INFO: Unable to fetch services-2440/externalname-service-2dzs9/externalname-service logs: the server rejected our request for an unknown reason (get pods externalname-service-2dzs9) Jan 21 17:49:22.719: INFO: Unable to fetch services-2440/externalname-service-nz5lf/externalname-service logs: the server rejected our request for an unknown reason (get pods externalname-service-nz5lf) Jan 21 17:49:22.935: INFO: Logging node info for node i-03775830c60663d32 Jan 21 17:49:23.149: INFO: Node Info: &Node{ObjectMeta:{i-03775830c60663d32 7e863bb0-bd92-4fd6-abc2-40d9e11317f1 33014 0 2023-01-21 17:22:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-southeast-1 failure-domain.beta.kubernetes.io/zone:ap-southeast-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-03775830c60663d32 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-southeast-1a topology.hostpath.csi/node:i-03775830c60663d32 topology.kubernetes.io/region:ap-southeast-1 topology.kubernetes.io/zone:ap-southeast-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.55.172 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-03775830c60663d32"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-21 17:37:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-21 17:47:21 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-21 17:47:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-southeast-1a/i-03775830c60663d32,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078252032 0} {<nil>} 3982668Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973394432 0} {<nil>} 3880268Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 17:47:26 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 17:47:26 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 17:47:26 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 17:47:26 +0000 UTC,LastTransitionTime:2023-01-21 17:23:06 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.55.172,},NodeAddress{Type:ExternalIP,Address:13.229.107.111,},NodeAddress{Type:InternalDNS,Address:i-03775830c60663d32.ap-southeast-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-03775830c60663d32.ap-southeast-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-229-107-111.ap-southeast-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec283bf7e7ad98bfb3e8e233a27b8209,SystemUUID:ec283bf7-e7ad-98bf-b3e8-e233a27b8209,BootID:a0bdbc5b-a9a7-47cf-88a5-9de3c7f8b2ce,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.24.10,KubeProxyVersion:v1.24.10,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.24.10],SizeBytes:112211511,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa k8s.gcr.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb k8s.gcr.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 k8s.gcr.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a k8s.gcr.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 k8s.gcr.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 k8s.gcr.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f k8s.gcr.io/e2e-test-images/nginx:1.15-2],SizeBytes:7000509,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7],SizeBytes:311278,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-05ce4ba3795a29b88],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-05ce4ba3795a29b88,DevicePath:,},},Config:nil,},} Jan 21 17:49:23.150: INFO: Logging kubelet events for node i-03775830c60663d32 Jan 21 17:49:23.367: INFO: Logging pods the kubelet thinks is on node i-03775830c60663d32 Jan 21 17:49:23.593: INFO: pod-with-prestop-exec-hook started at 2023-01-21 17:44:21 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:23.593: INFO: Container pod-with-prestop-exec-hook ready: false, restart count 0 Jan 21 17:49:23.593: INFO: suspend-true-to-false-ctf95 started at 2023-01-21 17:48:40 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:23.593: INFO: Container c ready: false, restart count 0 Jan 21 17:49:23.593: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-8b9jt started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:23.593: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:23.593: INFO: hostexec-i-03775830c60663d32-8wzpb started at 2023-01-21 17:49:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:23.593: INFO: Container agnhost-container ready: true, restart count 0 Jan 21 17:49:23.593: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-k4jpx started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:23.593: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:23.593: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-49cq9 started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:23.593: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:23.593: INFO: ebs-csi-node-lsgbl started at 2023-01-21 17:22:46 +0000 UTC (0+3 container statuses recorded) Jan 21 17:49:23.593: INFO: Container ebs-plugin ready: true, restart count 0 Jan 21 17:49:23.593: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:49:23.593: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 21 17:49:23.593: INFO: cilium-2tq4w started at 2023-01-21 17:22:46 +0000 UTC (1+1 container statuses recorded) Jan 21 17:49:23.593: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 21 17:49:23.593: INFO: Container cilium-agent ready: true, restart count 0 Jan 21 17:49:23.593: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-tfbvc started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:23.593: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:23.593: INFO: suspend-true-to-false-h2lzk started at 2023-01-21 17:48:40 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:23.593: INFO: Container c ready: false, restart count 0 Jan 21 17:49:23.593: INFO: pod-fa8f7974-7a8f-4d0a-a9f4-246237bfa8b6 started at 2023-01-21 17:49:16 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:23.593: INFO: Container write-pod ready: false, restart count 0 Jan 21 17:49:23.593: INFO: hostexec-i-03775830c60663d32-h4jm4 started at 2023-01-21 17:45:03 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:23.593: INFO: Container agnhost-container ready: true, restart count 0 Jan 21 17:49:23.593: INFO: netserver-0 started at 2023-01-21 17:45:12 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:23.593: INFO: Container webserver ready: false, restart count 0 Jan 21 17:49:23.593: INFO: hairpin started at 2023-01-21 17:47:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:23.593: INFO: Container agnhost-container ready: false, restart count 0 Jan 21 17:49:23.593: INFO: pod-projected-secrets-0da06512-5c21-4d72-a2c9-3392bd5c6e89 started at 2023-01-21 17:44:29 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:23.593: INFO: Container secret-volume-test ready: false, restart count 0 Jan 21 17:49:23.593: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-m9bgz started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:23.593: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:23.593: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-vjvht started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:23.593: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:23.593: INFO: exceed-active-deadline-9dnzs started at 2023-01-21 17:49:22 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:23.593: INFO: Container c ready: false, restart count 0 Jan 21 17:49:23.593: INFO: netserver-0 started at 2023-01-21 17:44:45 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:23.593: INFO: Container webserver ready: true, restart count 0 Jan 21 17:49:23.593: INFO: netserver-0 started at 2023-01-21 17:44:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:23.593: INFO: Container webserver ready: false, restart count 0 Jan 21 17:49:23.593: INFO: termination-message-containerf7a29c43-fda8-453c-8178-763ce83a42aa started at 2023-01-21 17:45:05 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:23.593: INFO: Container termination-message-container ready: false, restart count 0 Jan 21 17:49:23.593: INFO: pod-a138f362-77a8-42b7-be7c-81ec30a1b470 started at 2023-01-21 17:45:08 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:23.593: INFO: Container write-pod ready: false, restart count 0 Jan 21 17:49:23.593: INFO: exceed-active-deadline-tzmp4 started at 2023-01-21 17:49:22 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:23.593: INFO: Container c ready: false, restart count 0 Jan 21 17:49:23.593: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-f7vgb started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:23.593: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:23.593: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-8vz56 started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:23.593: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:23.593: INFO: rs-gqcsw started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:23.593: INFO: Container donothing ready: false, restart count 0 Jan 21 17:49:23.593: INFO: externalname-service-2dzs9 started at 2023-01-21 17:44:17 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:23.593: INFO: Container externalname-service ready: false, restart count 0 Jan 21 17:49:23.593: INFO: pod-5c06b80d-aa28-4f8c-b34f-91a4e97e33ea started at 2023-01-21 17:47:19 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:23.593: INFO: Container write-pod ready: false, restart count 0 Jan 21 17:49:23.593: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-nwcqs started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:23.593: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:23.593: INFO: rs-6zfxj started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:23.593: INFO: Container donothing ready: false, restart count 0 Jan 21 17:49:23.593: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-g72gd started at 2023-01-21 17:37:50 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:23.593: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:23.593: INFO: sample-webhook-deployment-68c7bd4684-gmll7 started at 2023-01-21 17:44:17 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:23.593: INFO: Container sample-webhook ready: false, restart count 0 Jan 21 17:49:23.593: INFO: rs-8t6wd started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:23.593: INFO: Container donothing ready: true, restart count 0 Jan 21 17:49:24.512: INFO: Latency metrics for node i-03775830c60663d32 Jan 21 17:49:24.512: INFO: Logging node info for node i-089df1bd1599c9fac Jan 21 17:49:24.726: INFO: Node Info: &Node{ObjectMeta:{i-089df1bd1599c9fac 5933bf32-55e4-4bc6-811a-9ebde5df5619 33466 0 2023-01-21 17:20:48 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-southeast-1 failure-domain.beta.kubernetes.io/zone:ap-southeast-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-089df1bd1599c9fac kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:ap-southeast-1a topology.kubernetes.io/region:ap-southeast-1 topology.kubernetes.io/zone:ap-southeast-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.40.1 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-089df1bd1599c9fac"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-21 17:20:48 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-21 17:21:14 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:21:23 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:21:23 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 17:21:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-21 17:23:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-southeast-1a/i-089df1bd1599c9fac,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3889451008 0} {<nil>} 3798292Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3784593408 0} {<nil>} 3695892Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 17:48:44 +0000 UTC,LastTransitionTime:2023-01-21 17:20:46 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 17:48:44 +0000 UTC,LastTransitionTime:2023-01-21 17:20:46 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 17:48:44 +0000 UTC,LastTransitionTime:2023-01-21 17:20:46 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 17:48:44 +0000 UTC,LastTransitionTime:2023-01-21 17:21:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.40.1,},NodeAddress{Type:ExternalIP,Address:13.212.76.186,},NodeAddress{Type:InternalDNS,Address:i-089df1bd1599c9fac.ap-southeast-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-089df1bd1599c9fac.ap-southeast-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-212-76-186.ap-southeast-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec28683bad10cfdec8fa4bd6c22408b7,SystemUUID:ec28683b-ad10-cfde-c8fa-4bd6c22408b7,BootID:a32c6813-ffd6-4923-a901-e3a8658adebd,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.24.10,KubeProxyVersion:v1.24.10,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64@sha256:6db2761074bae8385aa601d4b45ab065893cfdc258d8b2593fc56698c44dbee5 k8s.gcr.io/kube-apiserver-amd64:v1.24.10 registry.k8s.io/kube-apiserver-amd64:v1.24.10],SizeBytes:131733971,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64@sha256:8867df47c332bae8dfd061b4d4230cd0febcc5a8a427ecb2e8f70b33ffc6d732 k8s.gcr.io/kube-controller-manager-amd64:v1.24.10 registry.k8s.io/kube-controller-manager-amd64:v1.24.10],SizeBytes:121342265,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.24.10],SizeBytes:112211511,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64@sha256:a589f10748fa227ea6ebf0730126f3f192cbdbb2c7f96a9d4685cabb86eb1cbc k8s.gcr.io/kube-scheduler-amd64:v1.24.10 registry.k8s.io/kube-scheduler-amd64:v1.24.10],SizeBytes:52751160,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-beta.2],SizeBytes:43191763,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-beta.2],SizeBytes:42821714,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:245e81c2ed53b5508a6f687f3ab0c724b9ab31e6a5fa5e6d2f814981ab6ce55f registry.k8s.io/provider-aws/cloud-controller-manager:v1.24.3],SizeBytes:18282737,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-beta.2],SizeBytes:4965793,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 21 17:49:24.727: INFO: Logging kubelet events for node i-089df1bd1599c9fac Jan 21 17:49:24.943: INFO: Logging pods the kubelet thinks is on node i-089df1bd1599c9fac Jan 21 17:49:25.165: INFO: ebs-csi-controller-779575c67d-scjvt started at 2023-01-21 17:21:19 +0000 UTC (0+5 container statuses recorded) Jan 21 17:49:25.165: INFO: Container csi-attacher ready: true, restart count 0 Jan 21 17:49:25.165: INFO: Container csi-provisioner ready: true, restart count 0 Jan 21 17:49:25.165: INFO: Container csi-resizer ready: true, restart count 0 Jan 21 17:49:25.165: INFO: Container ebs-plugin ready: true, restart count 0 Jan 21 17:49:25.165: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:49:25.165: INFO: kube-controller-manager-i-089df1bd1599c9fac started at 2023-01-21 17:20:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:25.165: INFO: Container kube-controller-manager ready: true, restart count 3 Jan 21 17:49:25.165: INFO: etcd-manager-events-i-089df1bd1599c9fac started at 2023-01-21 17:20:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:25.165: INFO: Container etcd-manager ready: true, restart count 0 Jan 21 17:49:25.165: INFO: etcd-manager-main-i-089df1bd1599c9fac started at 2023-01-21 17:20:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:25.165: INFO: Container etcd-manager ready: true, restart count 0 Jan 21 17:49:25.165: INFO: kops-controller-7fpkx started at 2023-01-21 17:21:18 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:25.165: INFO: Container kops-controller ready: true, restart count 0 Jan 21 17:49:25.165: INFO: ebs-csi-node-j7jjl started at 2023-01-21 17:21:19 +0000 UTC (0+3 container statuses recorded) Jan 21 17:49:25.165: INFO: Container ebs-plugin ready: true, restart count 0 Jan 21 17:49:25.165: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:49:25.165: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 21 17:49:25.165: INFO: dns-controller-7d4957564c-rk48f started at 2023-01-21 17:21:19 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:25.165: INFO: Container dns-controller ready: true, restart count 0 Jan 21 17:49:25.165: INFO: kube-scheduler-i-089df1bd1599c9fac started at 2023-01-21 17:20:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:25.165: INFO: Container kube-scheduler ready: true, restart count 0 Jan 21 17:49:25.165: INFO: kube-apiserver-i-089df1bd1599c9fac started at 2023-01-21 17:20:10 +0000 UTC (0+2 container statuses recorded) Jan 21 17:49:25.165: INFO: Container healthcheck ready: true, restart count 0 Jan 21 17:49:25.165: INFO: Container kube-apiserver ready: true, restart count 1 Jan 21 17:49:25.165: INFO: aws-cloud-controller-manager-lt9wb started at 2023-01-21 17:21:18 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:25.165: INFO: Container aws-cloud-controller-manager ready: true, restart count 0 Jan 21 17:49:25.165: INFO: cilium-nj7m8 started at 2023-01-21 17:21:19 +0000 UTC (1+1 container statuses recorded) Jan 21 17:49:25.165: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 21 17:49:25.165: INFO: Container cilium-agent ready: true, restart count 1 Jan 21 17:49:25.165: INFO: cilium-operator-8d8478c74-hpl2l started at 2023-01-21 17:21:19 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:25.165: INFO: Container cilium-operator ready: true, restart count 0 Jan 21 17:49:25.899: INFO: Latency metrics for node i-089df1bd1599c9fac Jan 21 17:49:25.899: INFO: Logging node info for node i-0c9a59753149775ab Jan 21 17:49:26.113: INFO: Node Info: &Node{ObjectMeta:{i-0c9a59753149775ab 5c157934-21a3-4b7b-9fa3-5c66b5b25ec5 33220 0 2023-01-21 17:22:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-southeast-1 failure-domain.beta.kubernetes.io/zone:ap-southeast-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0c9a59753149775ab kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-southeast-1a topology.hostpath.csi/node:i-0c9a59753149775ab topology.kubernetes.io/region:ap-southeast-1 topology.kubernetes.io/zone:ap-southeast-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.34.240 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0c9a59753149775ab"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-21 17:37:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-21 17:47:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-southeast-1a/i-0c9a59753149775ab,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 17:47:38 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 17:47:38 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 17:47:38 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 17:47:38 +0000 UTC,LastTransitionTime:2023-01-21 17:23:06 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.34.240,},NodeAddress{Type:ExternalIP,Address:13.212.2.160,},NodeAddress{Type:InternalDNS,Address:i-0c9a59753149775ab.ap-southeast-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0c9a59753149775ab.ap-southeast-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-212-2-160.ap-southeast-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2610052ce207b4f84f50e9ba8d53ab,SystemUUID:ec261005-2ce2-07b4-f84f-50e9ba8d53ab,BootID:ff39a0e3-8cb1-4190-8b6d-8912e2826f9a,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.24.10,KubeProxyVersion:v1.24.10,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.24.10],SizeBytes:112211511,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa k8s.gcr.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb k8s.gcr.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 k8s.gcr.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a k8s.gcr.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 k8s.gcr.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 k8s.gcr.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:55d0552eb6538050ea7741e46b35d27eccffeeaed7010f9f2bad0a89c149bc6f k8s.gcr.io/e2e-test-images/nginx:1.15-2],SizeBytes:7000509,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7],SizeBytes:311278,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 21 17:49:26.114: INFO: Logging kubelet events for node i-0c9a59753149775ab Jan 21 17:49:26.330: INFO: Logging pods the kubelet thinks is on node i-0c9a59753149775ab Jan 21 17:49:26.554: INFO: ss2-0 started at 2023-01-21 17:47:15 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:26.554: INFO: Container webserver ready: false, restart count 0 Jan 21 17:49:26.554: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-s4jct started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:26.554: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:26.554: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-lhl2j started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:26.554: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:26.554: INFO: cilium-7h9rt started at 2023-01-21 17:22:46 +0000 UTC (1+1 container statuses recorded) Jan 21 17:49:26.554: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 21 17:49:26.554: INFO: Container cilium-agent ready: true, restart count 0 Jan 21 17:49:26.554: INFO: pod-subpath-test-inlinevolume-gkbp started at 2023-01-21 17:45:21 +0000 UTC (1+1 container statuses recorded) Jan 21 17:49:26.554: INFO: Init container init-volume-inlinevolume-gkbp ready: false, restart count 0 Jan 21 17:49:26.554: INFO: Container test-container-subpath-inlinevolume-gkbp ready: false, restart count 0 Jan 21 17:49:26.554: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-b7bsr started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:26.554: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:26.554: INFO: netserver-1 started at 2023-01-21 17:44:10 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:26.554: INFO: Container webserver ready: true, restart count 0 Jan 21 17:49:26.554: INFO: pod-init-15c5b058-f29b-4a6e-bb36-6f1eb27d04a1 started at 2023-01-21 17:48:47 +0000 UTC (2+1 container statuses recorded) Jan 21 17:49:26.554: INFO: Init container init1 ready: false, restart count 0 Jan 21 17:49:26.554: INFO: Init container init2 ready: false, restart count 0 Jan 21 17:49:26.554: INFO: Container run1 ready: false, restart count 0 Jan 21 17:49:26.554: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-w47qr started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:26.554: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:26.554: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-rvh9t started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:26.554: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:26.554: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-drmzt started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:26.554: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:26.554: INFO: netserver-1 started at 2023-01-21 17:45:12 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:26.554: INFO: Container webserver ready: false, restart count 0 Jan 21 17:49:26.554: INFO: pfpod started at 2023-01-21 17:47:14 +0000 UTC (0+2 container statuses recorded) Jan 21 17:49:26.554: INFO: Container portforwardtester ready: false, restart count 0 Jan 21 17:49:26.554: INFO: Container readiness ready: false, restart count 0 Jan 21 17:49:26.554: INFO: ebs-csi-node-vzcrc started at 2023-01-21 17:22:46 +0000 UTC (0+3 container statuses recorded) Jan 21 17:49:26.555: INFO: Container ebs-plugin ready: true, restart count 0 Jan 21 17:49:26.555: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:49:26.555: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 21 17:49:26.555: INFO: rs-fjjf2 started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:26.555: INFO: Container donothing ready: false, restart count 0 Jan 21 17:49:26.555: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-6hvtr started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:26.555: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:26.555: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-g9wzw started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:26.555: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:26.555: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-z9h5n started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:26.555: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:26.555: INFO: netserver-1 started at 2023-01-21 17:44:45 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:26.555: INFO: Container webserver ready: false, restart count 0 Jan 21 17:49:26.555: INFO: pod-handle-http-request started at 2023-01-21 17:39:27 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:26.555: INFO: Container agnhost-container ready: true, restart count 0 Jan 21 17:49:26.555: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-lwrkc started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:26.555: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:26.555: INFO: rs-mkvfg started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:26.555: INFO: Container donothing ready: false, restart count 0 Jan 21 17:49:27.284: INFO: Latency metrics for node i-0c9a59753149775ab Jan 21 17:49:27.284: INFO: Logging node info for node i-0d64fae545fa8bf3f Jan 21 17:49:27.498: INFO: Node Info: &Node{ObjectMeta:{i-0d64fae545fa8bf3f 77fc61e9-438c-4f3e-98aa-2b457c1202a0 31733 0 2023-01-21 17:22:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-southeast-1 failure-domain.beta.kubernetes.io/zone:ap-southeast-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0d64fae545fa8bf3f kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-southeast-1a topology.hostpath.csi/node:i-0d64fae545fa8bf3f topology.kubernetes.io/region:ap-southeast-1 topology.kubernetes.io/zone:ap-southeast-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.53.147 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-volume-expand-9636":"i-0d64fae545fa8bf3f","ebs.csi.aws.com":"i-0d64fae545fa8bf3f"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-21 17:22:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 17:22:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-21 17:37:47 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-21 17:44:29 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-21 17:44:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-southeast-1a/i-0d64fae545fa8bf3f,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 17:44:32 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 17:44:32 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 17:44:32 +0000 UTC,LastTransitionTime:2023-01-21 17:22:45 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 17:44:32 +0000 UTC,LastTransitionTime:2023-01-21 17:23:05 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.53.147,},NodeAddress{Type:ExternalIP,Address:13.229.75.189,},NodeAddress{Type:InternalDNS,Address:i-0d64fae545fa8bf3f.ap-southeast-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0d64fae545fa8bf3f.ap-southeast-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-229-75-189.ap-southeast-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2dfae26c309b0dd5a9ccb311cb6042,SystemUUID:ec2dfae2-6c30-9b0d-d5a9-ccb311cb6042,BootID:6e6cce59-de74-4521-b0ec-ab95e71b1046,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.24.10,KubeProxyVersion:v1.24.10,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.24.10],SizeBytes:112211511,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c k8s.gcr.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/sample-apiserver@sha256:f9c93b92b6ff750b41a93c4e4fe0bfe384597aeb841e2539d5444815c55b2d8f k8s.gcr.io/e2e-test-images/sample-apiserver:1.17.5],SizeBytes:24316368,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:6477988532358148d2e98f7c747db4e9250bbc7ad2664bf666348abf9ee1f5aa k8s.gcr.io/sig-storage/csi-provisioner:v3.0.0],SizeBytes:22728994,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6e0546563b18872b0aa0cad7255a26bb9a87cb879b7fc3e2383c867ef4f706fb k8s.gcr.io/sig-storage/csi-resizer:v1.3.0],SizeBytes:21671340,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:818f35653f2e214db81d655063e81995de9073328a3430498624c140881026a3 k8s.gcr.io/sig-storage/csi-snapshotter:v4.2.1],SizeBytes:21564520,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:80dec81b679a733fda448be92a2331150d99095947d04003ecff3dbd7f2a476a k8s.gcr.io/sig-storage/csi-attacher:v3.3.0],SizeBytes:21444261,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:6029c252dae6178c99b580de72d7776158edbc81be0de15cedc4152a3acfed18 k8s.gcr.io/sig-storage/hostpathplugin:v1.7.3],SizeBytes:15224494,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:f9bcee63734b7b01555ee8fc8fb01ac2922478b2c8934bf8d468dd2916edc405 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.3.0],SizeBytes:8582494,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:bb6ed397957e9ca7c65ada0db5c5d1c707c9c8afc80a94acbe69f3ae76988f0c k8s.gcr.io/pause:3.7],SizeBytes:311278,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-volume-expand-9636^40436064-99b3-11ed-aefe-f2f9c54a4473],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-volume-expand-9636^40436064-99b3-11ed-aefe-f2f9c54a4473,DevicePath:,},},Config:nil,},} Jan 21 17:49:27.499: INFO: Logging kubelet events for node i-0d64fae545fa8bf3f Jan 21 17:49:27.716: INFO: Logging pods the kubelet thinks is on node i-0d64fae545fa8bf3f Jan 21 17:49:27.942: INFO: coredns-6dd78b7459-44jzj started at 2023-01-21 17:23:22 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:27.942: INFO: Container coredns ready: true, restart count 0 Jan 21 17:49:27.942: INFO: csi-hostpathplugin-0 started at 2023-01-21 17:44:10 +0000 UTC (0+7 container statuses recorded) Jan 21 17:49:27.942: INFO: Container csi-attacher ready: true, restart count 0 Jan 21 17:49:27.942: INFO: Container csi-provisioner ready: true, restart count 0 Jan 21 17:49:27.942: INFO: Container csi-resizer ready: true, restart count 0 Jan 21 17:49:27.942: INFO: Container csi-snapshotter ready: true, restart count 0 Jan 21 17:49:27.942: INFO: Container hostpath ready: true, restart count 0 Jan 21 17:49:27.942: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:49:27.942: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 21 17:49:27.942: INFO: netserver-2 started at 2023-01-21 17:44:45 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:27.942: INFO: Container webserver ready: false, restart count 0 Jan 21 17:49:27.942: INFO: csi-hostpathplugin-0 started at 2023-01-21 17:45:35 +0000 UTC (0+7 container statuses recorded) Jan 21 17:49:27.942: INFO: Container csi-attacher ready: false, restart count 0 Jan 21 17:49:27.942: INFO: Container csi-provisioner ready: false, restart count 0 Jan 21 17:49:27.942: INFO: Container csi-resizer ready: false, restart count 0 Jan 21 17:49:27.942: INFO: Container csi-snapshotter ready: false, restart count 0 Jan 21 17:49:27.942: INFO: Container hostpath ready: false, restart count 0 Jan 21 17:49:27.942: INFO: Container liveness-probe ready: false, restart count 0 Jan 21 17:49:27.942: INFO: Container node-driver-registrar ready: false, restart count 0 Jan 21 17:49:27.942: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-k5qhx started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:27.942: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:27.942: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-gj9hg started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:27.942: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:27.942: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-dhzrx started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:27.942: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:27.942: INFO: rs-rvl99 started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:27.942: INFO: Container donothing ready: false, restart count 0 Jan 21 17:49:27.942: INFO: pod-c4a96c13-73b3-4bb4-b100-d87d572fe413 started at 2023-01-21 17:44:29 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:27.942: INFO: Container write-pod ready: false, restart count 0 Jan 21 17:49:27.942: INFO: ebs-csi-node-k2jhx started at 2023-01-21 17:22:46 +0000 UTC (0+3 container statuses recorded) Jan 21 17:49:27.942: INFO: Container ebs-plugin ready: true, restart count 0 Jan 21 17:49:27.942: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 17:49:27.942: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 21 17:49:27.942: INFO: externalname-service-nz5lf started at 2023-01-21 17:44:17 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:27.942: INFO: Container externalname-service ready: false, restart count 0 Jan 21 17:49:27.942: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-fbjxh started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:27.942: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:27.942: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-zjvp4 started at 2023-01-21 17:37:50 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:27.942: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:27.942: INFO: rs-cgktj started at 2023-01-21 17:44:24 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:27.942: INFO: Container donothing ready: true, restart count 0 Jan 21 17:49:27.942: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-gplfc started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:27.942: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:27.942: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-kprqk started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:27.942: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:27.942: INFO: netserver-2 started at 2023-01-21 17:45:12 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:27.942: INFO: Container webserver ready: false, restart count 0 Jan 21 17:49:27.942: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-857g9 started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:27.942: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:27.942: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-hrf6g started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:27.942: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: true, restart count 0 Jan 21 17:49:27.942: INFO: cleanup40-df2c4948-0835-40d2-9733-d0baa036031e-nkjzz started at 2023-01-21 17:37:49 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:27.942: INFO: Container cleanup40-df2c4948-0835-40d2-9733-d0baa036031e ready: false, restart count 0 Jan 21 17:49:27.942: INFO: cilium-gv5dw started at 2023-01-21 17:22:46 +0000 UTC (1+1 container statuses recorded) Jan 21 17:49:27.942: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 21 17:49:27.942: INFO: Container cilium-agent ready: true, restart count 0 Jan 21 17:49:27.942: INFO: csi-mockplugin-0 started at 2023-01-21 17:47:26 +0000 UTC (0+3 container statuses recorded) Jan 21 17:49:27.942: INFO: Container csi-provisioner ready: false, restart count 0 Jan 21 17:49:27.942: INFO: Container driver-registrar ready: false, restart count 0 Jan 21 17:49:27.942: INFO: Container mock ready: false, restart count 0 Jan 21 17:49:27.942: INFO: csi-mockplugin-attacher-0 started at 2023-01-21 17:47:26 +0000 UTC (0+1 container statuses recorded) Jan 21 17:49:27.942: INFO: Container csi-attacher ready: false, restart count 0 Jan 21 17:49:28.667: INFO: Latency metrics for node i-0d64fae545fa8bf3f Jan 21 17:49:28.667: INFO: Logging node info for node i-0e989f541e95bf4a9 Jan 21 17:49:28.882: INFO: Node Info: &Node{ObjectMeta:{i-0e989f541e95bf4a9 bf125f17-fba9-4a1f-bf10-621d29cd68aa 33425 0 2023-01-21 17:22:44 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-southeast-1 failure-domain.beta.kubernetes.io/zone:ap-southeast-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0e989f541e95bf4a9 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-southeast-1a topology.hostpath.csi/node:i-0e989f541e95bf4a9 topology.kubernetes.io/region:ap-southeast-1 topology.kubernetes.io/zone:ap-southeast-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.55.136 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0e989f541e95bf4a9"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-21 17:22:44 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-21 17:22:44 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-21 17:22:44 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-21 17:22:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-21 17:22:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-21 17:37:47 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-21 17:38:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-southeast-1a/i-0e989f541e95bf4a9,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078206976 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973349376 0} {<n